-- Logs begin at Fri 2022-09-23 02:56:58 UTC, end at Fri 2022-09-23 05:27:17 UTC. -- Sep 23 03:27:21.621253 n-d-858495-2 systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 03:27:21.630439 n-d-858495-2 devstack@n-api.service[106412]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 03:27:21 2022] *** Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: nodename: n-d-858495-2 Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: machine: x86_64 Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: clock source: unix Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: pcre jit disabled Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: detected number of CPU cores: 4 Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: current working directory: / Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: detected binary path: /usr/bin/uwsgi-core Sep 23 03:27:21.633004 n-d-858495-2 devstack@n-api.service[106412]: your processes number limit is 47680 Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: your memory page size is 4096 bytes Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: detected max file descriptor number: 2048 Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: lock engine: pthread robust mutexes Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: thunder lock: enabled Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 03:27:21.633818 n-d-858495-2 devstack@n-api.service[106412]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 03:27:21.672685 n-d-858495-2 devstack@n-api.service[106412]: Python main interpreter initialized at 0x559aa098b9c0 Sep 23 03:27:21.672685 n-d-858495-2 devstack@n-api.service[106412]: python threads support enabled Sep 23 03:27:21.672685 n-d-858495-2 devstack@n-api.service[106412]: your server socket listen backlog is limited to 100 connections Sep 23 03:27:21.672685 n-d-858495-2 devstack@n-api.service[106412]: your mercy for graceful operations on workers is 90 seconds Sep 23 03:27:21.673004 n-d-858495-2 devstack@n-api.service[106412]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 03:27:21.673119 n-d-858495-2 devstack@n-api.service[106412]: *** Operational MODE: preforking *** Sep 23 03:27:21.673383 n-d-858495-2 devstack@n-api.service[106412]: *** uWSGI is running in multiple interpreter mode *** Sep 23 03:27:21.673383 n-d-858495-2 devstack@n-api.service[106412]: spawned uWSGI master process (pid: 106412) Sep 23 03:27:21.673549 n-d-858495-2 systemd[1]: Started Devstack devstack@n-api.service. Sep 23 03:27:21.674069 n-d-858495-2 devstack@n-api.service[106412]: spawned uWSGI worker 1 (pid: 106413, cores: 1) Sep 23 03:27:21.675111 n-d-858495-2 devstack@n-api.service[106412]: spawned uWSGI worker 2 (pid: 106414, cores: 1) Sep 23 03:27:21.675111 n-d-858495-2 devstack@n-api.service[106412]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 03:27:22.330543 n-d-858495-2 devstack@n-api.service[106414]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 03:27:22.337307 n-d-858495-2 devstack@n-api.service[106413]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 03:27:23.410920 n-d-858495-2 devstack@n-api.service[106414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:27:23.410920 n-d-858495-2 devstack@n-api.service[106414]: from cryptography.utils import int_from_bytes Sep 23 03:27:23.411557 n-d-858495-2 devstack@n-api.service[106414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:27:23.411557 n-d-858495-2 devstack@n-api.service[106414]: from cryptography.utils import int_from_bytes Sep 23 03:27:23.413122 n-d-858495-2 devstack@n-api.service[106413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:27:23.413122 n-d-858495-2 devstack@n-api.service[106413]: from cryptography.utils import int_from_bytes Sep 23 03:27:23.413565 n-d-858495-2 devstack@n-api.service[106413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:27:23.413565 n-d-858495-2 devstack@n-api.service[106413]: from cryptography.utils import int_from_bytes Sep 23 03:27:25.938996 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:27:25.939627 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:27:25.939768 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:27:25.940121 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:27:25.940372 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:27:25.940536 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:27:25.940924 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.941016 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:27:25.941103 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.941312 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:27:25.941454 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.941704 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.941808 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:27:25.941958 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:27:25.942067 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.942328 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.942432 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.942645 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.942730 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.942960 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.943056 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.943279 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.943371 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.944140 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.944453 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.944814 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.945137 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.945491 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.945754 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.945848 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946073 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946176 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946403 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858495-2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946510 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858495-2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946726 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.946825 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947031 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947129 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947338 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947421 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947652 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947736 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.947953 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.948049 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.948272 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.948371 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.948571 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.948655 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949064 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949480 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949633 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949742 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949853 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.949969 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950104 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950225 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950435 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950549 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950745 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.950843 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951048 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951133 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951364 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951451 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951666 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951759 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.951985 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952129 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952292 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952428 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952682 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858495-2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952774 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858495-2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.952996 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.953088 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.953303 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.953420 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.953644 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.953736 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954051 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954155 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954359 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954446 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954668 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954768 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.954980 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955064 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955297 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955388 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955600 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955703 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.955922 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956014 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956233 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956327 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956544 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956643 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956862 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.956975 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957154 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957248 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957484 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957585 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957787 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.957878 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958099 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958194 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958401 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958485 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958697 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958781 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.958943 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.959078 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.959786 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.959881 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960107 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960202 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960425 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960522 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960738 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960872 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.960983 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961080 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961227 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961315 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961564 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961651 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961880 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.961976 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962185 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962270 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962487 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962572 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962789 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.962883 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963089 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963175 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963389 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963483 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963689 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963788 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.963991 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964077 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964292 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964387 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964604 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964698 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.964913 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965007 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965230 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965317 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965556 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965645 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965868 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.965956 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966257 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966343 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966503 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966598 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966802 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.966901 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967137 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967243 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967443 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967532 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967745 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.967839 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968056 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968151 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968369 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968453 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968672 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968767 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.968968 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969065 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969271 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969380 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969606 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969701 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.969932 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970026 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970230 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970317 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970475 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970625 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970757 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.970856 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971052 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971148 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971363 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971456 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971664 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971758 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.971961 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972048 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972260 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972353 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972555 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972646 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972853 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.972937 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973151 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973247 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973474 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973575 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973775 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.973862 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974076 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974159 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974372 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974504 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974698 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.974782 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975000 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975085 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975298 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975392 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975593 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975688 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975904 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.975991 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976216 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976310 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976519 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976604 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976815 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.976910 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977119 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977247 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977439 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977537 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977753 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.977841 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978053 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978139 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978354 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978438 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978666 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978756 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.978967 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979052 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979262 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979353 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979572 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979668 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979871 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.979955 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980172 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980263 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980481 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980574 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980771 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.980856 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981072 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981165 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981399 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981503 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981702 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.981788 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982001 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982095 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982294 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982388 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982591 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982675 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982885 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.982972 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983182 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983269 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983475 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983565 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983772 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.983858 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984065 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984151 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984362 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984455 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984677 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984764 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.984974 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985075 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985291 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985435 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985596 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985688 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985907 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.985995 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:27:25.986236 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.986321 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.986560 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.986658 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.986898 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.986983 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987218 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987349 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987538 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987633 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987862 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.987947 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988176 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988260 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988481 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988580 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988790 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.988882 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989110 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989197 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989438 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989542 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989746 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.989830 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990052 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990150 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990390 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990565 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990703 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.990795 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991028 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991154 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991342 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991442 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991653 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991751 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.991967 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992064 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992274 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992360 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992586 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992683 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.992910 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993002 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993226 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993311 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993560 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993645 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993895 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.993981 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994236 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994331 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994550 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994673 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994869 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.994954 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995186 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995272 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995496 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995582 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995804 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.995898 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996110 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996195 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996445 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996538 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996756 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.996853 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997065 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997150 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997398 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997487 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997709 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.997811 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998029 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998114 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998338 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998433 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998646 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998739 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.998952 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999036 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999260 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999353 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999565 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999650 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999895 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:25.999980 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000204 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000289 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000522 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000607 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000831 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.000922 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001139 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001261 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001476 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001563 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001787 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.001871 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002091 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002175 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002398 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002493 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002700 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002784 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.002998 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003085 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003299 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003384 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003609 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003701 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.003914 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004012 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004228 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004321 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004549 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004634 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004851 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.004951 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.005180 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.005272 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.005508 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.005595 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.005816 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.006398 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.006635 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.006721 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.006943 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007039 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007247 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007341 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007554 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007646 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007860 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.007945 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008160 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008253 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008475 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008560 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008782 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.008868 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009084 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009171 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009426 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009515 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009732 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.009817 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010038 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010131 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010346 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010430 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010654 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010739 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.010961 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011048 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011270 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011400 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011576 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011671 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011894 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.011981 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012200 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012286 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012507 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012599 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012834 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.012920 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013160 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013244 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013482 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013581 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013804 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.013898 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014126 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014296 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014438 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014600 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014736 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.014828 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015042 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015127 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015340 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015439 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015640 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015725 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.015937 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016022 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016240 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016357 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016535 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016619 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016834 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.016919 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017130 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017218 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017451 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017546 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017750 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.017835 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018068 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018155 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018370 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018454 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018670 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018764 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.018967 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019053 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019262 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019355 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019598 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019694 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019896 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.019982 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020231 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020316 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020562 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020655 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020873 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.020966 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.021187 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.021273 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.021541 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.022150 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.022398 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.022485 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.022704 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.022793 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023014 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023098 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023320 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023405 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023627 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023720 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.023944 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024030 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024250 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024340 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024563 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024651 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024869 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.024996 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025188 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025280 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025516 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025602 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025833 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.025930 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026131 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026216 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026441 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026533 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026775 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.026868 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027103 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027194 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027414 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027507 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027729 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.027857 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028037 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028127 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028347 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028446 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028650 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028736 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.028953 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029045 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029257 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029382 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029587 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029683 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029897 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.029994 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030202 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030302 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030513 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030598 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030814 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.030900 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031129 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031225 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031433 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031517 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031742 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.031827 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032040 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032127 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032346 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032431 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032666 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032758 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.032992 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033079 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033298 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033406 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033631 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033726 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.033946 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034033 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034252 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034349 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034555 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034648 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034858 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.034953 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035159 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035243 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035456 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035549 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035760 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.035854 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036067 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036152 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036368 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036471 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036673 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036758 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.036972 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037055 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037311 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037432 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037641 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037735 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.037943 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038038 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038239 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038326 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038546 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038631 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038861 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.038945 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039167 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039254 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039482 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039568 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039796 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.039882 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.040097 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.040190 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.040393 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.040732 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.040962 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041053 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041268 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041420 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041592 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041735 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041893 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.041978 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042190 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042275 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042525 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042611 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042830 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.042924 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043127 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043212 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043438 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043523 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043755 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.043914 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.044508 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.044640 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.044750 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.044855 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.044958 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045072 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045160 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045236 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045303 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045441 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045564 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045665 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045870 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.045958 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046176 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046263 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046483 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046569 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046786 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.046871 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047092 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047179 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047408 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047496 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047713 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.047798 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048016 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048100 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048322 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048407 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048619 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048703 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.048925 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.049011 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.049238 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.049330 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.049822 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.049908 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050151 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050251 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050461 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050555 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050775 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.050861 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051117 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051222 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051431 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051526 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051755 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.051849 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.052081 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.052173 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.052388 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.052473 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.052687 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.053259 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.053532 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.053620 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.053842 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.053940 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054143 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054228 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054448 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054532 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054750 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.054848 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055050 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055135 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055350 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055437 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055657 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055755 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.055954 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056086 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056254 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056340 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056550 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056657 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056848 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.056935 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057153 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057239 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057478 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057567 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057787 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.057872 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058089 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058186 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058405 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058491 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058710 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.058803 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059008 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059100 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059308 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059402 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059607 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059691 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.059940 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060032 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060241 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060333 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060571 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060664 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060896 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.060990 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061227 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061312 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061556 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061641 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061857 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.061954 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062177 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062263 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062479 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062563 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062775 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.062877 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063074 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063159 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063376 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063461 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063680 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063772 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.063974 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064060 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064281 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064364 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064582 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064668 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064886 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.064973 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065190 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065273 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065512 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065600 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065816 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.065902 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066113 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066196 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066419 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066506 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066720 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.066815 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067018 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067114 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067317 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067404 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067620 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067713 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.067922 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.068082 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.068221 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.068313 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069067 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069171 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069381 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069484 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069698 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069785 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.069998 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070084 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070298 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070392 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070596 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070683 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070901 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.070987 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071203 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071304 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071501 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071585 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071815 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.071906 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072121 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072206 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072417 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072501 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072715 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.072798 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073018 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073103 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073315 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073414 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073640 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073725 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.073946 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074039 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074262 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074355 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074573 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074668 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074871 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.074957 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075177 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075263 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075476 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075617 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075773 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.075858 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076071 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076157 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076370 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076464 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076667 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076751 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.076962 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077045 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077259 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077408 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077582 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077679 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077878 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.077963 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078193 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078287 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078493 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078577 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078789 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.078874 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079088 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079175 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079386 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079469 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079719 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.079805 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080017 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080112 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080373 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080458 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080673 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080757 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.080983 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081070 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081295 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081398 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081633 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081717 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.081939 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082026 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082247 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082332 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082544 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082638 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082853 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.082946 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083159 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083252 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083463 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083564 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083761 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.083846 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084085 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084175 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084401 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084496 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084708 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.084800 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085012 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085097 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085327 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085508 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085670 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085756 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.085987 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086081 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086287 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086373 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086587 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086673 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086892 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.086977 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087191 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087289 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087497 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087591 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087800 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.087886 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088107 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088194 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088414 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088507 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088720 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.088805 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089024 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089110 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089331 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089452 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089660 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089757 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.089962 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090047 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090266 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090350 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090563 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090657 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090883 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.090970 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091188 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091271 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091484 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091578 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091787 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.091873 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092087 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092211 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092392 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092490 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092693 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.092777 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093111 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093195 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093442 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093544 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093752 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.093839 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094051 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094136 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094356 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094449 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094662 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094747 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.094969 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095054 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095277 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095363 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095578 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095663 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.095988 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096075 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096295 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096382 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096600 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096692 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.096906 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097068 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097207 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097295 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097531 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097618 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097840 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.097937 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098157 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098251 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098457 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098551 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098756 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.098854 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099053 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099137 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099368 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099455 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099689 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.099786 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100008 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100092 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100418 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100504 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100727 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.100813 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101025 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101117 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101457 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101548 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101767 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.101855 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102071 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102178 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102386 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102476 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102703 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.102789 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103024 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103111 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103324 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103412 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103630 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103716 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.103936 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104024 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104256 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104341 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104575 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104673 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104885 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.104972 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105195 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105280 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105523 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105611 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105846 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.105971 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106162 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106275 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106526 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106658 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106767 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.106861 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107174 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107262 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107494 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107657 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107802 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.107887 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108115 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108207 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108435 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108568 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108735 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.108820 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109035 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109131 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109337 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109489 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109659 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109745 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.109960 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110056 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110277 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110364 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110577 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110674 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110884 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.110977 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111188 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111274 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111492 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111576 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111791 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.111878 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112088 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112181 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112403 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112488 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112701 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.112804 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113015 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113101 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113322 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113462 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113662 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113808 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.113980 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114066 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114278 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114401 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114596 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114696 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114901 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.114988 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.115199 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.115779 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116020 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116185 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116326 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116670 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116767 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.116974 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.117294 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.117399 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.117655 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.117890 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.117978 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.118282 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.118476 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.118614 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.118939 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.119062 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.119259 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.119569 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.119663 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.119885 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.120192 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.120281 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.120501 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.120805 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.120900 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121114 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121288 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121458 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121670 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121768 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.121995 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122082 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122326 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122413 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122641 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122729 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.122944 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123021 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123248 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123325 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123560 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123647 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.123872 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.124070 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.124181 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.124514 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.124672 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.124800 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.125104 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.125255 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.125430 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.125738 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.125867 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126158 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126244 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126475 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126551 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126801 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.126909 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127111 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127211 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127416 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127502 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127722 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.127819 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128027 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128117 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128368 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128464 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128673 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128772 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.128998 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129094 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129319 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129432 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129662 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129740 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.129984 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130059 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130302 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130394 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130616 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130693 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.130957 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.131535 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.131888 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.131978 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.132123 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.132396 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.132657 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.132963 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.133050 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.133309 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.133572 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.133672 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.133971 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.134151 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.134295 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.134733 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.134821 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.135154 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.135320 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.135476 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.135793 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.135887 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.136114 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.136368 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.136529 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.136695 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.136857 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137020 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137170 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137338 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137508 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137702 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.137822 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138034 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138134 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138368 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138462 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138712 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.138815 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139039 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139135 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139360 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139447 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139680 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139776 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.139991 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140127 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140307 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140402 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140621 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140718 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.140946 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141033 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141264 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141380 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141608 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141697 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.141938 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142076 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142232 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142328 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142541 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142626 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142850 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.142981 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143444 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143575 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143575 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143735 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143817 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.143885 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144066 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144166 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144374 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144469 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144688 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.144773 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145001 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145089 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145323 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145463 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145663 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145751 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.145979 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146067 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146292 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146377 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146648 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146842 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.146964 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.147164 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.147501 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.147594 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.147838 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.147938 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148166 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148258 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148488 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148582 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148805 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.148899 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149123 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149210 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149455 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149544 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149767 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.149867 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150074 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150168 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150377 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150463 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150679 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150773 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.150983 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151070 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151285 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151371 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151594 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151681 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151898 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.151992 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.152201 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.152287 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.152518 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.152730 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.152827 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.153080 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.153336 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.153454 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.153703 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.153793 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154045 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154177 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154363 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154458 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154670 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154758 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.154991 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155077 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155294 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155388 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155598 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155683 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155910 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.155994 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.156219 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.156313 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.156523 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.156609 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.156828 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157005 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157134 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157453 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157544 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157764 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.157877 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.158075 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.158305 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.158408 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.158691 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.158777 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159000 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159178 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159307 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159611 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159696 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.159926 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160070 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160232 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160536 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160622 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160841 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.160983 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.161146 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.161431 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.161533 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.161778 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.161873 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.162088 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.162366 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.162463 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.162717 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.162835 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163072 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163279 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163365 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163590 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163678 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163899 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.163986 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164215 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164301 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164521 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164608 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164829 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.164916 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.165134 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.165221 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.165723 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.165820 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166051 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166148 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166366 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166460 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166666 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166752 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.166987 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.167080 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.167290 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.167533 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.167657 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.167873 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168087 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168196 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168513 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168608 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168849 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.168983 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.169160 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.169489 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.169579 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.169797 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.169968 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.170122 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.170433 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.170530 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.170745 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.170904 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.171054 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.171363 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.171669 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.171756 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.171976 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.172181 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.172267 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.172577 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.172669 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.172887 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173089 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173183 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173451 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173541 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173766 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.173863 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174078 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174166 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174389 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174474 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174698 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.174793 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175017 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175103 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175331 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175417 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175643 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175737 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.175954 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176040 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176262 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176347 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176568 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176671 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176873 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.176959 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.177178 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.177296 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.177515 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.177754 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.178370 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.178685 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.178772 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.179002 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.179174 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.179308 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.179645 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.179993 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.180129 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.180318 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.180567 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.180658 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.180960 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.181046 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.181276 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.181494 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.181628 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.181959 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.182057 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.182280 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.182444 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.182608 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.182921 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183008 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183244 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183338 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183558 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183660 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183869 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.183957 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184179 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184265 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184488 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184585 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184794 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.184879 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185100 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185187 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185440 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185546 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185760 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.185847 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186071 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186376 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186470 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186682 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186768 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.186992 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187165 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187296 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187596 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187683 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187901 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.187999 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.188204 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.188471 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.188559 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.188804 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.188959 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.189157 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.189439 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.189545 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.189746 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.189928 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190049 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190351 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190436 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190661 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190801 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.190967 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.191274 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.191360 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.191577 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.191785 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.191881 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192167 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192309 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192499 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192625 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192834 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.192920 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.193150 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.193235 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194030 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194141 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194357 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194490 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194681 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194769 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.194995 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195090 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195300 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195386 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195609 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195704 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.195912 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196000 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196219 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196305 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196522 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196611 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196846 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.196933 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197158 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197245 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197494 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197626 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197813 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.197902 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198114 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198199 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198417 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198503 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198720 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.198807 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199021 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199114 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199328 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199424 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199631 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199717 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.199934 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200028 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200235 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200334 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200535 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200616 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200834 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.200921 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201163 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201264 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201511 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201600 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201823 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.201909 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202134 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202222 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202441 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202527 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202752 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.202838 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203058 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203145 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203370 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203463 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203684 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203771 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.203996 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204084 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204303 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204390 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204634 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204719 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.204944 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205040 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205254 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205409 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205589 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205689 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205898 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.205993 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206209 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206296 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206516 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206611 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206841 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.206934 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207165 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207260 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207472 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207568 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207790 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.207876 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.208096 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.208195 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.208342 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:27:26.208430 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.208716 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.209044 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.209400 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.209717 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.210029 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.210337 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.210647 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.210955 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.211269 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.211578 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.211889 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.212204 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.212517 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.212842 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.213163 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.213499 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.213826 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.214149 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.214491 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.214802 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.215139 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.215461 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.215774 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.216090 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.216391 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:27:26.216632 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:27:26.360577 n-d-858495-2 devstack@n-api.service[106414]: INFO dbcounter [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Registered counter for database nova_api Sep 23 03:27:26.368282 n-d-858495-2 devstack@n-api.service[106413]: INFO dbcounter [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Registered counter for database nova_api Sep 23 03:27:26.382969 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_db.sqlalchemy.engines [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.388383 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_db.sqlalchemy.engines [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.389641 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writer thread running {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.394761 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writer thread running {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.447800 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.context [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=106414) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:27:26.451194 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.context [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=106413) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:27:26.451629 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:27:26.452097 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:27:26.453694 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:27:26.454412 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:27:26.454854 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:27:26.454989 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:27:26.455455 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:27:26.456911 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_concurrency.lockutils [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:27:26.457073 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:27:26.457750 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:27:26.458173 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:27:26.461281 n-d-858495-2 devstack@n-api.service[106414]: INFO dbcounter [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Registered counter for database nova_cell0 Sep 23 03:27:26.461460 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:27:26.463879 n-d-858495-2 devstack@n-api.service[106414]: INFO dbcounter [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Registered counter for database nova_cell1 Sep 23 03:27:26.464317 n-d-858495-2 devstack@n-api.service[106413]: INFO dbcounter [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Registered counter for database nova_cell0 Sep 23 03:27:26.468815 n-d-858495-2 devstack@n-api.service[106413]: INFO dbcounter [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Registered counter for database nova_cell1 Sep 23 03:27:26.471458 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_db.sqlalchemy.engines [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.473997 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_db.sqlalchemy.engines [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.475619 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_db.sqlalchemy.engines [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.477808 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_db.sqlalchemy.engines [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.480364 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writer thread running {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.481849 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writer thread running {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.483097 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writer thread running {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.485048 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writer thread running {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.626106 n-d-858495-2 devstack@n-api.service[106414]: INFO dbcounter [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Registered counter for database nova_cell0 Sep 23 03:27:26.628010 n-d-858495-2 devstack@n-api.service[106413]: INFO dbcounter [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Registered counter for database nova_cell0 Sep 23 03:27:26.635734 n-d-858495-2 devstack@n-api.service[106414]: DEBUG oslo_db.sqlalchemy.engines [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.638952 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_db.sqlalchemy.engines [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:27:26.640232 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writer thread running {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.643749 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writer thread running {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:27:26.977721 n-d-858495-2 devstack@n-api.service[106413]: WARNING keystonemiddleware.auth_token [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:27:26.979626 n-d-858495-2 devstack@n-api.service[106414]: WARNING keystonemiddleware.auth_token [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:27:26.984978 n-d-858495-2 devstack@n-api.service[106413]: WARNING keystonemiddleware.auth_token [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:27:26.986957 n-d-858495-2 devstack@n-api.service[106414]: WARNING keystonemiddleware.auth_token [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:27:27.329721 n-d-858495-2 devstack@n-api.service[106414]: WARNING keystonemiddleware.auth_token [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:27:27.329910 n-d-858495-2 devstack@n-api.service[106413]: WARNING keystonemiddleware.auth_token [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:27:27.336158 n-d-858495-2 devstack@n-api.service[106414]: WARNING keystonemiddleware.auth_token [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:27:27.336416 n-d-858495-2 devstack@n-api.service[106413]: WARNING keystonemiddleware.auth_token [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:27:27.341507 n-d-858495-2 devstack@n-api.service[106414]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559aa098b9c0 pid: 106414 (default app) Sep 23 03:27:27.341667 n-d-858495-2 devstack@n-api.service[106413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559aa098b9c0 pid: 106413 (default app) Sep 23 03:27:27.343774 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:27.344982 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-57b35cd9-bc2a-4111-b7c5-d0029fd81971 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001971 Sep 23 03:27:27.345426 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Fri Sep 23 03:27:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:28:47.653235 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:47.655221 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002826 Sep 23 03:28:47.655832 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:28:47.667203 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_api:SELECT=3 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:47.668314 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_cell0:SELECT=3 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:47.669407 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_cell1:SELECT=3 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:47.671433 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:48.522080 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-22309576-5317-4d0c-9d22-944e1307b633 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:48.554705 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-22309576-5317-4d0c-9d22-944e1307b633 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892977 Sep 23 03:28:48.555447 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:28:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:28:51.173153 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:51.174779 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-f8dac1b5-a3ce-43de-9191-61cb51b7f528 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Sep 23 03:28:51.175525 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:28:51.622967 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-9fd96f36-7e3f-4e59-91cf-7e2070d2aeb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:51.669317 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-9fd96f36-7e3f-4e59-91cf-7e2070d2aeb8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487281 Sep 23 03:28:51.669925 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:28:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:28:51.684096 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_api:SELECT=3 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:51.684925 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_cell0:SELECT=3 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:51.686921 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_cell1:SELECT=3 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:51.687643 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:28:51.900133 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-bf1159b5-7760-4f13-b485-b9f7bbed1f3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:51.969192 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-bf1159b5-7760-4f13-b485-b9f7bbed1f3a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290038 Sep 23 03:28:51.969748 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 23 03:28:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:28:54.602140 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-9fd96f36-7e3f-4e59-91cf-7e2070d2aeb8 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:54.603747 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-9fd96f36-7e3f-4e59-91cf-7e2070d2aeb8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Sep 23 03:28:54.604168 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:28:55.343456 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-87501d58-d635-4536-8377-1b7aa11d9a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:55.390331 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-87501d58-d635-4536-8377-1b7aa11d9a70 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779415 Sep 23 03:28:55.392224 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:28:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:28:55.406111 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-05b031f0-fd9d-4287-a7aa-97a06642848f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:55.479108 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-05b031f0-fd9d-4287-a7aa-97a06642848f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078639 Sep 23 03:28:55.480246 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 23 03:28:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:28:58.184722 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-87501d58-d635-4536-8377-1b7aa11d9a70 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:58.185817 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-87501d58-d635-4536-8377-1b7aa11d9a70 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 23 03:28:58.186478 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:28:58.710842 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-5809a432-3286-48fd-aa7f-3b9860803198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:58.762622 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-5809a432-3286-48fd-aa7f-3b9860803198 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.567678 Sep 23 03:28:58.772526 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:28:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:28:58.794831 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-319b442d-9f77-4d77-a372-fac32c19cfb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:28:58.827045 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-319b442d-9f77-4d77-a372-fac32c19cfb6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044687 Sep 23 03:28:58.828287 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 23 03:28:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:01.465203 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-5809a432-3286-48fd-aa7f-3b9860803198 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:01.466939 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-5809a432-3286-48fd-aa7f-3b9860803198 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Sep 23 03:29:01.468140 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:01.912049 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-cab235c2-739f-457b-9d89-34b1a3db0f8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:01.933059 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-cab235c2-739f-457b-9d89-34b1a3db0f8b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458560 Sep 23 03:29:01.933650 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:01.946144 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-dd5ba1ea-990e-4a93-8fa3-d457d00c983b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:01.976550 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-dd5ba1ea-990e-4a93-8fa3-d457d00c983b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034138 Sep 23 03:29:01.977148 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 23 03:29:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:04.680310 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-cab235c2-739f-457b-9d89-34b1a3db0f8b admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:04.681960 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-cab235c2-739f-457b-9d89-34b1a3db0f8b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Sep 23 03:29:04.686111 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:05.166293 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 20}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:05.190349 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501917 Sep 23 03:29:05.191382 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:05.203157 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-1ac0b008-ba19-4251-992f-82a1c61712c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:05.228686 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-1ac0b008-ba19-4251-992f-82a1c61712c7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029093 Sep 23 03:29:05.250405 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 23 03:29:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:07.865288 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:07.866335 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 23 03:29:07.866735 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:08.340325 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-169f46fb-84ab-4aca-bf6d-a72a19bf6b83 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:08.365008 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-169f46fb-84ab-4aca-bf6d-a72a19bf6b83 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.491982 Sep 23 03:29:08.365581 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:29:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:29:11.006005 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:11.006948 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-12ae171e-36fe-4134-b997-97dccdcb03b6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 23 03:29:11.007358 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:29:11.522558 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-a0e36290-3354-4465-bb13-16e5008e8f86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:11.545457 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-a0e36290-3354-4465-bb13-16e5008e8f86 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.531484 Sep 23 03:29:11.545958 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:11.558996 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-e6d7c838-927b-4c7c-9c31-b462385fa490 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:11.597783 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-e6d7c838-927b-4c7c-9c31-b462385fa490 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042295 Sep 23 03:29:11.598511 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 23 03:29:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:14.249600 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-a0e36290-3354-4465-bb13-16e5008e8f86 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:14.250662 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-a0e36290-3354-4465-bb13-16e5008e8f86 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Sep 23 03:29:14.251067 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:29:14.650413 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-d161c5b7-080a-4bf8-aa15-6fb7d41fb035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:14.669277 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-d161c5b7-080a-4bf8-aa15-6fb7d41fb035 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412180 Sep 23 03:29:14.669963 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:14.681707 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-1c31c712-f91a-47fb-ab13-0633c4538acb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:14.705781 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-1c31c712-f91a-47fb-ab13-0633c4538acb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027587 Sep 23 03:29:14.706368 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 23 03:29:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:17.282722 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-d161c5b7-080a-4bf8-aa15-6fb7d41fb035 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:17.283716 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-d161c5b7-080a-4bf8-aa15-6fb7d41fb035 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Sep 23 03:29:17.284120 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:17.663011 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-6f82b1c1-2ca9-44fc-b14a-c7e06bb81248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "swap": 0}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:17.683659 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-6f82b1c1-2ca9-44fc-b14a-c7e06bb81248 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.391685 Sep 23 03:29:17.684213 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:17.697274 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-fe72eea0-053e-4436-a039-d7805a7836b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:17.704295 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:29:17.729590 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-fe72eea0-053e-4436-a039-d7805a7836b3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036071 Sep 23 03:29:17.730197 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 23 03:29:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:29:20.423672 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-6f82b1c1-2ca9-44fc-b14a-c7e06bb81248 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:20.424696 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-6f82b1c1-2ca9-44fc-b14a-c7e06bb81248 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 23 03:29:20.425098 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:29:20.871883 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-a6d5b8cd-04b0-4b82-a819-385efc121e66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:20.896649 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-a6d5b8cd-04b0-4b82-a819-385efc121e66 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465505 Sep 23 03:29:20.897314 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:20.909297 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-52ac26c6-55c5-4a9f-8d29-f44912ccb92e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:20.933646 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-52ac26c6-55c5-4a9f-8d29-f44912ccb92e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027911 Sep 23 03:29:20.949826 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 23 03:29:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:23.555103 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-a6d5b8cd-04b0-4b82-a819-385efc121e66 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:23.556350 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-a6d5b8cd-04b0-4b82-a819-385efc121e66 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Sep 23 03:29:23.556973 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:24.032764 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:24.041770 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:29:24.055688 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.491870 Sep 23 03:29:24.056403 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 23 03:29:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:29:24.068990 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-6ee9a782-0658-4d03-8d7e-e683584a69fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:24.095836 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-6ee9a782-0658-4d03-8d7e-e683584a69fb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030416 Sep 23 03:29:24.096424 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 23 03:29:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:45.899287 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:45.900299 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 23 03:29:45.900706 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:45.911886 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:29:46.290496 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-61f54721-ae85-45a9-916b-21b612f866d9 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:46.308711 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-61f54721-ae85-45a9-916b-21b612f866d9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401167 Sep 23 03:29:46.309186 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:29:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:47.610358 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:47.611374 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-31d3abd2-65c2-4794-9cf8-7c557605e1fc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 23 03:29:47.611927 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:48.157978 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-11a47220-a398-4caa-8089-f021932749ae admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:48.163510 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.wsgi [None req-11a47220-a398-4caa-8089-f021932749ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-11a47220-a398-4caa-8089-f021932749ae admin admin] Request method failure captured: Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Accept: application/json Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Accept-Encoding: gzip, deflate Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Connection: keep-alive Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Content-Length: 0 Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Host: 10.222.0.25 Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: Openstack-System-Scope: None Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: User-Agent: python-novaclient Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Auth-Token: gAAAAABjLSgrem_bO0pmehqGSfGtPU6y-2Lj0lG9lYECs2SdeFfLUNJ-Pki9MZoPaGhLvpzBK-qweulEe9IXFWIPowdOD82A6ZRmGJyJZNwsLQ6BD4nrMtv1urSjriQWZ_NCo4YHvULDGPO1gLdcfxZoTra_VCfYyZujUoyGtMNUHKsEQUxT5oA Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Id: None Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Name: None Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Identity-Status: Confirmed Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Is-Admin-Project: True Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Id: default Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Name: Default Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Name: admin Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Role: admin,reader,member Sep 23 03:29:48.166733 n-d-858495-2 devstack@n-api.service[106414]: X-Roles: admin,reader,member Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant: admin Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Name: admin Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-User: admin Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Id: default Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Name: Default Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: X-User-Name: admin Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: method: > Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: exception: Flavor 42 could not be found. Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: action_args: {'id': '42'} Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:48.168465 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:48.169480 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.170860 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-11a47220-a398-4caa-8089-f021932749ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:48.172696 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-11a47220-a398-4caa-8089-f021932749ae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392720 Sep 23 03:29:48.172696 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 23 03:29:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:29:48.178712 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-029bf818-7610-4ee5-b943-86b5b3566ffb admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:48.201373 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-029bf818-7610-4ee5-b943-86b5b3566ffb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026535 Sep 23 03:29:48.201939 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:48.212751 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-33294604-d319-40b8-91a7-baa135619732 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:48.235378 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-33294604-d319-40b8-91a7-baa135619732 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027073 Sep 23 03:29:48.236037 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:48.245068 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-413292cb-2d0b-470c-a819-2a9c49ba5080 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:48.250819 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.wsgi [None req-413292cb-2d0b-470c-a819-2a9c49ba5080 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-413292cb-2d0b-470c-a819-2a9c49ba5080 admin admin] Request method failure captured: Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Accept: application/json Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Accept-Encoding: gzip, deflate Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Connection: keep-alive Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Content-Length: 0 Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Host: 10.222.0.25 Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: Openstack-System-Scope: None Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: User-Agent: python-novaclient Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Auth-Token: gAAAAABjLSgrem_bO0pmehqGSfGtPU6y-2Lj0lG9lYECs2SdeFfLUNJ-Pki9MZoPaGhLvpzBK-qweulEe9IXFWIPowdOD82A6ZRmGJyJZNwsLQ6BD4nrMtv1urSjriQWZ_NCo4YHvULDGPO1gLdcfxZoTra_VCfYyZujUoyGtMNUHKsEQUxT5oA Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Id: None Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Name: None Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Identity-Status: Confirmed Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Is-Admin-Project: True Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Id: default Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Name: Default Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Name: admin Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Role: admin,reader,member Sep 23 03:29:48.254093 n-d-858495-2 devstack@n-api.service[106413]: X-Roles: admin,reader,member Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant: admin Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Name: admin Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-User: admin Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Id: default Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Name: Default Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: X-User-Name: admin Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: method: > Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: exception: Flavor 42 could not be found. Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: action_args: {'id': '42'} Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:48.255587 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:48.256516 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:48.257812 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-413292cb-2d0b-470c-a819-2a9c49ba5080 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:48.259086 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-413292cb-2d0b-470c-a819-2a9c49ba5080 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013970 Sep 23 03:29:48.259086 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 23 03:29:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:29:49.461819 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-33294604-d319-40b8-91a7-baa135619732 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:49.462832 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-33294604-d319-40b8-91a7-baa135619732 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 23 03:29:49.463237 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:49.977638 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-be450cd9-9eb2-4fac-b869-38105485996b admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:49.982855 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.wsgi [None req-be450cd9-9eb2-4fac-b869-38105485996b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-be450cd9-9eb2-4fac-b869-38105485996b admin admin] Request method failure captured: Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Accept: application/json Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Accept-Encoding: gzip, deflate Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Connection: keep-alive Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Content-Length: 0 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Host: 10.222.0.25 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: Openstack-System-Scope: None Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: User-Agent: python-novaclient Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Auth-Token: gAAAAABjLSgtLLGud29QNoahNwym5hAt34bAtrRl68rdkKLHIgLT0TEMVLjC44V9tT_ub40Rz-izWxk2DmtFpiduHKPbBSdSJ6ktQwvOt5rUBcloIJlg2w8cD_3LL8LoTkZAGKEeQ1uSdBLbEWABK63crIlDP3lslEDls9uVVfc-q-D9-6u5MN8 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Id: None Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Name: None Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Identity-Status: Confirmed Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Is-Admin-Project: True Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Id: default Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Name: Default Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Name: admin Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Role: admin,reader,member Sep 23 03:29:49.984421 n-d-858495-2 devstack@n-api.service[106413]: X-Roles: admin,reader,member Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant: admin Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Name: admin Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-User: admin Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Id: default Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Name: Default Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: X-User-Name: admin Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: method: > Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: exception: Flavor 84 could not be found. Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: action_args: {'id': '84'} Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:49.986003 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:49.986841 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:49.987977 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-be450cd9-9eb2-4fac-b869-38105485996b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:49.989184 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-be450cd9-9eb2-4fac-b869-38105485996b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387116 Sep 23 03:29:49.989184 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 23 03:29:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:29:49.995393 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-aea0d8b2-8537-4e12-942f-fefeb40987d7 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:50.010416 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-aea0d8b2-8537-4e12-942f-fefeb40987d7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018554 Sep 23 03:29:50.010934 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:50.020751 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-bc4ec840-591d-4104-9037-c688ec060800 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:50.035814 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-bc4ec840-591d-4104-9037-c688ec060800 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018526 Sep 23 03:29:50.036339 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:50.045675 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-854dbe92-120d-4021-a3d4-c74be212a089 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:50.051009 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.wsgi [None req-854dbe92-120d-4021-a3d4-c74be212a089 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-854dbe92-120d-4021-a3d4-c74be212a089 admin admin] Request method failure captured: Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Accept: application/json Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Accept-Encoding: gzip, deflate Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Connection: keep-alive Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Content-Length: 0 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Host: 10.222.0.25 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: Openstack-System-Scope: None Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: User-Agent: python-novaclient Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Auth-Token: gAAAAABjLSgtLLGud29QNoahNwym5hAt34bAtrRl68rdkKLHIgLT0TEMVLjC44V9tT_ub40Rz-izWxk2DmtFpiduHKPbBSdSJ6ktQwvOt5rUBcloIJlg2w8cD_3LL8LoTkZAGKEeQ1uSdBLbEWABK63crIlDP3lslEDls9uVVfc-q-D9-6u5MN8 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Id: None Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Name: None Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Identity-Status: Confirmed Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Is-Admin-Project: True Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Id: default Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Name: Default Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Name: admin Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Role: admin,reader,member Sep 23 03:29:50.052480 n-d-858495-2 devstack@n-api.service[106414]: X-Roles: admin,reader,member Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant: admin Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Name: admin Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-User: admin Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Id: default Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Name: Default Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: X-User-Name: admin Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: method: > Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: exception: Flavor 84 could not be found. Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: action_args: {'id': '84'} Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:50.054000 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:50.055067 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:50.056157 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-854dbe92-120d-4021-a3d4-c74be212a089 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:50.057127 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-854dbe92-120d-4021-a3d4-c74be212a089 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011573 Sep 23 03:29:50.057127 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 23 03:29:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 03:29:51.273541 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-bc4ec840-591d-4104-9037-c688ec060800 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:51.274543 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-bc4ec840-591d-4104-9037-c688ec060800 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 23 03:29:51.274938 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:51.786748 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-ea1861c7-79e1-4109-8cb3-cae6f9e0ee08 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:51.793100 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.wsgi [None req-ea1861c7-79e1-4109-8cb3-cae6f9e0ee08 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-ea1861c7-79e1-4109-8cb3-cae6f9e0ee08 admin admin] Request method failure captured: Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Accept: application/json Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Accept-Encoding: gzip, deflate Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Connection: keep-alive Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Content-Length: 0 Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Host: 10.222.0.25 Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: Openstack-System-Scope: None Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: User-Agent: python-novaclient Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Auth-Token: gAAAAABjLSgv6RBjjnhwWn5Uf0_IrvAA9gXET5o3QpKQqj3jaF2VszpasbIz1Yl6wm22jP2hh-iZwDuJE6m3RJ7HJGwC3RZeBWdmvxG7C5LgMEGyaaEuc59jJkXVQ-ieRPb4gkj9aGQhwOegJoY9KfXKdGI4P0BctptLspOmA9jvPzq5HXOKjZg Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Id: None Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Domain-Name: None Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Identity-Status: Confirmed Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Is-Admin-Project: True Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Id: default Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Domain-Name: Default Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Project-Name: admin Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Role: admin,reader,member Sep 23 03:29:51.794612 n-d-858495-2 devstack@n-api.service[106414]: X-Roles: admin,reader,member Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant: admin Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-Tenant-Name: admin Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-User: admin Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Id: default Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-User-Domain-Name: Default Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: X-User-Name: admin Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: method: > Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: exception: Flavor 451 could not be found. Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: action_args: {'id': '451'} Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:51.796070 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:51.797485 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.798774 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-ea1861c7-79e1-4109-8cb3-cae6f9e0ee08 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:51.799834 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-ea1861c7-79e1-4109-8cb3-cae6f9e0ee08 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385826 Sep 23 03:29:51.799834 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:29:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:29:51.808882 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-a4efa667-ada0-47b8-950b-5ad5c7661266 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:51.824451 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-a4efa667-ada0-47b8-950b-5ad5c7661266 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019234 Sep 23 03:29:51.825011 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:29:51.834227 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:51.848641 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017882 Sep 23 03:29:51.849154 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 23 03:29:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:29:51.858037 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-48de6101-5a54-4ac4-ad6e-60e5022c3714 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:51.863312 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.wsgi [None req-48de6101-5a54-4ac4-ad6e-60e5022c3714 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-48de6101-5a54-4ac4-ad6e-60e5022c3714 admin admin] Request method failure captured: Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Accept: application/json Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Accept-Encoding: gzip, deflate Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Connection: keep-alive Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Content-Length: 0 Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Host: 10.222.0.25 Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Openstack-Api-Version: compute 2.92 Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: Openstack-System-Scope: None Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: User-Agent: python-novaclient Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Auth-Token: gAAAAABjLSgv6RBjjnhwWn5Uf0_IrvAA9gXET5o3QpKQqj3jaF2VszpasbIz1Yl6wm22jP2hh-iZwDuJE6m3RJ7HJGwC3RZeBWdmvxG7C5LgMEGyaaEuc59jJkXVQ-ieRPb4gkj9aGQhwOegJoY9KfXKdGI4P0BctptLspOmA9jvPzq5HXOKjZg Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Id: None Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Domain-Name: None Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Identity-Status: Confirmed Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Is-Admin-Project: True Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Id: default Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Domain-Name: Default Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Project-Name: admin Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Role: admin,reader,member Sep 23 03:29:51.864783 n-d-858495-2 devstack@n-api.service[106413]: X-Roles: admin,reader,member Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31bf5ea9987e418b98ad9cf36547db8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant: admin Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Id: 31bf5ea9987e418b98ad9cf36547db8f Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-Tenant-Name: admin Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-User: admin Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Id: default Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-User-Domain-Name: Default Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-User-Id: cf1fae532e4f43a8817b660be17ef01a Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: X-User-Name: admin Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: method: > Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: exception: Flavor 451 could not be found. Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: action_args: {'id': '451'} Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:29:51.866338 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:51.867491 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: ERROR nova.api.openstack.wsgi Sep 23 03:29:51.868833 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-48de6101-5a54-4ac4-ad6e-60e5022c3714 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:29:51.870077 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-48de6101-5a54-4ac4-ad6e-60e5022c3714 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011491 Sep 23 03:29:51.870077 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:29:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:29:53.079704 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:53.080702 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 23 03:29:53.081099 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:53.588539 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-dd5ec1e8-eb27-4f8c-b955-5575ef19b06f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:53.607931 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-dd5ec1e8-eb27-4f8c-b955-5575ef19b06f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.390545 Sep 23 03:29:53.608463 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 23 03:29:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:54.816597 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:54.817607 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 23 03:29:54.818003 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:55.326727 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-8fecfe76-280e-4c1a-840c-c08466b167f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:55.344719 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-8fecfe76-280e-4c1a-840c-c08466b167f0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.392630 Sep 23 03:29:55.345259 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 23 03:29:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:56.556369 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:56.557367 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 23 03:29:56.557775 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:57.077002 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-b5f7a5bb-f222-45ae-9f5a-205810144e73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:57.097334 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-b5f7a5bb-f222-45ae-9f5a-205810144e73 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403594 Sep 23 03:29:57.097932 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 23 03:29:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:58.318287 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:58.319286 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 23 03:29:58.319680 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:58.839870 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-9179ae83-ff2f-4163-8c50-9204158756e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:58.858033 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-9179ae83-ff2f-4163-8c50-9204158756e8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399477 Sep 23 03:29:58.858587 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 23 03:29:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:00.188559 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:00.189599 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 23 03:30:00.190022 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:00.706750 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-f5edf253-eb74-4d59-9f42-011c5533e876 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:00.726863 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-f5edf253-eb74-4d59-9f42-011c5533e876 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402631 Sep 23 03:30:00.727343 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Sep 23 03:30:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:30:57.065999 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.066973 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-804dd722-dc63-437e-8713-f991fc6f916c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 23 03:30:57.067378 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:57.078432 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:30:57.457574 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-5331e822-887e-4791-81a4-104d6fd99db6 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.480541 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-5331e822-887e-4791-81a4-104d6fd99db6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407002 Sep 23 03:30:57.481093 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:30:57.502421 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_api:SELECT=14 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:30:57.506598 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-8689b3b2-08fd-4504-8fdb-f653788ed52b admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.514551 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-8689b3b2-08fd-4504-8fdb-f653788ed52b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013645 Sep 23 03:30:57.515441 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:30:57.527125 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-ea5fa4fd-5ec5-4be6-88e1-a367ed365ee8 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.534740 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-ea5fa4fd-5ec5-4be6-88e1-a367ed365ee8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Sep 23 03:30:57.535280 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:30:57.547659 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.554963 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010939 Sep 23 03:30:57.555482 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:30:57.567531 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-80b188d0-9a23-49ae-9292-6f08e1ba027f admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:57.574667 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-80b188d0-9a23-49ae-9292-6f08e1ba027f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010693 Sep 23 03:30:57.575183 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Sep 23 03:30:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:36:19.760912 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:19.761947 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 23 03:36:19.762363 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:36:19.901776 n-d-858495-2 devstack@n-api.service[106413]: DEBUG dbcounter [-] [106413] Writing DB stats nova_api:SELECT=6 {{(pid=106413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:36:20.039410 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:20.044655 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:36:20.045122 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:36:20.045568 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:36:20.046271 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:36:20.046708 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:36:20.047117 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:36:20.084758 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-fdb558a2-ebcd-41a2-bc0a-234d53e41eaf admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.184643 Sep 23 03:36:20.085309 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:36:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:36:21.156534 n-d-858495-2 devstack@n-api.service[106414]: DEBUG nova.api.openstack.wsgi [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] Calling method '>' {{(pid=106414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:21.157567 n-d-858495-2 devstack@n-api.service[106414]: INFO nova.api.openstack.requestlog [None req-c6e35ba8-b6a4-455c-9e3f-03cba3696ef3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 23 03:36:21.157971 n-d-858495-2 devstack@n-api.service[106414]: [pid: 106414|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 23 03:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:36:21.350063 n-d-858495-2 devstack@n-api.service[106413]: DEBUG nova.api.openstack.wsgi [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Calling method '>' {{(pid=106413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:21.354106 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:36:21.354576 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:36:21.354998 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:36:21.355700 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:36:21.356137 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:36:21.356545 n-d-858495-2 devstack@n-api.service[106413]: DEBUG oslo_concurrency.lockutils [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:36:21.378900 n-d-858495-2 devstack@n-api.service[106413]: INFO nova.api.openstack.requestlog [None req-ec2ef4d2-0a17-4d8c-833e-f30f3b1d17d7 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.078491 Sep 23 03:36:21.379385 n-d-858495-2 devstack@n-api.service[106413]: [pid: 106413|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:36:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:37:05.744715 n-d-858495-2 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 03:37:05.745225 n-d-858495-2 devstack@n-api.service[106412]: Fri Sep 23 03:37:05 2022 - graceful shutdown triggered... Sep 23 03:37:05.745719 n-d-858495-2 devstack@n-api.service[106413]: Gracefully killing worker 1 (pid: 106413)... Sep 23 03:37:05.746081 n-d-858495-2 devstack@n-api.service[106414]: Gracefully killing worker 2 (pid: 106414)... Sep 23 03:37:05.871936 n-d-858495-2 devstack@n-api.service[106414]: DEBUG dbcounter [-] [106414] Writing DB stats nova_api:SELECT=4 {{(pid=106414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:06.745342 n-d-858495-2 devstack@n-api.service[106412]: worker 1 buried after 1 seconds Sep 23 03:37:06.745342 n-d-858495-2 devstack@n-api.service[106412]: worker 2 buried after 1 seconds Sep 23 03:37:06.745342 n-d-858495-2 devstack@n-api.service[106412]: goodbye to uWSGI. Sep 23 03:37:06.747473 n-d-858495-2 systemd[1]: devstack@n-api.service: Succeeded. Sep 23 03:37:06.748035 n-d-858495-2 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 03:37:06.750756 n-d-858495-2 systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 03:37:06.770740 n-d-858495-2 devstack@n-api.service[128710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 03:37:06 2022] *** Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: nodename: n-d-858495-2 Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: machine: x86_64 Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: clock source: unix Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: pcre jit disabled Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: detected number of CPU cores: 4 Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: current working directory: / Sep 23 03:37:06.790102 n-d-858495-2 devstack@n-api.service[128710]: detected binary path: /usr/bin/uwsgi-core Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: your processes number limit is 47680 Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: your memory page size is 4096 bytes Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: detected max file descriptor number: 2048 Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: lock engine: pthread robust mutexes Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: thunder lock: enabled Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 03:37:06.790875 n-d-858495-2 devstack@n-api.service[128710]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 03:37:06.833009 n-d-858495-2 devstack@n-api.service[128710]: Python main interpreter initialized at 0x55cd936479c0 Sep 23 03:37:06.833009 n-d-858495-2 devstack@n-api.service[128710]: python threads support enabled Sep 23 03:37:06.833009 n-d-858495-2 devstack@n-api.service[128710]: your server socket listen backlog is limited to 100 connections Sep 23 03:37:06.833009 n-d-858495-2 devstack@n-api.service[128710]: your mercy for graceful operations on workers is 90 seconds Sep 23 03:37:06.833511 n-d-858495-2 devstack@n-api.service[128710]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 03:37:06.833511 n-d-858495-2 devstack@n-api.service[128710]: *** Operational MODE: preforking *** Sep 23 03:37:06.833762 n-d-858495-2 devstack@n-api.service[128710]: *** uWSGI is running in multiple interpreter mode *** Sep 23 03:37:06.833762 n-d-858495-2 devstack@n-api.service[128710]: spawned uWSGI master process (pid: 128710) Sep 23 03:37:06.833968 n-d-858495-2 systemd[1]: Started Devstack devstack@n-api.service. Sep 23 03:37:06.834688 n-d-858495-2 devstack@n-api.service[128710]: spawned uWSGI worker 1 (pid: 128723, cores: 1) Sep 23 03:37:06.836010 n-d-858495-2 devstack@n-api.service[128710]: spawned uWSGI worker 2 (pid: 128724, cores: 1) Sep 23 03:37:06.836010 n-d-858495-2 devstack@n-api.service[128710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 03:37:07.496587 n-d-858495-2 devstack@n-api.service[128723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 03:37:07.520584 n-d-858495-2 devstack@n-api.service[128724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 03:37:08.646199 n-d-858495-2 devstack@n-api.service[128723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:37:08.646199 n-d-858495-2 devstack@n-api.service[128723]: from cryptography.utils import int_from_bytes Sep 23 03:37:08.646838 n-d-858495-2 devstack@n-api.service[128723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:37:08.646838 n-d-858495-2 devstack@n-api.service[128723]: from cryptography.utils import int_from_bytes Sep 23 03:37:08.700980 n-d-858495-2 devstack@n-api.service[128724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:37:08.700980 n-d-858495-2 devstack@n-api.service[128724]: from cryptography.utils import int_from_bytes Sep 23 03:37:08.701591 n-d-858495-2 devstack@n-api.service[128724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:37:08.701591 n-d-858495-2 devstack@n-api.service[128724]: from cryptography.utils import int_from_bytes Sep 23 03:37:11.082626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:37:11.083165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:37:11.083306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:37:11.083672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:37:11.083933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:37:11.084326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.084657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.084983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.085312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.085671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.085987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.086312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.086637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.086963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.087226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.087547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.087998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858495-2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.088326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.088648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.089531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.089857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.090168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.090496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.090815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.091316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.091749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.092062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.092545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.092715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.093035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.093367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.093695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.094006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.094336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.094653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.095055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858495-2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.095377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.095696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.096014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.096433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.096752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.097068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.097415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.097745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.098058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.098393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.098715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.099038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.099362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.099668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.100001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.100298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.100621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.100930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.101238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.101528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.101843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.102169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.102493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.102820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.103080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.103334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.103658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.103985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.104299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.104649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.104965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.105279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.105621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.105930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.106241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.106552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.106877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.107198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.107524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.107831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.108157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.108576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.108834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.109146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.109519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.109842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.110153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.110476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.110802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.111114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.111429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.111740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.112064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.112407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.112716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.112973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.113283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.113640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.113963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.114275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.114586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.114900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.115208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.115520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.115830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.116142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.116452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.116763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.117073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.117405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.117719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.118031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.118339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.118674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.118999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.119308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.119617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.119926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.120271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.120592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.120902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.121210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.121565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.121878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.122187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.122511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.122823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.123133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.123459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.123762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.124073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.124395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.124707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.125022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.125333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.125665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.125976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.126283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.126665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.126975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.127279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.127589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.127918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.128234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.128559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.128870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.129189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.129562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.129891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.130238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.130553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.130889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.131221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.131547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.131863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.132179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.132506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.132823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.133139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.133488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.133872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.134198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.134539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.134860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.135179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.135502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.136359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.136682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.137013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.137387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.137689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.138037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.138393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.138713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.139048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.139380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.139698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.140014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.140332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.140683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.141061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.141407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.142821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.143200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.143534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.143857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.144174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.144495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.144815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.145131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.145507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.145834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.146163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.146493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.146816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.147138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.147457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.147776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.148094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.148425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.148725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.149027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.149341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.149676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.150008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.150350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.150661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.151000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.151438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.152255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.152576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.152893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.153481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.153804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.154123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.154432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.154760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.155078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.155393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.155721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.156031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.156340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.156666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.156981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.157296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.157641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.157957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.158286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.158604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.158919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.159261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.159595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.159905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.160239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.160570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.160889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.161198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.161537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.161850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.162161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.162468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.162783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.163091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.163401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.163710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.164019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.164327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.164656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.164968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.165277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.165617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.165926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.166277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.166590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.166993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.167339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.167665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.167992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.168310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.168631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.168951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.169269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.169613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.169930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.170258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.170577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.170901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.171218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.171546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.171862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.172187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.172494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.172813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.173158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.173523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.173847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.174173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.174489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.174809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.175124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.175438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.175752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.176065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.176388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.176708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.177032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.177356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.177695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.178007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.178328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.178637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.178960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.179293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.179629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.179945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.180267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.180594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.180908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.181222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.181578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.181892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.182203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.182567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.182871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.183184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.183495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.183802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.184120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.184432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.184741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.185051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.185390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.185710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.186024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.186349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.186675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.186983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.187290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.187616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.187928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.188233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.188540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.188850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.189196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.189537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.189848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.190178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.190500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.190816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.191140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.191454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.191768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.192094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.192412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.192724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.193039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.193384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.193689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.194003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.194327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.194642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.194954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.195271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.195578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.195893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.196127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:37:11.196559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.196647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:37:11.196788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.196897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:37:11.197123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.197275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:37:11.197468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.197641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:37:11.197796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.197948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.198675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.198814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.199005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.199146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.199342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.199475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.199674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.199819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.199992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.200214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.200320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.200467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.200606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.200792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.200899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.201128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.201221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.201416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.201538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.201742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.201845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.202140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.202230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858495-2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.202448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.202540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.202763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.202904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.203071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.203164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.203378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.203479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.203687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.203780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.203994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.204087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.204310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.204409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.204618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.204895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.205004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.205217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.205316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.205559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.205653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.205868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.205960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.206176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.206278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.206483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.206577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.206790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.206881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.207134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.207245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.207443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.207535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.207774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.207866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.208091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.208196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.208430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.208521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858495-2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.208740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.208840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.209052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.209145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.209400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.209495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.209712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.209861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.210022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.210175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.210352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.210486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.210643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.210819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.210953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.211152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.211253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.211469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.211561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.211806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.211907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.212137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.212237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.212461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.212586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.212759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.212859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.213069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.213174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.213395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.213504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.213717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.214398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.214570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.214685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.214879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.214991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.215187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.215288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.215442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.215545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.215760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.215862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.216096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.216211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.216405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.216506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.216710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.216817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.216988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.217080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.217245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.217370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.217599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.217703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.217933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.218030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.218244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.218350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.218557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.218659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.218863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.218956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.219173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.219272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.219486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.219605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.219790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.219922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.220099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.220201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.220422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.220538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.220726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.220831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.221034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.221144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.221396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.221510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.221690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.221790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.222004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.222110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.222313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.222413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.222625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.222730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.222931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.223049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.223241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.223385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.223547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.223674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.224024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.224123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.224209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.224289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.224431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.224806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.224989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.225098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.225334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.225480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.225765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.225916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.226004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.226314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.226569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.226668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.226806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.226970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.227235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.227372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.227667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.227969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.228129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.228282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.228553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.228753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.228981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.229167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.229396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.229514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.229657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.229934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.230075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.230249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.230368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.230585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.230881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.231030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.231198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.231320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.231508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.231822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.231949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.232187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.232302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.232550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.232898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.233006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.233101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.233191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.233433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.233551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.233783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.233935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.234112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.234321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.234520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.234702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.234920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.235073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.235234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.235385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.235608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.235822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.235992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.236136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.236226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.236550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.236681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.236857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.237169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.237267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.237702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.237813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.237952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.238097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.238257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.238363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.238500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.238739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.238833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.239059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.239253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.239373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.239689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.239801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.239979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.240167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.240340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.240586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.240691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.241027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.241257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.241383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.241473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.241682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.242012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.242153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.242302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.242464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.242604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.242778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.242925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.243245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.243344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.243583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.243701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.244056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.244172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.244327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.244598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.244778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.244918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.245135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.245307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.245592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.245754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.245878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.246073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.246235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.246518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.246617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.246830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.247171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.247304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.247382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.247466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.248570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.248732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.248845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.248999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.249098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.249184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.249269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.249432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.249525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.249525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.249753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.249854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.250029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.250146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.250340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.250445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.250753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.250899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.251091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.251246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:37:11.251459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.251680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.251802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.251999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.252249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.252471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.252712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.252829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.252950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.253170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.253571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.253571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.253743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.253926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.254162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.254266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.254535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.254738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.254962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.255150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.255279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.255394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.261179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.261440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.261759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.262884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.263790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.264989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.265965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.266960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.267992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.268931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.269911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.270870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.271886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.272823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.273949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.274825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.275825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.276032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.276032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.276195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.276925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.277917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.278010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.278493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.278632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.278810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.278919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.279129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.279229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.279449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.279699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.279807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.280991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.281967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.282915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.283982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.284939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.285949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.286902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.287856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.288829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.289964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.290915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.291987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.292255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.292412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.292606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.292732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.292935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.293969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.294933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.295907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.296896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.297978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.298187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.298403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.298541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.298769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.298931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.299910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.300862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.301793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.302948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.303903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.304860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.305831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.306974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.307959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.308915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.309992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.310941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.311899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.312866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.313985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.314973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.315922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.316953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.317941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.318888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.319833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.320789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.321944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.322925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.323019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.323844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.323994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.324816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.325761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.325962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.326198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.326352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.326352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.326734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.326885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.327979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.328874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.329869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.330990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.331947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.332891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.333827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.334955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.335899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.336882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.337799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.338826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.339526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.339613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.339855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.339985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.340900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.341878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.342852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.343969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.344928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.345914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.346961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.347899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.348835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.349784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.350936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.351972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.352210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.352326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.352983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.353999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.354967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.355121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.355248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:37:11.355451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.355770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.356263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.356411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.356703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.357033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.357388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.357704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.358022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.358341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.358677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.359184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.359332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.359687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.360028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.360299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.360690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.360950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.361259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.361601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.361926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.362247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.362568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.362887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.363279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.363526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.363846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.364164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.364484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.364806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.365117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.365476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.365796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.366116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.366437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.366749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.367073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.367386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.367836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.368160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.368481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.391039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.396515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.397558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.399216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.401813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.407345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.408526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.409751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.410850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.411894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.412972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.413871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.414517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.414517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.414744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.414968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.415246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.415593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.415916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.416261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.416805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.417050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.417318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.417679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.418013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.418345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.418675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.419015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.419346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.419679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.420003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.420332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.420664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.421253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.421638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.421977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.422303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.422629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.422979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.423276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.423600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.424029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.424357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.424687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.425030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.425381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.425723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.426077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.426407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.426734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.427060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.427385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.427757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.428077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.428397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.428718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.429049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.429452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.429754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.430077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.430399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.430722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.431044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.431364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.431690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.432011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.432349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.433224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.433579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.433904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.434227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.434553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.435088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.435414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.435760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.436099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.436440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.436778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.437142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.437460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.437782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.438100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.438425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.438748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.439065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.439406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.439727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.440302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.440503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.440701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.441195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.441580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.441907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.442402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.442580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.443745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.443745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.443745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.444228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.444228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.444457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.444770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.445085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.445421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.445746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.446067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.446381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.446679 n-d-858495-2 devstack@n-api.service[128723]: INFO dbcounter [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Registered counter for database nova_api Sep 23 03:37:11.446836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.447047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.447832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.447832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.448229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.448882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.449104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.449445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.449766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.450084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.450399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.450725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.451036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.451454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.451769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.452092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.452655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.452787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.453190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.453444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.453764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.454079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.454407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.454729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.455064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.455390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.455720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.456081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.456407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.456990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.457367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.457706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.458052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.458406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.458729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.459050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.459376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.459717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.460042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.460367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.460690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.461012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.461332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.461675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.461991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.462322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.462638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.462998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.463275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.463595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.463971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.464285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.464609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.464968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.465411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.465642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.465962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.466291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.466611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.466934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.468213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.468213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.468213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.468213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.469167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.469167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.469714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.469714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.470131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.470358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.470568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.470832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.471169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.471489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.471821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.472142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.472478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.473032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.473420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.473646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.473873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.474104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.474441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.474730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.475066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.475371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.475683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.475998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.476324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.476641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.477077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.477682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.477908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.478090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.478420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.478641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.478985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.479262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.479607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.479925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.480245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.480559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.480773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_db.sqlalchemy.engines [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.481002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.481225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.481494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.481918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.482132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.482490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.482846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.483143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.483474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.483799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.484130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.484463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.484801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.485132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.485482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.485822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.486278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.486759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.487089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.487416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.487741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.488062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.488476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.488741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.489087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.489419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.489754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.490086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.490415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.490738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.491083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.491405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.491726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.492128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.492347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writer thread running {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.492545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.492750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.493077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.493282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.493691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.493926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.494244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.494714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.494930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.495766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.496109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.496453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.496814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.497140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.497519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.497863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.498193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.498618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.498836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:37:11.499076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:37:11.552098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.context [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128723) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:37:11.556288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:11.556763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:11.558970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:11.559710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:11.560161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:11.562026 n-d-858495-2 devstack@n-api.service[128724]: INFO dbcounter [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Registered counter for database nova_api Sep 23 03:37:11.562191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:11.564224 n-d-858495-2 devstack@n-api.service[128723]: INFO dbcounter [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Registered counter for database nova_cell0 Sep 23 03:37:11.568483 n-d-858495-2 devstack@n-api.service[128723]: INFO dbcounter [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Registered counter for database nova_cell1 Sep 23 03:37:11.576423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_db.sqlalchemy.engines [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.581635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writer thread running {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.582376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_db.sqlalchemy.engines [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.583792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_db.sqlalchemy.engines [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.590743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writer thread running {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.648675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.context [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128724) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:37:11.652724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:11.653503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:11.655120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:11.655858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:11.656452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:11.658354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:11.660379 n-d-858495-2 devstack@n-api.service[128724]: INFO dbcounter [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Registered counter for database nova_cell0 Sep 23 03:37:11.664814 n-d-858495-2 devstack@n-api.service[128724]: INFO dbcounter [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Registered counter for database nova_cell1 Sep 23 03:37:11.672219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_db.sqlalchemy.engines [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.676004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_db.sqlalchemy.engines [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.678612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writer thread running {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.729106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writer thread running {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.738208 n-d-858495-2 devstack@n-api.service[128723]: INFO dbcounter [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Registered counter for database nova_cell0 Sep 23 03:37:11.744873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_db.sqlalchemy.engines [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.750533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writer thread running {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.824193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writer thread running {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:11.834011 n-d-858495-2 devstack@n-api.service[128724]: INFO dbcounter [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Registered counter for database nova_cell0 Sep 23 03:37:11.840792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_db.sqlalchemy.engines [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:37:11.845205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writer thread running {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 03:37:12.074973 n-d-858495-2 devstack@n-api.service[128723]: WARNING keystonemiddleware.auth_token [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:37:12.082535 n-d-858495-2 devstack@n-api.service[128723]: WARNING keystonemiddleware.auth_token [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:37:12.170306 n-d-858495-2 devstack@n-api.service[128724]: WARNING keystonemiddleware.auth_token [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:37:12.177647 n-d-858495-2 devstack@n-api.service[128724]: WARNING keystonemiddleware.auth_token [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:37:12.424120 n-d-858495-2 devstack@n-api.service[128723]: WARNING keystonemiddleware.auth_token [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:37:12.430393 n-d-858495-2 devstack@n-api.service[128723]: WARNING keystonemiddleware.auth_token [None req-1efc0e57-61dd-4bff-9006-592355b30c8f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:37:12.436132 n-d-858495-2 devstack@n-api.service[128723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd936479c0 pid: 128723 (default app) Sep 23 03:37:12.538851 n-d-858495-2 devstack@n-api.service[128724]: WARNING keystonemiddleware.auth_token [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:37:12.544980 n-d-858495-2 devstack@n-api.service[128724]: WARNING keystonemiddleware.auth_token [None req-7b158676-da53-4c21-9207-245beb8cd72d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:37:12.550332 n-d-858495-2 devstack@n-api.service[128724]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd936479c0 pid: 128724 (default app) Sep 23 03:37:53.064750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:53.065710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:53.066463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:53.069541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:54.694251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '.version_select at 0x7f0c90c81430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:54.702055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128723) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 23 03:37:54.702793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:54.703589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:54.704180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:54.736206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:54.736206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:54.736519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:54.757801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:54.759315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:54.759919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:54.771334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-668238f0-26dc-4065-9000-a05f5d6452bb tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.712515 Sep 23 03:37:54.773059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1/1] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 03:37:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:55.189778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee53324d-86b8-4169-be8c-c43a9e7d20d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1207790564", "name": "tempest-test_aggregate-1948059401"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:55.237474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-ee53324d-86b8-4169-be8c-c43a9e7d20d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid ed384c6b-4992-414f-b64b-6ec716a00279 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:37:55.249508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:55.251192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:55.252105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:55.253044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:55.364894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee53324d-86b8-4169-be8c-c43a9e7d20d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.572077 Sep 23 03:37:55.367159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Sep 23 03:37:54 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:37:55.736218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38e45f0d-1b4d-41ad-ae84-25a1ee10aab9 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1685533636", "id": 2092091078, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:55.806339 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38e45f0d-1b4d-41ad-ae84-25a1ee10aab9 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.778646 Sep 23 03:37:55.806963 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2/3] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:37:55 2022] POST /compute/v2.1/flavors => generated 471 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:37:55.813288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7712356b-f18e-4c42-b53d-691f9353f83e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:55.831555 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7712356b-f18e-4c42-b53d-691f9353f83e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.023282 Sep 23 03:37:55.837510 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:37:55 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:56.050887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c90c81940>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:56.053530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.054216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.054853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.071813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.073317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.074055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.085991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.086576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.087932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.096314 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd636d67-3bb2-4f50-8994-b9efb28804b3 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.257543 Sep 23 03:37:56.096903 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 4/5] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:37:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:56.173831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef3e31c3-13f9-4d01-a176-1d12a76bac7b tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1726013703", "ram": 512, "vcpus": 1, "disk": 10, "id": 116072915, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:56.234072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef3e31c3-13f9-4d01-a176-1d12a76bac7b tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.865077 Sep 23 03:37:56.234873 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2/6] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:37:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:56.240898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e2df5b1-fa6a-447c-b2db-f323e499b416 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:56.391225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:56.396740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.397456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.398078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.399039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.399813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.400626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.464309 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-866423fa-a124-4731-99ae-f8cbc305994d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.366018 Sep 23 03:37:56.465185 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:37:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:56.471694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc5e41fd-ef38-4e65-9fc8-f758044e8206 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:56.509645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc5e41fd-ef38-4e65-9fc8-f758044e8206 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:56.510966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc5e41fd-ef38-4e65-9fc8-f758044e8206 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:56.511612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc5e41fd-ef38-4e65-9fc8-f758044e8206 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:56.520854 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e2df5b1-fa6a-447c-b2db-f323e499b416 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2092091078/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.283733 Sep 23 03:37:56.522219 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3/8] 10.222.0.25 () {62 vars in 1265 bytes} [Fri Sep 23 03:37:56 2022] POST /compute/v2.1/flavors/2092091078/os-extra_specs => generated 62 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:56.823632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-65408916", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:57.216999 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc5e41fd-ef38-4e65-9fc8-f758044e8206 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.748048 Sep 23 03:37:57.229384 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 6/9] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:37:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:57.229384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c9023ad30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:57.229384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.229384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.229839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.249691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.250134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.250952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.265921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.266421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.266931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.275070 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fec3e37b-8743-4af6-ab86-d401d9e3a0aa tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.055492 Sep 23 03:37:57.276245 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 7/10] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 03:37:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:57.329164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:37:57.474581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5b06f3d-ef4a-42d9-9543-c20b1c4d896d tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:57.503501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d5b06f3d-ef4a-42d9-9543-c20b1c4d896d tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] HTTP exception thrown: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5b06f3d-ef4a-42d9-9543-c20b1c4d896d tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Request method failure captured: Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoPDiQB4RcxPc54fbt6O2nIrfPrAOVl8Kd-Nez-cENCvwF5H8Py7wbQXTFcSm3G4M3HY85P6echcDAjjwV6U3pj_y6PRrGoUYbHFIzFGTaZ-81m2f5nIdh1YlrsgC1Mhuj3uXh5Ivifl8RjSjBy7G1r2otKZCv51vXSTP0SmQPVemU Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:37:57.506035 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 738ccc55ffea4fbda390ec062b82f846 Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:37:57.507126 n-d-858495-2 devstack@n-api.service[128723]: exception: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'flavor_id': '116072915', 'id': 'hw:cpu_thread_policy'} Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:57.507688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:57.508774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.510723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5b06f3d-ef4a-42d9-9543-c20b1c4d896d tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Returning 404 to user: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:57.511905 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5b06f3d-ef4a-42d9-9543-c20b1c4d896d tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] 10.222.0.25 "GET /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.234608 Sep 23 03:37:57.512664 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 8/11] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:37:57 2022] GET /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:37:57.702368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23dadf35-801a-44fc-8b4b-a21841ec68f7 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-634252708", "id": 1436088387, "os-flavor-access:is_public": "False"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:57.728216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23dadf35-801a-44fc-8b4b-a21841ec68f7 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.213269 Sep 23 03:37:57.729333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 9/12] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:37:57 2022] POST /compute/v2.1/flavors => generated 438 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:57.736095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b2b08fa-c4da-4601-a179-073a47da4025 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:57.757781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:37:57.758225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:37:57.758705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:37:57.759114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:37:57.759530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:37:57.776080 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b2b08fa-c4da-4601-a179-073a47da4025 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2092091078" status: 202 len: 0 microversion: 2.86 time: 0.045127 Sep 23 03:37:57.777488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.777979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.778411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.779123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.779747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.780401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.781464 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 10/13] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Sep 23 03:37:57 2022] DELETE /compute/v2.1/flavors/2092091078 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:37:57.786830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c902199d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:57.788823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.790618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.790618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.810946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.811463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.812077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.818632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Getting quotas for project 23102e21f8ad459d961a1ab32beaa312. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:37:57.824709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.825388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.825857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.827064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Getting quotas for user 5d039b881c2b448d955103ba005f3b97 and project 23102e21f8ad459d961a1ab32beaa312. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:37:57.833691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79f286db-a718-4b48-8836-40da36aaff49 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050966 Sep 23 03:37:57.834839 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 11/14] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:37:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:57.841180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:37:57.844898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:37:57.902954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-424490126", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "availability_zone": "tempest-test_az-1207790564"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:57.906513 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8ed46a8-46e0-4391-a911-0b6b6974dbec tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382543 Sep 23 03:37:57.909394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 4/15] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:37:57.919283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.919553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.920078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.920306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d274e374-c80e-4574-bedd-675839077dbb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:57.920960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:57.921547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:57.922072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:57.925017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d274e374-c80e-4574-bedd-675839077dbb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '738ccc55ffea4fbda390ec062b82f846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00d4624c4f449768c2eb6adb445628e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d274e374-c80e-4574-bedd-675839077dbb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Request method failure captured: Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/flavors/116072915/os-extra_specs HTTP/1.1 Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 66 Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoPDiQB4RcxPc54fbt6O2nIrfPrAOVl8Kd-Nez-cENCvwF5H8Py7wbQXTFcSm3G4M3HY85P6echcDAjjwV6U3pj_y6PRrGoUYbHFIzFGTaZ-81m2f5nIdh1YlrsgC1Mhuj3uXh5Ivifl8RjSjBy7G1r2otKZCv51vXSTP0SmQPVemU Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:37:57.932340 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 738ccc55ffea4fbda390ec062b82f846 Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 23 03:37:57.933471 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'flavor_id': '116072915', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:37:57.934056 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 03:37:57.934926 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:57.937580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d274e374-c80e-4574-bedd-675839077dbb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:57.939100 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d274e374-c80e-4574-bedd-675839077dbb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] 10.222.0.25 "POST /compute/v2.1/flavors/116072915/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.030218 Sep 23 03:37:57.944113 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 5/16] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:37:57 2022] POST /compute/v2.1/flavors/116072915/os-extra_specs => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:37:57.949576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed279116-be09-47e7-88d9-762d55c86695 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:58.097201 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed279116-be09-47e7-88d9-762d55c86695 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1436088387/action" status: 200 len: 97 microversion: 2.1 time: 0.151705 Sep 23 03:37:58.105826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 6/17] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:37:57 2022] POST /compute/v2.1/flavors/1436088387/action => generated 97 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:37:58.111005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79e38f96-f337-45e0-b110-f90801ebd0a3 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:58.165448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79e38f96-f337-45e0-b110-f90801ebd0a3 tempest-FlavorMetadataValidation-1275333654 tempest-FlavorMetadataValidation-1275333654-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.86 time: 0.061249 Sep 23 03:37:58.166547 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 7/18] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:37:58 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:37:58.172072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c902878b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:58.178853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128724) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 23 03:37:58.179790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:58.180513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:58.181141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:58.215556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:58.216586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:58.217229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:58.227749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:37:58.228525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc09d24a-0d6d-43b0-a7bb-44358c205b13 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.059608 Sep 23 03:37:58.230722 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 8/19] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:37:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:58.246704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37be0103-9acc-4b26-9540-29b7c6660af9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:58.247449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37be0103-9acc-4b26-9540-29b7c6660af9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:37:58.394812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-37be0103-9acc-4b26-9540-29b7c6660af9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:58.420257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37be0103-9acc-4b26-9540-29b7c6660af9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1218 microversion: 2.1 time: 0.188151 Sep 23 03:37:58.425888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 9/20] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:37:58 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:58.430706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03226764-65f7-4391-9b90-1253bdf057f7 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:58.504921 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03226764-65f7-4391-9b90-1253bdf057f7 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/116072915/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.077348 Sep 23 03:37:58.507765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 10/21] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:37:58 2022] POST /compute/v2.1/flavors/116072915/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:37:58.515184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-012d95ca-89d8-4750-825b-69edf51c9104 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:58.700425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:37:58.700959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:37:58.701939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:37:58.702451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:37:58.702940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:37:58.736277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:58.737129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:58.737973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:58.738939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:58.739632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:58.740274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:58.807832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Getting quotas for project 2228ce9e638f4e829c8e5ee252994f4f. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:37:58.822336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Getting quotas for user 23536c40f5b748d899efc0d94673ecaf and project 2228ce9e638f4e829c8e5ee252994f4f. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:37:58.861185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:37:58.864572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:37:58.967984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-012d95ca-89d8-4750-825b-69edf51c9104 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. Sep 23 03:37:58.981886 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3505dc67-e676-4a92-906e-c9072e9c2b74 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140808 Sep 23 03:37:58.983349 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 12/22] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:37:58.996524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-293cb20e-5c18-4da4-a62e-c17988b9322a tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c9023a820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:58.998694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-293cb20e-5c18-4da4-a62e-c17988b9322a tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.001838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-293cb20e-5c18-4da4-a62e-c17988b9322a tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.002821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-293cb20e-5c18-4da4-a62e-c17988b9322a tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-012d95ca-89d8-4750-825b-69edf51c9104 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Request method failure captured: Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/flavors/1436088387/action HTTP/1.1 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 67 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTMgot5Y7r-P9xd7Nua8-YB4QmFbl-bwIFBCqxA1wbnUkuYbXiRLaHCRV3IjpWuGU0Z7idSkatqg1p5ghpqVPOxL87u0wlyfP5Cypl9o-0nz6JQ_qNx7YinSL4vs8GdTi0YbS-rW7UcD1z4gXziFPyyUF3JLRsL_wDRbCcVQeK2_g Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:37:59.006157 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 09f742e4dc6c4229abe8616d7e1740d9 Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} Sep 23 03:37:59.007254 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: exception: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '1436088387', 'body': {'addTenantAccess': {'tenant': 'b70d993a1be14b5b92b849163b5dcbe3'}}} Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:37:59.007869 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-b70d993a1be14b5b92b849163b5dcbe3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 03:37:59.008820 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 03:37:59.009946 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:37:59.010835 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-b70d993a1be14b5b92b849163b5dcbe3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 3, 37, 58, 941399), 'updated_at': None, 'flavor_id': 17, 'project_id': 'b70d993a1be14b5b92b849163b5dcbe3'}] Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.011740 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.015112 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:37:59.017169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-012d95ca-89d8-4750-825b-69edf51c9104 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project b70d993a1be14b5b92b849163b5dcbe3 combination. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-012d95ca-89d8-4750-825b-69edf51c9104 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1436088387/action" status: 409 len: 152 microversion: 2.1 time: 0.498334 Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 11/23] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:37:58 2022] POST /compute/v2.1/flavors/1436088387/action => generated 152 bytes in 500 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:37:59.020877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d71bd2a-b79c-4ea9-9fae-2ea1b70b8986 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.026253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d71bd2a-b79c-4ea9-9fae-2ea1b70b8986 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '738ccc55ffea4fbda390ec062b82f846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00d4624c4f449768c2eb6adb445628e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d71bd2a-b79c-4ea9-9fae-2ea1b70b8986 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Request method failure captured: Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoPDiQB4RcxPc54fbt6O2nIrfPrAOVl8Kd-Nez-cENCvwF5H8Py7wbQXTFcSm3G4M3HY85P6echcDAjjwV6U3pj_y6PRrGoUYbHFIzFGTaZ-81m2f5nIdh1YlrsgC1Mhuj3uXh5Ivifl8RjSjBy7G1r2otKZCv51vXSTP0SmQPVemU Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:37:59.028109 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 738ccc55ffea4fbda390ec062b82f846 Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:59.029293 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'flavor_id': '116072915', 'id': 'hw:numa_nodes'} Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:37:59.030143 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.031074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d71bd2a-b79c-4ea9-9fae-2ea1b70b8986 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.031891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d71bd2a-b79c-4ea9-9fae-2ea1b70b8986 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016721 Sep 23 03:37:59.034341 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 03:37:59 2022] DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:37:59.039132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fdd8c88-ef6c-4677-95bc-1650e5ea949b tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.040566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fdd8c88-ef6c-4677-95bc-1650e5ea949b tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:37:59.056589 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-293cb20e-5c18-4da4-a62e-c17988b9322a tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.071512 Sep 23 03:37:59.058242 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1179 bytes} [Fri Sep 23 03:37:58 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:59.070985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df52faf9-f7e3-4372-b441-0de3bd430044 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.258504 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df52faf9-f7e3-4372-b441-0de3bd430044 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1436088387/action" status: 200 len: 21 microversion: 2.1 time: 0.197718 Sep 23 03:37:59.261883 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:37:59 2022] POST /compute/v2.1/flavors/1436088387/action => generated 21 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:37:59.271434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37acdbaf-1c54-4f07-b102-2194b124857e tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.316430 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37acdbaf-1c54-4f07-b102-2194b124857e tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/116072915/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052864 Sep 23 03:37:59.317455 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 15/27] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:37:59 2022] POST /compute/v2.1/flavors/116072915/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:37:59.322630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c90157e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.326405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.327111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.327753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.345175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.346072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.346936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.360593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.361915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.362682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.384589 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2595b89d-e867-47d4-95b2-d139240a3f17 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065599 Sep 23 03:37:59.387590 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:59.401866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ae7b5b6-71ef-4fef-831c-486fb32c3728 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.406175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fdd8c88-ef6c-4677-95bc-1650e5ea949b tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:59.419762 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fdd8c88-ef6c-4677-95bc-1650e5ea949b tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1242 microversion: 2.1 time: 0.383303 Sep 23 03:37:59.436091 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 13/29] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1242 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:59.445006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4a58eb1-2090-4fc3-bb0d-fa73bf7265eb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.450158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ae7b5b6-71ef-4fef-831c-486fb32c3728 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1436088387" status: 202 len: 0 microversion: 2.1 time: 0.061224 Sep 23 03:37:59.450756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:37:59 2022] DELETE /compute/v2.1/flavors/1436088387 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:37:59.451475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b4a58eb1-2090-4fc3-bb0d-fa73bf7265eb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '738ccc55ffea4fbda390ec062b82f846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00d4624c4f449768c2eb6adb445628e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4a58eb1-2090-4fc3-bb0d-fa73bf7265eb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Request method failure captured: Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 22 Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoPDiQB4RcxPc54fbt6O2nIrfPrAOVl8Kd-Nez-cENCvwF5H8Py7wbQXTFcSm3G4M3HY85P6echcDAjjwV6U3pj_y6PRrGoUYbHFIzFGTaZ-81m2f5nIdh1YlrsgC1Mhuj3uXh5Ivifl8RjSjBy7G1r2otKZCv51vXSTP0SmQPVemU Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:37:59.453586 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00d4624c4f449768c2eb6adb445628e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a00d4624c4f449768c2eb6adb445628e Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 738ccc55ffea4fbda390ec062b82f846 Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: {"hw:numa_nodes": "1"} Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:59.454638 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'flavor_id': '116072915', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:37:59.455270 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 03:37:59.456194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.459345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4a58eb1-2090-4fc3-bb0d-fa73bf7265eb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.460607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4a58eb1-2090-4fc3-bb0d-fa73bf7265eb tempest-FlavorsExtraSpecsNegativeTestJSON-298295040 tempest-FlavorsExtraSpecsNegativeTestJSON-298295040-project] 10.222.0.25 "PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020696 Sep 23 03:37:59.462636 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 14/31] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:37:59 2022] PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:37:59.467720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c901575e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.468385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-321fbaa4-2736-45c2-acb2-bf3098dd3429 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.469501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-321fbaa4-2736-45c2-acb2-bf3098dd3429 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:37:59.469604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.470096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.470546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.525237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:37:59.529200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.529934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.532454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.550448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9b28c1b-79fb-4128-86b5-6a629cf64c35 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.087525 Sep 23 03:37:59.551077 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 18/32] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:59.559917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5bc495a9-41ea-4d6a-bb97-d0751d10d0e6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.588839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-321fbaa4-2736-45c2-acb2-bf3098dd3429 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:37:59.609220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-321fbaa4-2736-45c2-acb2-bf3098dd3429 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1218 microversion: 2.1 time: 0.145249 Sep 23 03:37:59.635242 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 15/33] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:59.642502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6695227-fb08-4acd-9617-4f40ac0c3bb8 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.661394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-e6695227-fb08-4acd-9617-4f40ac0c3bb8 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] HTTP exception thrown: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6695227-fb08-4acd-9617-4f40ac0c3bb8 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Request method failure captured: Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTARq99LWdoYyXmJPh6qix78541yL5FlHoXJYSJQJ3fOKmy4CVwujFeJDlV0javjwmzGF7XT4dv_6pf21Q0amVgR8KB5n59hXY_YErFgXVZR8l5jMLf3bcx9gV0IsFOhIAEKFWEjxrJ9-i34BZ0yI9Me8xIC8OlvLKYwfuuyJTOAA Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:37:59.662880 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2e3fd1f89ee8422791075ead4ee119e5 Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:59.664098 n-d-858495-2 devstack@n-api.service[128724]: exception: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'flavor_id': '116072915', 'id': 'hw:cpu_thread_policy'} Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.665407 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. Sep 23 03:37:59.666504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.666857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5bc495a9-41ea-4d6a-bb97-d0751d10d0e6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.106988 Sep 23 03:37:59.668911 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:37:59.676211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6695227-fb08-4acd-9617-4f40ac0c3bb8 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Returning 404 to user: Flavor 116072915 has no extra specs with key hw:cpu_thread_policy. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.677197 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6695227-fb08-4acd-9617-4f40ac0c3bb8 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.040656 Sep 23 03:37:59.677900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 16/35] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 03:37:59 2022] DELETE /compute/v2.1/flavors/116072915/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:37:59.695135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9178c63-92e9-4be6-8445-124a18bd0d2d tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.707234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-e9178c63-92e9-4be6-8445-124a18bd0d2d tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9178c63-92e9-4be6-8445-124a18bd0d2d tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Request method failure captured: Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 27 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTARq99LWdoYyXmJPh6qix78541yL5FlHoXJYSJQJ3fOKmy4CVwujFeJDlV0javjwmzGF7XT4dv_6pf21Q0amVgR8KB5n59hXY_YErFgXVZR8l5jMLf3bcx9gV0IsFOhIAEKFWEjxrJ9-i34BZ0yI9Me8xIC8OlvLKYwfuuyJTOAA Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:37:59.709019 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2e3fd1f89ee8422791075ead4ee119e5 Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: {"hw:cpu_policy": "shared"} Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:37:59.710123 n-d-858495-2 devstack@n-api.service[128724]: exception: Request body and URI mismatch Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'flavor_id': '116072915', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.710757 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.712280 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:37:59.712280 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:37:59.712280 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 23 03:37:59.712280 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.712493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c90158c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.717801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.718834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9178c63-92e9-4be6-8445-124a18bd0d2d tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.719939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e9178c63-92e9-4be6-8445-124a18bd0d2d tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028984 Sep 23 03:37:59.720400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.721215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.729465 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 17/36] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:37:59 2022] PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes => generated 73 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 23 03:37:59.734711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a59d7e6-fa30-4b6d-b0f6-1896392b4c9e tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-561587168", "id": 1774625719, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.773564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.775624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.779130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.793241 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c54d1177-52ae-4425-b285-8e90b0581717 tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.099651 Sep 23 03:37:59.794207 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:59.809501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8eec745-9660-4ac6-bbe2-d6bc57bb21d9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:37:59.827766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a59d7e6-fa30-4b6d-b0f6-1896392b4c9e tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.096749 Sep 23 03:37:59.828605 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:37:59 2022] POST /compute/v2.1/flavors => generated 437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8eec745-9660-4ac6-bbe2-d6bc57bb21d9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Request method failure captured: Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 49 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoTARq99LWdoYyXmJPh6qix78541yL5FlHoXJYSJQJ3fOKmy4CVwujFeJDlV0javjwmzGF7XT4dv_6pf21Q0amVgR8KB5n59hXY_YErFgXVZR8l5jMLf3bcx9gV0IsFOhIAEKFWEjxrJ9-i34BZ0yI9Me8xIC8OlvLKYwfuuyJTOAA Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:37:59.832087 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cb4176c16ae449aa71c9aa4e6e5db06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1cb4176c16ae449aa71c9aa4e6e5db06 Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2e3fd1f89ee8422791075ead4ee119e5 Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 23 03:37:59.833509 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'flavor_id': '116072915', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance: Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 23 03:37:59.834246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.835709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8eec745-9660-4ac6-bbe2-d6bc57bb21d9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.837526 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f8eec745-9660-4ac6-bbe2-d6bc57bb21d9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.036721 Sep 23 03:37:59.841721 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:37:59 2022] PUT /compute/v2.1/flavors/116072915/os-extra_specs/hw:numa_nodes => generated 117 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:37:59.846508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5e6af34-d6b9-4029-a926-23f82ec0e5b6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.848561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Calling method '.version_select at 0x7f0c901564c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.850731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.854018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.854628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.864279 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f5e6af34-d6b9-4029-a926-23f82ec0e5b6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5e6af34-d6b9-4029-a926-23f82ec0e5b6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Request method failure captured: Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/flavors/1774625719/os-flavor-access HTTP/1.1 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoTMgot5Y7r-P9xd7Nua8-YB4QmFbl-bwIFBCqxA1wbnUkuYbXiRLaHCRV3IjpWuGU0Z7idSkatqg1p5ghpqVPOxL87u0wlyfP5Cypl9o-0nz6JQ_qNx7YinSL4vs8GdTi0YbS-rW7UcD1z4gXziFPyyUF3JLRsL_wDRbCcVQeK2_g Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:37:59.871188 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 09f742e4dc6c4229abe8616d7e1740d9 Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: exception: Access list not available for public flavors. Sep 23 03:37:59.872370 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'flavor_id': '1774625719'} Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 23 03:37:59.872994 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:37:59.877171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5e6af34-d6b9-4029-a926-23f82ec0e5b6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:37:59.878342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f5e6af34-d6b9-4029-a926-23f82ec0e5b6 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1774625719/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035495 Sep 23 03:37:59.881425 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 22/40] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/flavors/1774625719/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:37:59.886060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.886572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.887014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.889313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f16db69-7120-4d61-b646-f63bf4dff3c9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.911054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.911548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.912794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.930482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:37:59.931147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df757353-c798-4f0f-9bed-18572338ba0b tempest-HypervisorAdminTestJSON-173517645 tempest-HypervisorAdminTestJSON-173517645-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:37:59.933023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f16db69-7120-4d61-b646-f63bf4dff3c9 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/116072915" status: 202 len: 0 microversion: 2.1 time: 0.050241 Sep 23 03:37:59.933764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 23/41] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:37:59 2022] DELETE /compute/v2.1/flavors/116072915 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:37:59.937537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.938135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.939110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.941608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:37:59.942086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:37:59.942524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:37:59.943319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6bfdc74e-0223-4a29-8860-a3cb941f23d4 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:37:59.964884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.rpcapi [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 03:37:59.965830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] Releasing lock "compute-rpcapi-router" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:37:59.983688 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6bfdc74e-0223-4a29-8860-a3cb941f23d4 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1774625719" status: 202 len: 0 microversion: 2.1 time: 0.045242 Sep 23 03:37:59.984912 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 24/42] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:37:59 2022] DELETE /compute/v2.1/flavors/1774625719 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:37:59.994185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b5a265d-0b80-4f12-979e-8324f108b623 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:00.047904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b5a265d-0b80-4f12-979e-8324f108b623 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348 tempest-FlavorsExtraSpecsNegativeTestJSON-979315348-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061622 Sep 23 03:38:00.054402 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 25/43] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:00.057851 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40874c7c-2f80-4d53-aa1a-d67d7665bf68 None None] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.227778 Sep 23 03:38:00.058495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 19/44] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Sep 23 03:37:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:00.064668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9425cc4b-ade8-4cce-b588-00404ee52a91 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:00.150932 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9425cc4b-ade8-4cce-b588-00404ee52a91 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091553 Sep 23 03:38:00.154000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 26/45] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:00.174475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c483824f-19ac-4dff-90fb-5e1ce16a030f tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1590550942", "id": 1810361538, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:00.212871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c483824f-19ac-4dff-90fb-5e1ce16a030f tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.041539 Sep 23 03:38:00.214739 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 20/46] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:00 2022] POST /compute/v2.1/flavors => generated 439 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:00.447163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4237c80f-c1a4-4d18-a635-69b78e3a6140 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:00.448363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4237c80f-c1a4-4d18-a635-69b78e3a6140 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:00.834968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32ded5b9-4ed9-4fb2-8fb6-0d38d9ccecf9 tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:00.840467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32ded5b9-4ed9-4fb2-8fb6-0d38d9ccecf9 tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '833186d6240845ee880abaaa289170da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70d993a1be14b5b92b849163b5dcbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32ded5b9-4ed9-4fb2-8fb6-0d38d9ccecf9 tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Request method failure captured: Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/flavors/1810361538/action HTTP/1.1 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 67 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoP9h1QzY-DZ4xpg8J8KDcWCPk0T9u9fSiSZGTfMOKfLQkpOgPW7uZls0UmZgZmH9_pwMvym1nnEquPKm8OhPYHR6iaQZphoTHnBQwHiK-HfDKaZX78A84ndFW8c3gv4aTbv2yRmE5xOwhV1NqdaY6XQZutS1o3eZrjcPue-u5PdQo Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b70d993a1be14b5b92b849163b5dcbe3 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:38:00.867323 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b70d993a1be14b5b92b849163b5dcbe3 Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsAccessNegativeTestJSON-13025467-project Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 833186d6240845ee880abaaa289170da Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-13025467-project Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} Sep 23 03:38:00.869287 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '1810361538', 'body': {'addTenantAccess': {'tenant': 'b70d993a1be14b5b92b849163b5dcbe3'}}} Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:00.870080 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 03:38:00.872123 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:00.883710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32ded5b9-4ed9-4fb2-8fb6-0d38d9ccecf9 tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:00.885186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32ded5b9-4ed9-4fb2-8fb6-0d38d9ccecf9 tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] 10.222.0.25 "POST /compute/v2.1/flavors/1810361538/action" status: 403 len: 130 microversion: 2.1 time: 0.662826 Sep 23 03:38:00.886253 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 27/47] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:38:00 2022] POST /compute/v2.1/flavors/1810361538/action => generated 130 bytes in 664 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:00.897429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:00.900733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:00.917850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4237c80f-c1a4-4d18-a635-69b78e3a6140 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:00.939929 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4237c80f-c1a4-4d18-a635-69b78e3a6140 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1242 microversion: 2.1 time: 0.497122 Sep 23 03:38:00.960033 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 21/48] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:00 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1242 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:00.966945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c35dcc4f-645a-4578-bb55-a37f30b88a2a tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:00.971815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:00.978455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:00.978938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:00.982955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:00.983459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:00.983908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:00.984121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=14,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:01.063843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c35dcc4f-645a-4578-bb55-a37f30b88a2a tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1810361538" status: 202 len: 0 microversion: 2.1 time: 0.102196 Sep 23 03:38:01.065763 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 22/49] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:38:00 2022] DELETE /compute/v2.1/flavors/1810361538 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:01.075955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27f9bef5-72c0-41f6-b4de-79c6404d2798 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:01.127070 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-27f9bef5-72c0-41f6-b4de-79c6404d2798 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057146 Sep 23 03:38:01.128347 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 23/50] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:01.149569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b1d45304-9fa7-452f-8a02-4d65452ccc80 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-185652015", "id": 2049546153, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:01.216594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b1d45304-9fa7-452f-8a02-4d65452ccc80 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.072023 Sep 23 03:38:01.220167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 24/51] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:01.233718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89b2d34e-74e4-4af9-9514-9904758c6b6f tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:01.535840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:01.573002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5412e719-ed14-482b-b7df-af018b68b239 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1292 microversion: 2.1 time: 0.684979 Sep 23 03:38:01.591326 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:00 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1292 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:01.964058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:01.964664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:01.974917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:01.978023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:01.978646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:01.982402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:01.983186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:01.983805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:02.115217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:02.123883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8358ca7d-e739-4a87-bba0-8df6e934ca67 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1290 microversion: 2.1 time: 0.164640 Sep 23 03:38:02.154110 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 29/53] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:01 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1290 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:02.240894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89b2d34e-74e4-4af9-9514-9904758c6b6f tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2049546153/action" status: 200 len: 97 microversion: 2.1 time: 1.008462 Sep 23 03:38:02.243801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 25/54] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:38:01 2022] POST /compute/v2.1/flavors/2049546153/action => generated 97 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:02.256227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1834752-42ae-4999-8ad3-7d85b30be2df tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:02.264907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1834752-42ae-4999-8ad3-7d85b30be2df tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '833186d6240845ee880abaaa289170da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70d993a1be14b5b92b849163b5dcbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1834752-42ae-4999-8ad3-7d85b30be2df tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Request method failure captured: Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/flavors/2049546153/action HTTP/1.1 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 70 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoP9h1QzY-DZ4xpg8J8KDcWCPk0T9u9fSiSZGTfMOKfLQkpOgPW7uZls0UmZgZmH9_pwMvym1nnEquPKm8OhPYHR6iaQZphoTHnBQwHiK-HfDKaZX78A84ndFW8c3gv4aTbv2yRmE5xOwhV1NqdaY6XQZutS1o3eZrjcPue-u5PdQo Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b70d993a1be14b5b92b849163b5dcbe3 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:38:02.270459 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b70d993a1be14b5b92b849163b5dcbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b70d993a1be14b5b92b849163b5dcbe3 Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-13025467 Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsAccessNegativeTestJSON-13025467-project Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 833186d6240845ee880abaaa289170da Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-13025467-project Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: {"removeTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} Sep 23 03:38:02.271617 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2049546153', 'body': {'removeTenantAccess': {'tenant': 'b70d993a1be14b5b92b849163b5dcbe3'}}} Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can( Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:02.272728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 03:38:02.274025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:02.274971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1834752-42ae-4999-8ad3-7d85b30be2df tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:02.275101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1834752-42ae-4999-8ad3-7d85b30be2df tempest-FlavorsAccessNegativeTestJSON-13025467 tempest-FlavorsAccessNegativeTestJSON-13025467-project] 10.222.0.25 "POST /compute/v2.1/flavors/2049546153/action" status: 403 len: 133 microversion: 2.1 time: 0.025280 Sep 23 03:38:02.276577 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 30/55] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:38:02 2022] POST /compute/v2.1/flavors/2049546153/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:38:02.285853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a3fdbc3-b158-4ed0-b0cb-4246d26ed320 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b70d993a1be14b5b92b849163b5dcbe3"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:02.607275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:02.608088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:02.630340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:02.631678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:02.632720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:02.635258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:02.636797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:02.637419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:02.685157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a3fdbc3-b158-4ed0-b0cb-4246d26ed320 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2049546153/action" status: 200 len: 21 microversion: 2.1 time: 0.394947 Sep 23 03:38:02.691262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 26/56] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:38:02 2022] POST /compute/v2.1/flavors/2049546153/action => generated 21 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:02.706720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7398525c-0f2b-444d-9d9d-e222715afa68 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:02.769279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7398525c-0f2b-444d-9d9d-e222715afa68 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2049546153" status: 202 len: 0 microversion: 2.1 time: 0.076660 Sep 23 03:38:02.770593 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 27/57] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:38:02 2022] DELETE /compute/v2.1/flavors/2049546153 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:02.787056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8eb7c1a-16fd-4c2e-80dc-c364adcc646e tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:02.840479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8eb7c1a-16fd-4c2e-80dc-c364adcc646e tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064570 Sep 23 03:38:02.841289 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 28/58] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:02.873160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfccbede-ce49-4a2a-938a-d811256d7444 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-415393120", "id": 1214722893, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:02.919227 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfccbede-ce49-4a2a-938a-d811256d7444 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.051423 Sep 23 03:38:02.919858 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 29/59] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:02.944358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-23e3430e-1363-44e3-994e-dc86608f9353 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70c22307ab794e49acbf7027e41e7b63"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:03.131038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:03.140635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32ce5f5a-2659-4894-9846-ea96b8c8fdd0 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1298 microversion: 2.1 time: 0.545828 Sep 23 03:38:03.145024 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 31/60] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:02 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1298 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:03.172017 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-23e3430e-1363-44e3-994e-dc86608f9353 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] HTTP exception thrown: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-23e3430e-1363-44e3-994e-dc86608f9353 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Request method failure captured: Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/flavors/1214722893/action HTTP/1.1 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 70 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTMgot5Y7r-P9xd7Nua8-YB4QmFbl-bwIFBCqxA1wbnUkuYbXiRLaHCRV3IjpWuGU0Z7idSkatqg1p5ghpqVPOxL87u0wlyfP5Cypl9o-0nz6JQ_qNx7YinSL4vs8GdTi0YbS-rW7UcD1z4gXziFPyyUF3JLRsL_wDRbCcVQeK2_g Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:03.177908 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b09788c79edb4b129e3cbad52eaa9b67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b09788c79edb4b129e3cbad52eaa9b67 Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-4165616 Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 09f742e4dc6c4229abe8616d7e1740d9 Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: {"removeTenantAccess": {"tenant": "70c22307ab794e49acbf7027e41e7b63"}} Sep 23 03:38:03.179134 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: exception: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '1214722893', 'body': {'removeTenantAccess': {'tenant': '70c22307ab794e49acbf7027e41e7b63'}}} Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 23 03:38:03.179746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:03.180713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:03.181918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-23e3430e-1363-44e3-994e-dc86608f9353 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Returning 404 to user: Flavor access not found for 21 / 70c22307ab794e49acbf7027e41e7b63 combination. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:03.184673 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-23e3430e-1363-44e3-994e-dc86608f9353 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1214722893/action" status: 404 len: 124 microversion: 2.1 time: 0.246770 Sep 23 03:38:03.185296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Sep 23 03:38:02 2022] POST /compute/v2.1/flavors/1214722893/action => generated 124 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:03.188559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:03.189307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:03.203832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a785ed3-25ec-47fc-b2d2-4d804d674723 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:03.207367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:03.216171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:03.218852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:03.219876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:03.222031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:03.226067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:03.275995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a785ed3-25ec-47fc-b2d2-4d804d674723 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1214722893" status: 202 len: 0 microversion: 2.1 time: 0.084392 Sep 23 03:38:03.277806 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 31/62] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:38:03 2022] DELETE /compute/v2.1/flavors/1214722893 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:03.288853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4ca98fc-a1b7-452d-a20c-ad09965d84b2 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:03.326571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4ca98fc-a1b7-452d-a20c-ad09965d84b2 tempest-FlavorsAccessNegativeTestJSON-4165616 tempest-FlavorsAccessNegativeTestJSON-4165616-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043509 Sep 23 03:38:03.327960 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 32/63] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:03.415646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:03.429645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-556d9b3c-5a6d-41d3-8453-86c0c7ef30a3 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1296 microversion: 2.1 time: 0.244609 Sep 23 03:38:03.436859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 32/64] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:03 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:04.167471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:04.168095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:04.196100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:04.196612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:04.197061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:04.198116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:04.198587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:04.199019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:04.469976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:04.471521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:04.484453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:04.487282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:04.488627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:04.490803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:04.493026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:04.494981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:05.032963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:05.058682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ddfc0cb-d46d-4ef9-b129-88a57bb0a2d6 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1298 microversion: 2.1 time: 0.895580 Sep 23 03:38:05.059294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 33/65] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:04 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1298 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:05.425064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:05.445017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88a040e6-ff6f-4348-acad-53623bb1a7b8 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1296 microversion: 2.1 time: 0.994728 Sep 23 03:38:05.446868 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 33/66] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:04 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1296 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:06.091746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:06.092944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:06.109252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:06.114941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:06.115713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:06.118257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:06.118762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:06.119205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:06.331918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:06.376724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f8bf726-7dc8-4285-9d84-e68df0b0d9d2 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1298 microversion: 2.1 time: 0.285541 Sep 23 03:38:06.377572 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:06 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:06.473097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:06.474337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:06.487827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:06.489111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:06.491602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:06.495561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:06.496211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:06.497320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:06.672812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:06.683859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4bb1e43d-8f5c-4b23-892b-f11c07eb7283 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1296 microversion: 2.1 time: 0.214885 Sep 23 03:38:06.690178 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 34/68] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:06 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1296 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:07.406522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:07.407628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:07.426940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:07.427588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:07.428103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:07.428932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:07.431306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:07.431913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:07.715882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:07.730740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf2c6b1e-8517-4e81-be0d-390d23eb56aa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1298 microversion: 2.1 time: 0.329173 Sep 23 03:38:07.731376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 35/69] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:07 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:07.767894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:07.769861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:07.802695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:07.808567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:07.816941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c299f4b8-8931-44cc-aba4-b6c9d54ad3d5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:07.827579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:07.828487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:07.831085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:07.835080 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c299f4b8-8931-44cc-aba4-b6c9d54ad3d5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.031354 Sep 23 03:38:07.842092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:07.853720 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:08.249962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-613bb487-047b-4434-8443-ba120a0d0d8a tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-46661341", "id": 1923747897, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:08.293741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-613bb487-047b-4434-8443-ba120a0d0d8a tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.429887 Sep 23 03:38:08.299639 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 36/71] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:07 2022] POST /compute/v2.1/flavors => generated 423 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:08.313513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-184110d1-a4c0-4553-9034-2b200ac26ecb tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:08.333092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-184110d1-a4c0-4553-9034-2b200ac26ecb tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023444 Sep 23 03:38:08.349876 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 37/72] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Sep 23 03:38:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:08.356737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-061db279-577d-4dfe-80b2-0f08dd99cfec tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1166828114", "id": 1225018123, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:08.411771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-061db279-577d-4dfe-80b2-0f08dd99cfec tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.060513 Sep 23 03:38:08.418148 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 38/73] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:08 2022] POST /compute/v2.1/flavors => generated 425 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:08.435528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3cb66a50-54a2-474c-b97a-cb8b7567a5ea tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:08.472647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3cb66a50-54a2-474c-b97a-cb8b7567a5ea tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040456 Sep 23 03:38:08.483214 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 39/74] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Sep 23 03:38:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:08.498692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-815537c9-ba74-4c93-9160-63df40443bf1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Action: 'create', calling method: .version_select at 0x7f0c8bda3940>, body: {"keypair": {"name": "tempest-keypair-1958524183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEExj5NACXvHcvDMjfQwonEsFO7WS8vr+J2I3ku98aibHUSIT4tz+3fvdLKsV9DWz9iNz0X2UBIX3zY3/YrR2PzkGCxeUyr//p2EhFHAOa+506Os0XTPxp/YaLsKA5b+WA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:08.578194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-815537c9-ba74-4c93-9160-63df40443bf1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for project f14ba31b92a6476e83d865495e9320f6. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:38:08.594502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-815537c9-ba74-4c93-9160-63df40443bf1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for user 0d3b2ab940804d72aac837e7d6264aed and project f14ba31b92a6476e83d865495e9320f6. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:38:08.638917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:08.692486 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-815537c9-ba74-4c93-9160-63df40443bf1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197588 Sep 23 03:38:08.702653 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 40/75] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:38:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:08.703914 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a907a6f6-5f22-4fe6-9517-0f2ad91af4d5 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.962034 Sep 23 03:38:08.704564 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 36/76] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:07 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:08.758671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:08.759504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:08.775619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:08.786145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:08.786841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:08.787756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:08.788357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:08.789541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:09.158448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:09.171969 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5338d49-f767-4fe9-9912-7655eb85fd12 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.417482 Sep 23 03:38:09.175346 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 41/77] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:08 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:09.736792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:09.742118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:09.742118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:09.742118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:09.746166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:09.748548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:09.754447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:09.759971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:09.760908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:09.763359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:09.772575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:10.200503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:10.201724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:10.206912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:10.209496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:10.218633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:10.219093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:10.220032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:10.229492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:10.231103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:11.314997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:11.339948 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fdacaf5-b914-4cc1-aa97-862349a3ec0a tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 1.605247 Sep 23 03:38:11.340727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 37/78] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:09 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:11.444686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:11.459735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2cc1c18-8e67-45ff-8a5b-80aa2d73c540 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 1.260185 Sep 23 03:38:11.461512 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 42/79] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:10 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:12.365229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:12.365999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:12.390139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:12.396867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:12.397601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:12.398423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:12.398896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:12.399357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:13.009286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db28824b-898b-4517-8a29-7e6d4db60d4a tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1878476413", "ram": 512, "vcpus": 1, "disk": 10, "id": 399150410, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:13.054080 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db28824b-898b-4517-8a29-7e6d4db60d4a tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.668974 Sep 23 03:38:13.055868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 43/80] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:12 2022] POST /compute/v2.1/flavors => generated 413 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:13.082388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:13.094859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:13.116404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:13.118499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:13.119124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:13.120093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:13.120481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:13.120914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:13.748858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:13.762894 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4800d2ac-7bae-47f7-b840-adee05577b61 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 1.402560 Sep 23 03:38:13.766564 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 38/81] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:12 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:13.775724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60266933-1b6b-4bcc-96f8-2870b1a8973e tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:13.868986 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60266933-1b6b-4bcc-96f8-2870b1a8973e tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.100972 Sep 23 03:38:13.869923 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 39/82] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:38:13 2022] POST /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:13.907733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:13.919996 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2eabe905-8877-4f15-8749-bd7609eeacc7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.857949 Sep 23 03:38:13.921893 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 44/83] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:13 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:14.268521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67662183-a6be-4f7e-90c5-bfd241b668f2 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:14.272230 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-67662183-a6be-4f7e-90c5-bfd241b668f2 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67662183-a6be-4f7e-90c5-bfd241b668f2 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin] Request method failure captured: Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSolhMQnE3uz0PkOwkvKg-4bldYe29QF332oozHKV0ZQxiae_wygYcF5c0q2QYEyUHwIEusWkewnWZPcK0KFQCLF7zB-cDlX0G7pn5Tk8JWUbkE8NNMmewmH4_w0aABmYgTpxpmHHWz-Ot6Y8GF7fR1MOlJi3YEwVL1_Ogw4BIs0BAk Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: da217d8ecf1c4fb4af35bdfd3a644fb2 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:14.317018 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da217d8ecf1c4fb4af35bdfd3a644fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da217d8ecf1c4fb4af35bdfd3a644fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da217d8ecf1c4fb4af35bdfd3a644fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da217d8ecf1c4fb4af35bdfd3a644fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: da217d8ecf1c4fb4af35bdfd3a644fb2 Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 8d669fdc8093464a8a61bea1729143bb Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:14.318326 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid timestamp for date invalid_time Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'invalid_time'} Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:14.318968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67662183-a6be-4f7e-90c5-bfd241b668f2 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:14.320607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67662183-a6be-4f7e-90c5-bfd241b668f2 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474 tempest-InstanceUsageAuditLogNegativeTestJSON-135336474-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.447701 Sep 23 03:38:14.321428 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 23 03:38:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 449 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:38:14.336184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-124545691", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "1225018123", "adminPass": "***", "networks": [{"uuid": "ee17bb46-2848-4e80-a0a1-19a4bd202d49"}], "security_groups": [{"name": "tempest-securitygroup--1875985936"}], "key_name": "tempest-keypair-1958524183", "user_data": "}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:14.552222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] validate_networks() for [('ee17bb46-2848-4e80-a0a1-19a4bd202d49', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:38:14.654493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3eb3fb08-25fd-4094-bfc8-1229bc7657a7 tempest-FlavorsExtraSpecsTestJSON-1720591084 tempest-FlavorsExtraSpecsTestJSON-1720591084-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:14.680682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3eb3fb08-25fd-4094-bfc8-1229bc7657a7 tempest-FlavorsExtraSpecsTestJSON-1720591084 tempest-FlavorsExtraSpecsTestJSON-1720591084-project] 10.222.0.25 "GET /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.757397 Sep 23 03:38:14.683523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1200 bytes} [Fri Sep 23 03:38:13 2022] GET /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:15.032607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d94d1c4-6910-4704-ab64-f7cdc70e201e tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.034404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d94d1c4-6910-4704-ab64-f7cdc70e201e tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '9b3f782ce462479787629ef2404043a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9567052151b84ac4b3368ed361fd6d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d94d1c4-6910-4704-ab64-f7cdc70e201e tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Request method failure captured: Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoiO6q94BKKqSewAivA9tr55xfBz0siWgMnNiGkVBoEOjzoxB8er3uG9T5D4DtwCvkFu3lQvjoPxH28EleDzp19ZZv9cEY_y-RQ2Hy80ohTXKROcjXXcwc8ROqUaYRqSGC7WiAL9xIl2XtVHIEIV6jiDJKYsT_5maMdlfshFl0Zkzc Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9567052151b84ac4b3368ed361fd6d8f Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:15.036208 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9567052151b84ac4b3368ed361fd6d8f Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9b3f782ce462479787629ef2404043a8 Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project Sep 23 03:38:15.037508 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:15.038095 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 03:38:15.039362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.041064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d94d1c4-6910-4704-ab64-f7cdc70e201e tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:15.041939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d94d1c4-6910-4704-ab64-f7cdc70e201e tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.357269 Sep 23 03:38:15.045794 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 46/86] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:38:14 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 358 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:15.050477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e69f0941-c17b-48f6-9ef0-8dd3520716e3 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:15.072479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=78,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:15.078613 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e69f0941-c17b-48f6-9ef0-8dd3520716e3 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034822 Sep 23 03:38:15.079939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 47/87] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:38:15 2022] POST /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:15.084582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.085401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:15.092027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.092538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.093002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.093699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.094313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.094756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.321236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:15.330377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a76dccf-aef1-4178-90da-174979a84970 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.249244 Sep 23 03:38:15.330965 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 48/88] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:15.477671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4535d919-472e-488a-ae73-8149032868ca", "tag": "11dd0c0b-bd1e-439d-a4cd-e08ae42e4219"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:15.492535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.493025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.493920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.514922 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] Creating event network-changed:11dd0c0b-bd1e-439d-a4cd-e08ae42e4219 for instance 4535d919-472e-488a-ae73-8149032868ca on n-h1-858495-2 Sep 23 03:38:15.520665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-648b5959-93c9-4090-84bc-92fa8ccc072a req-093ddd9d-2e2d-42ef-9566-3db0393ef1c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187865 Sep 23 03:38:15.521665 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 49/89] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:15.528944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.530142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:15.537659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.538327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.538948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.540108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.541212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.541982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.728601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:38:15.729228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:38:15.729683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:38:15.730177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:38:15.730659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:38:15.740537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.741598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.743044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.744023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:15.744796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:15.745327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:15.764286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for project f14ba31b92a6476e83d865495e9320f6. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:38:15.769089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for user 0d3b2ab940804d72aac837e7d6264aed and project f14ba31b92a6476e83d865495e9320f6. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:38:15.778905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:15.783180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:38:15.786042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:38:15.792969 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0bb99b03-9299-4e4f-9531-d00bd83a1761 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.269734 Sep 23 03:38:15.793600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 50/90] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:15.813935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bca090b-2425-476c-8151-386824e7dca8 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.816001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bca090b-2425-476c-8151-386824e7dca8 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '9b3f782ce462479787629ef2404043a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9567052151b84ac4b3368ed361fd6d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bca090b-2425-476c-8151-386824e7dca8 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Request method failure captured: Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2003:38:15 HTTP/1.1 Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoiO6q94BKKqSewAivA9tr55xfBz0siWgMnNiGkVBoEOjzoxB8er3uG9T5D4DtwCvkFu3lQvjoPxH28EleDzp19ZZv9cEY_y-RQ2Hy80ohTXKROcjXXcwc8ROqUaYRqSGC7WiAL9xIl2XtVHIEIV6jiDJKYsT_5maMdlfshFl0Zkzc Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9567052151b84ac4b3368ed361fd6d8f Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:15.817981 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9567052151b84ac4b3368ed361fd6d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9567052151b84ac4b3368ed361fd6d8f Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9b3f782ce462479787629ef2404043a8 Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project Sep 23 03:38:15.819417 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2022-09-23 03:38:15'} Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:15.820632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 03:38:15.821718 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:15.823796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bca090b-2425-476c-8151-386824e7dca8 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:15.824870 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3bca090b-2425-476c-8151-386824e7dca8 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513 tempest-InstanceUsageAuditLogNegativeTestJSON-1717638513-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23 03:38:15" status: 403 len: 128 microversion: 2.1 time: 0.014854 Sep 23 03:38:15.830274 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 51/91] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2003%3A38%3A15 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:15.835920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-627461bf-47c9-4d5d-ae4b-b074b05b6c81 tempest-FlavorsExtraSpecsTestJSON-1720591084 tempest-FlavorsExtraSpecsTestJSON-1720591084-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.846203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-627461bf-47c9-4d5d-ae4b-b074b05b6c81 tempest-FlavorsExtraSpecsTestJSON-1720591084 tempest-FlavorsExtraSpecsTestJSON-1720591084-project] 10.222.0.25 "GET /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014429 Sep 23 03:38:15.853317 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 52/92] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:15.857851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc8dbae4-6ddb-4fad-a827-8cda82ee8e53 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.536276 Sep 23 03:38:15.858614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 41/93] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:38:15.879285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16b5f09a-cea5-4ecf-95ac-0bfabb41ffcc tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:15.914544 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16b5f09a-cea5-4ecf-95ac-0bfabb41ffcc tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053942 Sep 23 03:38:15.915846 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 42/94] 10.222.0.25 () {60 vars in 1221 bytes} [Fri Sep 23 03:38:15 2022] POST /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:15.921575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3f74e57-0ce4-4ae0-88dd-42c94340ebd3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:15.922481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3f74e57-0ce4-4ae0-88dd-42c94340ebd3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:16.004738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3f74e57-0ce4-4ae0-88dd-42c94340ebd3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.021193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3f74e57-0ce4-4ae0-88dd-42c94340ebd3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1264 microversion: 2.1 time: 0.104009 Sep 23 03:38:16.022361 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 43/95] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1264 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:16.213130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1578f63d-d8b6-4456-8f9b-94b913bb84cd tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Calling method '.version_select at 0x7f0c8be3be50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.215222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1578f63d-d8b6-4456-8f9b-94b913bb84cd tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd819a6546c9f4113a6088ff1b1519eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04eabe4a2554831b1ec39bbbf9705af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1578f63d-d8b6-4456-8f9b-94b913bb84cd tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Request method failure captured: Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSokP75mkWAJkmqQWoijeH9TuRQ1B0gJ7H2AEbsOCY1yL2Wt8laMO2BZ6OkPzTwpWjFTZrMk6rlSzMXLpK4EzerBvnq-CkI-dlHzVU-DPtHsuGvXyZj0jYalJESuSam7ojwfcKGlzBbOj57UanGihc1Y0m7zMxOMDFDBm7oHcpXXmB0 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:16.217278 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d819a6546c9f4113a6088ff1b1519eb9 Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:16.218642 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:16.219429 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 03:38:16.220373 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.221391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1578f63d-d8b6-4456-8f9b-94b913bb84cd tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.221391 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1578f63d-d8b6-4456-8f9b-94b913bb84cd tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.366338 Sep 23 03:38:16.224643 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 53/96] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 03:38:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.240175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c962dc3-a0b4-454f-8139-638304981a02 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.265719 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c962dc3-a0b4-454f-8139-638304981a02 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038137 Sep 23 03:38:16.271826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 54/97] 10.222.0.25 () {58 vars in 1200 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:16.278675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89ecbe3b-e80e-4b73-bb4b-28df6f84384e tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Calling method '.version_select at 0x7f0c8bda3790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.280663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89ecbe3b-e80e-4b73-bb4b-28df6f84384e tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd819a6546c9f4113a6088ff1b1519eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04eabe4a2554831b1ec39bbbf9705af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89ecbe3b-e80e-4b73-bb4b-28df6f84384e tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Request method failure captured: Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSokP75mkWAJkmqQWoijeH9TuRQ1B0gJ7H2AEbsOCY1yL2Wt8laMO2BZ6OkPzTwpWjFTZrMk6rlSzMXLpK4EzerBvnq-CkI-dlHzVU-DPtHsuGvXyZj0jYalJESuSam7ojwfcKGlzBbOj57UanGihc1Y0m7zMxOMDFDBm7oHcpXXmB0 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:16.282682 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d819a6546c9f4113a6088ff1b1519eb9 Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:16.283899 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:16.284583 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 03:38:16.285727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.287466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89ecbe3b-e80e-4b73-bb4b-28df6f84384e tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.289201 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89ecbe3b-e80e-4b73-bb4b-28df6f84384e tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014103 Sep 23 03:38:16.290388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 55/98] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.308908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5b2b071-020b-4a7f-800b-2155b5aadf5d tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:16.359646 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5b2b071-020b-4a7f-800b-2155b5aadf5d tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.067621 Sep 23 03:38:16.360929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 56/99] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:38:16 2022] PUT /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes => generated 22 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:16.366556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd421c05-fc9c-43c8-90e8-1d8f47333b68 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Calling method '.version_select at 0x7f0c8be3b820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.369607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd421c05-fc9c-43c8-90e8-1d8f47333b68 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd819a6546c9f4113a6088ff1b1519eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04eabe4a2554831b1ec39bbbf9705af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd421c05-fc9c-43c8-90e8-1d8f47333b68 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Request method failure captured: Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSokP75mkWAJkmqQWoijeH9TuRQ1B0gJ7H2AEbsOCY1yL2Wt8laMO2BZ6OkPzTwpWjFTZrMk6rlSzMXLpK4EzerBvnq-CkI-dlHzVU-DPtHsuGvXyZj0jYalJESuSam7ojwfcKGlzBbOj57UanGihc1Y0m7zMxOMDFDBm7oHcpXXmB0 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:16.372497 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d819a6546c9f4113a6088ff1b1519eb9 Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:16.373724 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:16.374376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 03:38:16.375334 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.377624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd421c05-fc9c-43c8-90e8-1d8f47333b68 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.378726 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd421c05-fc9c-43c8-90e8-1d8f47333b68 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016455 Sep 23 03:38:16.380675 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 57/100] 10.222.0.25 () {58 vars in 1179 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.385999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.386648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:16.394490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.394972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.395410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.396208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.396770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.398744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.436239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b13d62e8-d09f-4808-932a-2ee85d4031ac tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1513927994", "id": 66030460, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:16.461627 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b13d62e8-d09f-4808-932a-2ee85d4031ac tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.437706 Sep 23 03:38:16.462811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 44/101] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:38:16 2022] POST /compute/v2.1/flavors => generated 443 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:16.467554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d213ec42-e342-419e-9630-208ed3e20b67 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.479247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d213ec42-e342-419e-9630-208ed3e20b67 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015076 Sep 23 03:38:16.484992 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 45/102] 10.222.0.25 () {58 vars in 1200 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/399150410/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:16.607249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.613182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Calling method '.version_select at 0x7f0c8bf36310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.615015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.615668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.616112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.617037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c51df62-0627-496f-8894-5259472fcbcd tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.235268 Sep 23 03:38:16.627700 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 58/103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:16.641872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.642608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.643297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.656374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.656974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.657630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.665158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba15d94a-46fa-4d1b-9b08-1b59974ded0d tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.179064 Sep 23 03:38:16.673005 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 46/104] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:16.678232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12d1401f-12fc-4ea3-92f8-816a35b48396 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.681379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=6,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:16.721679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-12d1401f-12fc-4ea3-92f8-816a35b48396 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.047210 Sep 23 03:38:16.722594 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 47/105] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 03:38:16 2022] DELETE /compute/v2.1/flavors/399150410/os-extra_specs/hw:numa_nodes => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:16.728243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465ae69d-e45a-467c-8b94-2ac64a7c2a1f tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Calling method '.version_select at 0x7f0c8bf9cca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.730404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-465ae69d-e45a-467c-8b94-2ac64a7c2a1f tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd819a6546c9f4113a6088ff1b1519eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04eabe4a2554831b1ec39bbbf9705af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465ae69d-e45a-467c-8b94-2ac64a7c2a1f tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Request method failure captured: Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSokP75mkWAJkmqQWoijeH9TuRQ1B0gJ7H2AEbsOCY1yL2Wt8laMO2BZ6OkPzTwpWjFTZrMk6rlSzMXLpK4EzerBvnq-CkI-dlHzVU-DPtHsuGvXyZj0jYalJESuSam7ojwfcKGlzBbOj57UanGihc1Y0m7zMxOMDFDBm7oHcpXXmB0 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:38:16.733826 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d819a6546c9f4113a6088ff1b1519eb9 Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '1'} Sep 23 03:38:16.734949 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:16.735692 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 03:38:16.736680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.738258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465ae69d-e45a-467c-8b94-2ac64a7c2a1f tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.738965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-465ae69d-e45a-467c-8b94-2ac64a7c2a1f tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015423 Sep 23 03:38:16.739509 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 48/106] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.746898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1060116a-612b-4e71-b383-be349d5fc713 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.770945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1060116a-612b-4e71-b383-be349d5fc713 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/399150410/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027607 Sep 23 03:38:16.776230 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 49/107] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 03:38:16 2022] DELETE /compute/v2.1/flavors/399150410/os-extra_specs/hw:cpu_policy => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:16.781316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99ac34c4-e691-48f8-9543-594d3a844e76 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Calling method '.version_select at 0x7f0c8bf178b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.782901 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-99ac34c4-e691-48f8-9543-594d3a844e76 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] HTTP exception thrown: Hypervisor with ID '56055810-9a00-4e51-bbd5-1bb29f03093b' could not be found. Sep 23 03:38:16.783450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c31bb5e-5206-4e11-9e58-c50d15656c48 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.791636 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c31bb5e-5206-4e11-9e58-c50d15656c48 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] 10.222.0.25 "GET /compute/v2.1/flavors/66030460" status: 200 len: 443 microversion: 2.55 time: 0.172461 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99ac34c4-e691-48f8-9543-594d3a844e76 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Request method failure captured: Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/56055810-9a00-4e51-bbd5-1bb29f03093b/uptime HTTP/1.1 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoniBkhY1C4wyvDoBNdxBIxOBc87e0wqrZH_U9yeTkKHJ8yu7Q7aawHMo-dpe6VEhm18PmT3T1OHVbZkGKBIofg16SihBlXz-MpumtOzziLcSwcf2c_ihEytiz99y0hyoz90tzoHc1dpQQI2S4gmz5Vgaldb1NXDZxBJBRH7aftYeE Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 3c9a539888e542f98a44fc2cb0e0f004 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:16.796114 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 3c9a539888e542f98a44fc2cb0e0f004 Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 365b4828c132459ca944a074d14e6e80 Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: exception: Hypervisor with ID '56055810-9a00-4e51-bbd5-1bb29f03093b' could not be found. Sep 23 03:38:16.797706 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '56055810-9a00-4e51-bbd5-1bb29f03093b'} Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '56055810-9a00-4e51-bbd5-1bb29f03093b' Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 23 03:38:16.798377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '56055810-9a00-4e51-bbd5-1bb29f03093b' could not be found. Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.799554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '56055810-9a00-4e51-bbd5-1bb29f03093b' could not be found. Sep 23 03:38:16.800613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.801055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 59/108] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/66030460 => generated 443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:16.802629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99ac34c4-e691-48f8-9543-594d3a844e76 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Returning 404 to user: Hypervisor with ID '56055810-9a00-4e51-bbd5-1bb29f03093b' could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.803695 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99ac34c4-e691-48f8-9543-594d3a844e76 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/56055810-9a00-4e51-bbd5-1bb29f03093b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.026825 Sep 23 03:38:16.804476 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 50/109] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors/56055810-9a00-4e51-bbd5-1bb29f03093b/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.805452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-beec98ef-8323-4dd0-99a6-f4ad680a5097 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.810752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad70c6a3-ccb0-403a-92bc-d51681d73c3c tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] Action: 'update', calling method: .version_select at 0x7f0c9103cb80>, body: {"flavor": {"description": "new"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:16.816299 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-beec98ef-8323-4dd0-99a6-f4ad680a5097 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/399150410/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014391 Sep 23 03:38:16.817045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 60/110] 10.222.0.25 () {58 vars in 1200 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/399150410/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:16.822115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Calling method '.version_select at 0x7f0c8bd87dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.824324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.824803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.825240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.849298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.849833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.850258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.863764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.865180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.865935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.874459 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e911a905-131e-424a-9ab3-0ea5cd0221a3 tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056298 Sep 23 03:38:16.875434 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 61/111] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:16.880148 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad70c6a3-ccb0-403a-92bc-d51681d73c3c tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/66030460" status: 200 len: 444 microversion: 2.55 time: 0.074367 Sep 23 03:38:16.880769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.880972 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 51/112] 10.222.0.25 () {62 vars in 1213 bytes} [Fri Sep 23 03:38:16 2022] PUT /compute/v2.1/flavors/66030460 => generated 444 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:16.881816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:16.886895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d48d84a9-c287-483a-a45d-4e59e8c85070 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.888432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.889671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.890212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.891009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:16.891536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:16.892024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:16.910865 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d48d84a9-c287-483a-a45d-4e59e8c85070 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/399150410" status: 202 len: 0 microversion: 2.1 time: 0.028210 Sep 23 03:38:16.912474 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 52/113] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:38:16 2022] DELETE /compute/v2.1/flavors/399150410 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:16.919622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-615be528-817d-4ffc-aa95-a655bb19ce50 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Calling method '.version_select at 0x7f0c8bfae700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.922633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-615be528-817d-4ffc-aa95-a655bb19ce50 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd819a6546c9f4113a6088ff1b1519eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04eabe4a2554831b1ec39bbbf9705af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-615be528-817d-4ffc-aa95-a655bb19ce50 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Request method failure captured: Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSokP75mkWAJkmqQWoijeH9TuRQ1B0gJ7H2AEbsOCY1yL2Wt8laMO2BZ6OkPzTwpWjFTZrMk6rlSzMXLpK4EzerBvnq-CkI-dlHzVU-DPtHsuGvXyZj0jYalJESuSam7ojwfcKGlzBbOj57UanGihc1Y0m7zMxOMDFDBm7oHcpXXmB0 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:38:16.924723 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b04eabe4a2554831b1ec39bbbf9705af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b04eabe4a2554831b1ec39bbbf9705af Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307210990 Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d819a6546c9f4113a6088ff1b1519eb9 Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307210990-project Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '1'} Sep 23 03:38:16.926109 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:16.926910 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 03:38:16.927854 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:16.930040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-615be528-817d-4ffc-aa95-a655bb19ce50 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:16.931703 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-615be528-817d-4ffc-aa95-a655bb19ce50 tempest-HypervisorAdminNegativeTestJSON-307210990 tempest-HypervisorAdminNegativeTestJSON-307210990-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017611 Sep 23 03:38:16.933397 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 53/114] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:16.937584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cdae003b-83e8-491a-9050-02c361da8080 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:16.970883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cdae003b-83e8-491a-9050-02c361da8080 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.036972 Sep 23 03:38:16.971461 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 54/115] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:16.977262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5e6fe8c-b6b7-4741-92f0-0d399135b330 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.001785 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5e6fe8c-b6b7-4741-92f0-0d399135b330 tempest-FlavorsExtraSpecsTestJSON-1730957586 tempest-FlavorsExtraSpecsTestJSON-1730957586-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6231 microversion: 2.1 time: 0.029022 Sep 23 03:38:17.002542 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 55/116] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/flavors/detail => generated 6231 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:17.007601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-555a5922-35e1-4014-ac86-f3b01637fa1e tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Calling method '.version_select at 0x7f0c8be9d940>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.009381 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-555a5922-35e1-4014-ac86-f3b01637fa1e tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] HTTP exception thrown: Hypervisor with ID '39252ece-5d46-4273-beae-e0bef9cf81a0' could not be found. Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-555a5922-35e1-4014-ac86-f3b01637fa1e tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Request method failure captured: Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/39252ece-5d46-4273-beae-e0bef9cf81a0 HTTP/1.1 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoniBkhY1C4wyvDoBNdxBIxOBc87e0wqrZH_U9yeTkKHJ8yu7Q7aawHMo-dpe6VEhm18PmT3T1OHVbZkGKBIofg16SihBlXz-MpumtOzziLcSwcf2c_ihEytiz99y0hyoz90tzoHc1dpQQI2S4gmz5Vgaldb1NXDZxBJBRH7aftYeE Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 3c9a539888e542f98a44fc2cb0e0f004 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:17.011166 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c9a539888e542f98a44fc2cb0e0f004"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 3c9a539888e542f98a44fc2cb0e0f004 Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-616598598 Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 365b4828c132459ca944a074d14e6e80 Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: exception: Hypervisor with ID '39252ece-5d46-4273-beae-e0bef9cf81a0' could not be found. Sep 23 03:38:17.012315 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '39252ece-5d46-4273-beae-e0bef9cf81a0'} Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '39252ece-5d46-4273-beae-e0bef9cf81a0' Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 23 03:38:17.013028 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:38:17.014172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '39252ece-5d46-4273-beae-e0bef9cf81a0' could not be found. Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '39252ece-5d46-4273-beae-e0bef9cf81a0' could not be found. Sep 23 03:38:17.015398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:17.017701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-555a5922-35e1-4014-ac86-f3b01637fa1e tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] Returning 404 to user: Hypervisor with ID '39252ece-5d46-4273-beae-e0bef9cf81a0' could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:17.019074 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-555a5922-35e1-4014-ac86-f3b01637fa1e tempest-HypervisorAdminNegativeTestJSON-616598598 tempest-HypervisorAdminNegativeTestJSON-616598598-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/39252ece-5d46-4273-beae-e0bef9cf81a0" status: 404 len: 123 microversion: 2.1 time: 0.015478 Sep 23 03:38:17.020069 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 56/117] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 03:38:17 2022] GET /compute/v2.1/os-hypervisors/39252ece-5d46-4273-beae-e0bef9cf81a0 => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:17.036967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41dbd6fb-be9b-43a6-ae26-980c7f40e101 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.066248 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41dbd6fb-be9b-43a6-ae26-980c7f40e101 tempest-FlavorsV255TestJSON-1158180242 tempest-FlavorsV255TestJSON-1158180242-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.037683 Sep 23 03:38:17.066947 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 57/118] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Sep 23 03:38:17 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:17.072254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.073011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:17.079085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.079578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.080014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.080711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.081494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.081917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.103768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:17.113749 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c039a9d8-8008-4cc0-8a57-83e25a8d1bc4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.236978 Sep 23 03:38:17.118158 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 62/119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:16 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:17.123166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-217b8f15-b584-45d7-b268-fee0d06f3b28 tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.148627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-217b8f15-b584-45d7-b268-fee0d06f3b28 tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/66030460" status: 202 len: 0 microversion: 2.55 time: 0.028828 Sep 23 03:38:17.150604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 63/120] 10.222.0.25 () {60 vars in 1196 bytes} [Fri Sep 23 03:38:17 2022] DELETE /compute/v2.1/flavors/66030460 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:38:17.162673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:17.163455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ffd51a43-4542-4058-b959-013069a9c3e7 tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.171977 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c2e9faf-e6b8-4070-835a-5b1f75086fbe tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1316 microversion: 2.1 time: 0.103619 Sep 23 03:38:17.185374 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 58/121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:17 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:17.190605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ffd51a43-4542-4058-b959-013069a9c3e7 tempest-FlavorsV255TestJSON-385717205 tempest-FlavorsV255TestJSON-385717205-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.035283 Sep 23 03:38:17.191196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 64/122] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:38:17 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:17.557588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af737615-a68c-46ef-8d01-6951b0b91115", "tag": "2333ac35-2553-494c-bab6-b4b05ab5bcb3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:17.572695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.573377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.574010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.594698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Creating event network-changed:2333ac35-2553-494c-bab6-b4b05ab5bcb3 for instance af737615-a68c-46ef-8d01-6951b0b91115 on n-h1-858495-2 Sep 23 03:38:17.595534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:38:17.596080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dc6fcde9-3a6b-4133-9d3f-78c59d29023d req-ce11a1aa-961b-4ccc-9ce8-96eb122405d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:38:17.598495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.599273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.599854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.600737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.601912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.602343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.612400 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.rpcapi [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 03:38:17.613297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] Releasing lock "compute-rpcapi-router" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:38:17.639321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:17.640113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:17.641706 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbb39904-82bc-4783-9318-213327a70e48 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087510 Sep 23 03:38:17.644614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 59/123] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:17.650499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.651014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.651435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:17.652415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:17.652878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:17.653327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:18.042045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:18.055038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1802c6e3-64cc-4230-a057-343d73929ea6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.418904 Sep 23 03:38:18.055563 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 65/124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:17 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:18.142203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:18.143601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:18.158220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:18.159006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:18.159635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:18.160560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:18.161206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:18.161885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:18.196785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:18.197423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:18.204085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:18.204574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:18.208263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:18.211745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:18.212239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:18.212674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:18.326342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:18.338813 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f23f0909-4853-4649-a0c7-dfac92d5ee50 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.145524 Sep 23 03:38:18.339796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 66/125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:18 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:18.471978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:18.486648 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d87c68d-799f-4d50-9e93-2d9a3449d06f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.348633 Sep 23 03:38:18.487768 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 60/126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:18 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:19.082507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:19.082507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:19.084037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=18 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:19.098630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.114327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.115109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.118535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.119588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.122184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.405169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:19.406029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:19.504330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.504831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.505319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.506059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.506516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.507303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.570249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:19.594175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df2365f1-d999-4fa4-8c15-89d2d1147013 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.516742 Sep 23 03:38:19.596438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 67/127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:19 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:19.621304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:19.625202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:19.625867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:19.640050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c188c56d-a0ae-473b-bc54-2f747e7236ff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.266572 Sep 23 03:38:19.658976 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 61/128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:19 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:19.660115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.660697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.661396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.662191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:19.662678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:19.663129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:19.948323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:19.951792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:19.956628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88482e05-3671-4bd7-a082-fb2e893646a9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.354322 Sep 23 03:38:19.978857 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 68/129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:19 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:20.628171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:20.629327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:20.651443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:20.652525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:20.653186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:20.654058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:20.654537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:20.654974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:20.669904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:20.671601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:20.680161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:20.681859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:20.682512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:20.683691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:20.685588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:20.686368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:20.818926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:20.840459 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa0bd4e4-4143-4d37-be0f-d42072df0f3d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.175764 Sep 23 03:38:20.841551 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 69/130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:20 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:20.905105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:20.925050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc49c7fe-715b-48c3-bf7b-539c3dd9ee99 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.304433 Sep 23 03:38:20.925701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 62/131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:20 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:20.988034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:20.989379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:20.997708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:20.998318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:20.998930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.000486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:21.004421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:21.004980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.189621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:21.200671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03b2a4cd-42b0-4436-bb8b-d36a243aa563 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.218406 Sep 23 03:38:21.218044 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 70/132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:20 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:21.864903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:21.866941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:21.880102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:21.880597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:21.881029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.881775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:21.882809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:21.883427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.948212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:21.948969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:21.957522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:21.958357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:21.958978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.959940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:21.962371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:21.963191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:21.978413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:22.005938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5796d91-1fcc-4276-acd3-8dde50b19b18 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.145573 Sep 23 03:38:22.007455 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 63/133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:21 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:22.179794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:22.187860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51f40259-2cab-4850-8ed9-2f1f954e1467 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.243502 Sep 23 03:38:22.198059 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 71/134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:21 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:22.227868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:22.228639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:22.235604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.236498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.237421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.239009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.239520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.240089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.350689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4535d919-472e-488a-ae73-8149032868ca", "name": "network-vif-plugged", "status": "completed", "tag": "11dd0c0b-bd1e-439d-a4cd-e08ae42e4219"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:22.365642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.367301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.368270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.383407 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] Creating event network-vif-plugged:11dd0c0b-bd1e-439d-a4cd-e08ae42e4219 for instance 4535d919-472e-488a-ae73-8149032868ca on n-h1-858495-2 Sep 23 03:38:22.392521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:22.402329 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2689b646-4775-482f-9437-32f6f38f2ddc req-a9422f55-98a7-4d0f-90db-004518224941 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251212 Sep 23 03:38:22.403963 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-605494f3-c232-4987-9d04-4bd7ad4dcbaa tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.181230 Sep 23 03:38:22.405439 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 64/135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:22.406064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 72/136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:22 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:22.763206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:22.766616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.767093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.767551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.768608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.769244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.769672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.797327 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b950415-acf4-4922-815b-a272b2464cf4 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.312876 Sep 23 03:38:22.798470 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 65/137] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:22 2022] GET /compute/v2.1/os-services => generated 966 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:22.811736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:22.815367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.816102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.816538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.817431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.817886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.818307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.851262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1be427fe-6905-4b98-b022-eb5f4ef98b33 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858495-2" status: 200 len: 578 microversion: 2.1 time: 0.042538 Sep 23 03:38:22.851857 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 73/138] 10.222.0.25 () {58 vars in 1172 bytes} [Fri Sep 23 03:38:22 2022] GET /compute/v2.1/os-services?host=n-d-858495-2 => generated 578 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:22.867211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:22.870809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.871492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.871937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.872783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.873268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.873738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.900792 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca9475d5-593f-4430-8328-362521771a50 tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.036301 Sep 23 03:38:22.900792 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 66/139] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:38:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:22.912193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:22.918434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.919318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.920074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.920966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:22.921601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:22.922217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:22.957411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ddfb829-0504-4b6a-aba7-3896d31fbc3b tempest-ServicesAdminTestJSON-1640924769 tempest-ServicesAdminTestJSON-1640924769-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.049210 Sep 23 03:38:22.966205 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 74/140] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:22 2022] GET /compute/v2.1/os-services => generated 966 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:23.031673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:23.032420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:23.040377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.040948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.041310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.042240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.042707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.043135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.135538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:23.146337 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-459231e7-b1c0-42e1-a3ec-446d88b4b881 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.119861 Sep 23 03:38:23.162192 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 67/141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:23 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:23.212123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:23.212742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:23.219631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.220490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.221067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.222106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.222776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.223429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.438741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:23.453242 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0aa43990-544f-4ea5-a6ca-c4f36dacc862 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.245766 Sep 23 03:38:23.466268 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 75/142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:23 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:23.483395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:23.484150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:23.494464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.497189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.498194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.499624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:23.514975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:23.515432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:23.799654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1851463994", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:23.862317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:38:23.934368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:23.942470 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd7d443a-5048-4d72-8df6-4df89266d565 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1340 microversion: 2.1 time: 0.473972 Sep 23 03:38:23.957727 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 76/143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:23 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1340 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:24.116994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Calling method '.version_select at 0x7f0c8bd87040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.121243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.121762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.122555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.142643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.143143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.143604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.182210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.182716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.183155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.197004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.197712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.198298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.215964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:38:24.216498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:38:24.216858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:38:24.217273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:38:24.217714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:38:24.221641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.222303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.223024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.230800 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb2fceeb-3949-4567-ae09-d7192f483141 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.271111 Sep 23 03:38:24.234457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.235469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.236059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.236943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.237595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.238228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.242635 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 77/144] 10.222.0.25 () {60 vars in 1243 bytes} [Fri Sep 23 03:38:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:24.254009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.254866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:24.262804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.263495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.264094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.264554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:38:24.265800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.266421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.267550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.269416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:38:24.281640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:38:24.283959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:38:24.351582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:24.359783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a9690be-d036-4471-9b6c-1594a6bd1c57 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.111313 Sep 23 03:38:24.361013 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 78/145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:24.365925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Calling method '.version_select at 0x7f0c8bd879d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.374590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.382489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9223868-429b-4c49-8af8-cd258b2cec44 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113847 Sep 23 03:38:24.383208 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 68/146] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:38:24.388482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.389343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.398882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1b076fa-5674-49d1-8b6a-163b98041a93 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.400321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f1b076fa-5674-49d1-8b6a-163b98041a93 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:24.435786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.436828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.438255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.473446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1b076fa-5674-49d1-8b6a-163b98041a93 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:24.481477 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1b076fa-5674-49d1-8b6a-163b98041a93 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1213 microversion: 2.1 time: 0.090046 Sep 23 03:38:24.482066 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 69/147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:24.495920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.497007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.498031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.511098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.511566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.512248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.512398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:24.513063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.530825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.533795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.535738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.538929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.539546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.540868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.561999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.562548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.563005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.581450 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ff67254-41a7-4f15-a82b-8acb16f6e8c7 tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.218898 Sep 23 03:38:24.593039 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 79/148] 10.222.0.25 () {60 vars in 1222 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:24.604946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Calling method '.version_select at 0x7f0c8bd4be50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.614945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.619617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.620142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.650842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.652431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.652884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.661081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f29ffee7-be56-45b9-83ef-a50f684c26cb tempest-HypervisorAdminV253TestBase-462549676 tempest-HypervisorAdminV253TestBase-462549676-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/52272385-088a-45ae-9d52-5bea2c94d2cf" status: 200 len: 792 microversion: 2.53 time: 0.066823 Sep 23 03:38:24.675415 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 80/149] 10.222.0.25 () {60 vars in 1298 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/os-hypervisors/52272385-088a-45ae-9d52-5bea2c94d2cf => generated 792 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:24.690302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af737615-a68c-46ef-8d01-6951b0b91115", "name": "network-vif-plugged", "status": "completed", "tag": "2333ac35-2553-494c-bab6-b4b05ab5bcb3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:24.745506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.746686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.747543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.800650 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] Creating event network-vif-plugged:2333ac35-2553-494c-bab6-b4b05ab5bcb3 for instance af737615-a68c-46ef-8d01-6951b0b91115 on n-h1-858495-2 Sep 23 03:38:24.826845 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8d3833ee-006d-441f-90ff-27bf1a629685 req-ee82190f-0149-46ce-9ffd-7c7dec1de1b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136371 Sep 23 03:38:24.831328 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 81/150] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:24.957604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:24.973112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-845e96a5-af09-4680-8d1e-c199d8253a65 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.476051 Sep 23 03:38:24.973818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:24.974710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:24.975065 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 70/151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:24.987882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.988982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.989756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:24.991886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:24.992549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:24.993325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.249306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:25.258588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f031d2d-d869-4856-a85f-2cfba0c2df25 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1489 microversion: 2.1 time: 0.291513 Sep 23 03:38:25.274896 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 82/152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:24 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1489 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:25.390527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:25.391150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:25.400905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.401195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.405566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.406748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.407234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.407674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.543623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:25.555000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8f9bc13-4a76-4cb7-a9b4-fc89ac8247d9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.166904 Sep 23 03:38:25.560657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 83/153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:25 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:25.565421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:25.571891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:25.584906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.585637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.586261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.587211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.587439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.588993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.690874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:25.706768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7456b470-2d06-47e8-8290-c10770dcdcc6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1209 microversion: 2.1 time: 0.144715 Sep 23 03:38:25.707974 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 84/154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:25 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:25.810636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:25.811961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:25.824644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.825272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.826806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.827590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:25.828225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:25.828954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:25.910610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] [instance: 4535d919-472e-488a-ae73-8149032868ca] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:38:26.002703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:26.003351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:26.006322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:26.015145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.021648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.022929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.025213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.031866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.032434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.041406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:26.102494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5ec4555-b068-419a-922e-d893cbfe4925 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 204 len: 0 microversion: 2.1 time: 0.822014 Sep 23 03:38:26.103622 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 71/155] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:38:25 2022] DELETE /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:38:26.115430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:26.116235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:26.122695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.123453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.124062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.125274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.126368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.126926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.338143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:26.349763 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6dd74990-eee6-42e0-917c-d03efb279270 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.350725 Sep 23 03:38:26.374159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 85/156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:25 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:26.412805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:26.422028 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9f21b04-ae60-41f2-a7ea-930713463367 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1495 microversion: 2.1 time: 0.313117 Sep 23 03:38:26.440784 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 72/157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:26 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1495 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:26.588959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:26.590557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:26.599714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.601258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.601764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.602487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.602977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.603584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.736224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:26.738276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:26.747087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.748241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.748532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:26.749044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.750016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:26.750621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:26.751188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:26.761646 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10c974c3-a094-4ae7-8839-3a098196ade9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1322 microversion: 2.1 time: 0.175849 Sep 23 03:38:26.779143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 86/158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:26 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:26.852286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:26.856277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:26.863421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f63acd6d-f9c7-4e42-b2a4-76ba2ccce362 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1271 microversion: 2.1 time: 0.132255 Sep 23 03:38:26.864055 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 73/159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:26 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:27.385417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:27.386607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:27.419291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.421257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.426634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:27.430841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.432275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.433091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:27.453878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:27.462658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:27.499440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.502142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.503646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:27.511664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.512702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.514072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:27.942485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:27.953648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d59d0e99-d010-45a5-9b48-e3a13c762c7e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1338 microversion: 2.1 time: 0.573509 Sep 23 03:38:27.954989 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 87/160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:27 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1338 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:27.964815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:27.965456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:27.977686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.978179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.982777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:27.983688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:27.984540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:27.985109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:28.511647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:28.519447 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42dea8b2-19fe-473c-a0ab-cffc15ec62ba tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1495 microversion: 2.1 time: 1.077857 Sep 23 03:38:28.534134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 74/161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:27 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1495 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:28.544976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:28.546090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:28.556485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:28.556646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:28.557789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:28.558471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:28.559399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:28.560228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:28.561093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:28.572327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-684d2ae5-189d-485b-92be-60ef1ad8d4ca tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.616243 Sep 23 03:38:28.572933 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 88/162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:27 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:28.698692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:28.714542 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23330339-a510-4adb-9ab1-57d6c2e545bb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1271 microversion: 2.1 time: 0.178411 Sep 23 03:38:28.716174 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 75/163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:28 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:28.955916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:28.961086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:28.961943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:28.962654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:28.963628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:28.964378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:28.965195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:28.978022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:28.979123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:28.994554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:28.997507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:28.998216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.002019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.003156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.006669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.051975 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f4c4643-05a8-4651-9c5b-3c3bb8aa6587 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.469454 Sep 23 03:38:29.069293 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 89/164] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:28 2022] GET /compute/v2.1/os-services => generated 966 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:29.074484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.089417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.090357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.091017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.092068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.092763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.093552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.137388 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87c0f314-b83f-44d5-a4d4-e8788761aa2c tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.065120 Sep 23 03:38:29.148881 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 90/165] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 966 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:29.168269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.179945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.184467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.186760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.188848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.190349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.191564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.251972 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-afe184fa-864c-4608-b4c2-181d536fc162 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.100760 Sep 23 03:38:29.254276 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 91/166] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services => generated 966 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:29.266655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.271465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.272706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.273340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.274302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.274940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.275570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.301502 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aca3dfb5-5f0f-41e1-aaeb-24a508961255 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858495-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038497 Sep 23 03:38:29.309938 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 92/167] 10.222.0.25 () {58 vars in 1194 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services?host=n-d-858495-2&binary=xxx => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:29.315149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.318965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.319779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.320460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.321515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.322179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.322812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.353799 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3119e4ff-fece-4099-bede-aa0502a661e8 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.042425 Sep 23 03:38:29.364438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 93/168] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services => generated 966 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:29.371205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.374836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.379087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.384755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.386736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.386736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.386736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.410722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:29.427980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad79312a-b93e-4b93-8e67-b1148c98976e tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1487 microversion: 2.1 time: 0.454841 Sep 23 03:38:29.441967 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 76/169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:28 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:29.456769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.457443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:29.459342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=5,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:29.471782 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aba44a0a-1f2c-47b2-bc16-55aaebb48592 tempest-ServicesAdminNegativeTestJSON-1606052756 tempest-ServicesAdminNegativeTestJSON-1606052756-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.106119 Sep 23 03:38:29.475530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.476000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.476467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.477270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.477793 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 94/170] 10.222.0.25 () {58 vars in 1198 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:38:29.482529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.484463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.855065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8217c6b4-3dd1-4f59-9ac8-bbcc7f230842 tempest-ServicesAdminNegativeTestJSON-1881971186 tempest-ServicesAdminNegativeTestJSON-1881971186-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.872476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8217c6b4-3dd1-4f59-9ac8-bbcc7f230842 tempest-ServicesAdminNegativeTestJSON-1881971186 tempest-ServicesAdminNegativeTestJSON-1881971186-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '856bf4d3cc8f453bbbbc6ce557966f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d7b50625c04efe94870f344d8c0ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8217c6b4-3dd1-4f59-9ac8-bbcc7f230842 tempest-ServicesAdminNegativeTestJSON-1881971186 tempest-ServicesAdminNegativeTestJSON-1881971186-project] Request method failure captured: Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoyYKduTijj8GOynKE4fC0IEPXZqx-tj1jEo2DS2e3azUaKA-tGybK4e3aMV8ygKun6nF6rp_ZqGgjLGbPHxP8drstPMky4Yz8iZvoCGJPVRILyjf9ntW_WbCZqYci5Z6SZ2ImZBkGdpkETRv-Hy7hup-SUP3dF4Ly4IQQYi5DrwM0 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 21d7b50625c04efe94870f344d8c0ac5 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1881971186 Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:29.874897 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21d7b50625c04efe94870f344d8c0ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21d7b50625c04efe94870f344d8c0ac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21d7b50625c04efe94870f344d8c0ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21d7b50625c04efe94870f344d8c0ac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1881971186 Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 21d7b50625c04efe94870f344d8c0ac5 Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1881971186 Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServicesAdminNegativeTestJSON-1881971186-project Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 856bf4d3cc8f453bbbbc6ce557966f9e Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1881971186-project Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:38:29.876286 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:29.877066 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:38:29.878356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:29.880732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8217c6b4-3dd1-4f59-9ac8-bbcc7f230842 tempest-ServicesAdminNegativeTestJSON-1881971186 tempest-ServicesAdminNegativeTestJSON-1881971186-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:29.881797 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8217c6b4-3dd1-4f59-9ac8-bbcc7f230842 tempest-ServicesAdminNegativeTestJSON-1881971186 tempest-ServicesAdminNegativeTestJSON-1881971186-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.394664 Sep 23 03:38:29.885711 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 95/171] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:29.900776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:29.908542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:29.930319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.932540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.933151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:29.936441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:29.940151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:29.941512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.017883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.018735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.019377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.020047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lazy-loading 'fault' on Instance uuid 4535d919-472e-488a-ae73-8149032868ca {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:38:30.178247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:30.189494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccd00771-fe39-4ef9-b44e-226a60d60a6f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 200 len: 1330 microversion: 2.1 time: 0.302178 Sep 23 03:38:30.191513 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 96/172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 1330 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:30.200530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:30.204432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:30.220835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.225544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.226301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.229057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.231332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.232020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.271149 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-625dbae4-61e8-43ad-ab62-895fedabcbe8 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1638 microversion: 2.1 time: 0.817798 Sep 23 03:38:30.285460 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 77/173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:29 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1638 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:30.285460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4535d919-472e-488a-ae73-8149032868ca", "name": "network-vif-deleted", "tag": "11dd0c0b-bd1e-439d-a4cd-e08ae42e4219"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:30.303118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.304410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.305861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.340305 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] Creating event network-vif-deleted:11dd0c0b-bd1e-439d-a4cd-e08ae42e4219 for instance 4535d919-472e-488a-ae73-8149032868ca on n-h1-858495-2 Sep 23 03:38:30.356065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4efba1fb-b828-41f4-bbc1-7b57fa57f1f2 req-17f6f0df-4840-4c8b-b112-6606d39316a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081856 Sep 23 03:38:30.361780 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 78/174] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:30.398145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:30.401315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:30.438611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.442844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.443333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.445726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.446407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.447718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.813557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:30.822569 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-26b34474-dffa-4a5f-8fc6-7f8be648f44a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.628952 Sep 23 03:38:30.825633 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 97/175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:30 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:30.835953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:30.837176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:30.855144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.857494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.857959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.858682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:30.859150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:30.859570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:30.890233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:30.898624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a111972-069e-4b85-9e65-8607e1176beb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.528380 Sep 23 03:38:30.906745 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 79/176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:30 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:30.930759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:38:31.167308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-117f8b3f-6b8b-464e-97bc-8d269952ccb6 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 204 len: 0 microversion: 2.1 time: 0.340139 Sep 23 03:38:31.168212 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 98/177] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:38:30 2022] DELETE /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:38:31.176538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:31.177151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:31.183552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:31.184247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:31.184826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:31.185883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:31.186495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:31.187072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:31.219631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:31.220713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:31.229132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:31.232472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:31.233093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:31.234028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:31.236454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:31.237069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:31.273283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca HTTP/1.1 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:31.284764 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:38:31.286190 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '4535d919-472e-488a-ae73-8149032868ca'} Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:31.286917 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:38:31.288051 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:31.289910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:31.290906 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ae098d2-c9fe-4e3c-9cf4-5674c0a95e87 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 404 len: 111 microversion: 2.1 time: 0.075764 Sep 23 03:38:31.291649 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 99/178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:31 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:38:31.463482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1382317337", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:31.554735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:38:31.982917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:31.997821 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-395a42b1-c245-4fd6-9c8f-9ce32abfcdd4 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1493 microversion: 2.1 time: 0.825161 Sep 23 03:38:32.004774 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 80/179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:31 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1493 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:32.012034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:32.012873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:32.019850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.020344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.020830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.021686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.022797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.023349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.262905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:38:32.263405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:38:32.264183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:38:32.264815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:38:32.265939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:38:32.281045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.283066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.283765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.284735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.285422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.286272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.311069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Getting quotas for project 23102e21f8ad459d961a1ab32beaa312. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:38:32.316124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Getting quotas for user 5d039b881c2b448d955103ba005f3b97 and project 23102e21f8ad459d961a1ab32beaa312. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:38:32.336809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:38:32.340069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:38:32.356911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:32.368177 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec0cc169-7dc9-4867-bfff-3fe4e3f2450a tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.357872 Sep 23 03:38:32.369233 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 81/180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:32 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:32.441237 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-540615a6-da06-4e92-8106-d8b01209f67a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982040 Sep 23 03:38:32.442626 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 100/181] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:38:32.449205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:32.450169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:32.470943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.471987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.472576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.473637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.474244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.475910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.537146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:32.595481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.596228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.597919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.620171 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] Creating event network-changed:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h2-858495-2 Sep 23 03:38:32.626584 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a09fe921-9ed9-458d-be4e-720985040b08 req-74340600-b7d7-44e8-b646-cf35693339b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255824 Sep 23 03:38:32.627910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 82/182] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:32.633819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6035db-8278-4bf6-89e6-04dbb50f9bec", "tag": "e1bab091-be7c-4397-a1ea-518ef7a1ab2f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:32.645236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:32.650323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:32.651106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:32.667880 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] Creating event network-changed:e1bab091-be7c-4397-a1ea-518ef7a1ab2f for instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec on n-h2-858495-2 Sep 23 03:38:32.675121 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e8814ff5-4799-474e-8338-76125f87f6c5 req-29131cf0-4afc-48b7-8485-d84d7ac6057b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045583 Sep 23 03:38:32.676344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 83/183] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:32.683881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9be632b0-cc95-49e5-9ffb-cd10d38db7d5 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:32.686226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9be632b0-cc95-49e5-9ffb-cd10d38db7d5 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:32.811340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9be632b0-cc95-49e5-9ffb-cd10d38db7d5 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:32.820066 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9be632b0-cc95-49e5-9ffb-cd10d38db7d5 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1220 microversion: 2.1 time: 0.141888 Sep 23 03:38:32.822348 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 84/184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:32 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:32.966072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:32.980444 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f940b4c-dace-46e8-acdc-9438dc8c8136 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.531348 Sep 23 03:38:32.981261 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 101/185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:32 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:33.025637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:33.026260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:33.041082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.041791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.045174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:33.045174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.045174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.045174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:33.392220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:33.392825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:33.406294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.408753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.409410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:33.410307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.413708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.414352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:33.555077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:33.566360 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-506dc16c-cbe1-4212-9834-349fa7ada86c tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1493 microversion: 2.1 time: 0.545128 Sep 23 03:38:33.566994 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 85/186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:33 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1493 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:33.870455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:33.872656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:33.929737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.930306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.930770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:33.936685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:33.937201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:33.937696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.026155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:34.049317 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49a08c37-09dd-4ffd-84a9-71db46461976 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.660479 Sep 23 03:38:34.062967 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 102/187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:33 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:34.092653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:34.093288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:34.114255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:34.117769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:34.118512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.119423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:34.122058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:34.122801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.246674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:34.316306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:34.328352 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0fbd5ee8-21d7-4471-b0a4-2cb6b177168b tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1294 microversion: 2.1 time: 0.485986 Sep 23 03:38:34.333061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 86/188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:33 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1294 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:34.591118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:34.591904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:34.603462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:34.608824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:34.609524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.610527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:34.611752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:34.613099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.701215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:34.702244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:34.705694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:34.706362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lazy-loading 'fault' on Instance uuid af737615-a68c-46ef-8d01-6951b0b91115 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:38:35.073478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:35.100504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-800cc36c-ff1e-4e3b-88cb-c07f628e8172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 1.025433 Sep 23 03:38:35.101290 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 103/189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:34 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:35.112970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af737615-a68c-46ef-8d01-6951b0b91115", "name": "network-vif-deleted", "tag": "2333ac35-2553-494c-bab6-b4b05ab5bcb3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:35.151188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:35.151955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:35.162016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:35.211588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] Creating event network-vif-deleted:2333ac35-2553-494c-bab6-b4b05ab5bcb3 for instance af737615-a68c-46ef-8d01-6951b0b91115 on n-h1-858495-2 Sep 23 03:38:35.228551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-71858831-5b48-45ae-abd7-959c3e3e235f req-272c8351-4ef2-4457-9d01-d04d259f736b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122642 Sep 23 03:38:35.233295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 104/190] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:35.262366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:35.268894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:35.285849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:35.286117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23536c40f5b748d899efc0d94673ecaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2228ce9e638f4e829c8e5ee252994f4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:35.287965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:35.289937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:35.290870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:35.293934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:35.294565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:35.301133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d1029ae5-baa7-48aa-b0ff-b24c5bc1ca31 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 200 len: 1328 microversion: 2.1 time: 0.714436 Sep 23 03:38:35.319996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 87/191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:34 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 1328 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:35.364262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:35.367595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:35.383438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:35.383904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:35.384401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:35.385711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:35.388547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:35.391918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:35.620987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:35.635725 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a2e4337-604f-495f-a59e-6c9a674d00fc tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1300 microversion: 2.1 time: 0.280797 Sep 23 03:38:35.636567 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 88/192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:35 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1300 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:36.124167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:36.124798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:36.134340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.136941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.138076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.140143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.141211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.143498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.359932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:36.372062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a938d62-5df0-4b23-9dfe-05c6a55bfc80 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 1.136624 Sep 23 03:38:36.375337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 105/193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:35 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:36.387288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:36.389327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:36.409200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.409906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.411618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.414299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.414954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.417427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.478142 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] HTTP exception thrown: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Request method failure captured: Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 HTTP/1.1 Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoOqV3rPfL-1SsbOvFFn2BFT3JCdaP1ZhqWHknVFnkTSGN1gXatiu7WOHzOngPE8AcOLmvc_IWV-0zc4jDfhNkGobQt8dKW8SsZvOf5vExAk9ZEJDfiYS_DrYPi9B3j3t6RzAuVemQ53sxUZkUPwM2dw-KQxiNHUJjJSi6FFics_vQ Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:36.481191 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 23536c40f5b748d899efc0d94673ecaf Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:36.482489 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'af737615-a68c-46ef-8d01-6951b0b91115'} Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:36.483172 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:36.484276 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:36.488036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Returning 404 to user: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:36.492345 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0542d372-0548-4b4f-bdaf-45da21a721db tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 404 len: 111 microversion: 2.1 time: 0.115110 Sep 23 03:38:36.495192 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 106/194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:36 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:36.512351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07f37cb7-d7b9-4eca-94ea-bbafa610dc68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:36.546286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f37cb7-d7b9-4eca-94ea-bbafa610dc68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.548689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f37cb7-d7b9-4eca-94ea-bbafa610dc68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.559499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f37cb7-d7b9-4eca-94ea-bbafa610dc68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.595186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:36.609657 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e84a6f2-e2e4-428e-bee2-cc623a7d063a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.487421 Sep 23 03:38:36.629338 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 89/195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:36 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:36.661025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:36.661909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:36.671641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:36.674003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.675832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.676497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.677905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:36.680321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:36.687001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:36.897166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:36.914472 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ca637ae-051c-487d-b7fe-387ab73732b7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1300 microversion: 2.1 time: 0.254949 Sep 23 03:38:36.916260 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 90/196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:36 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:37.255039 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07f37cb7-d7b9-4eca-94ea-bbafa610dc68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.751023 Sep 23 03:38:37.256596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 107/197] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:37.267274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-accdaeb7-1e66-4ae1-8661-71dcae1a40c0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:37.353817 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-accdaeb7-1e66-4ae1-8661-71dcae1a40c0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.086420 Sep 23 03:38:37.356114 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 91/198] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:37 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:37.380986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-32d7eff8-1b9d-4ea2-adf9-dd11d696ed6c tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541066875"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:37.384694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-32d7eff8-1b9d-4ea2-adf9-dd11d696ed6c tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 51cc7207-0f43-4ac3-9b7f-3fe7cbb7e305 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:37.401776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:37.404178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:37.429774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-32d7eff8-1b9d-4ea2-adf9-dd11d696ed6c tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050183 Sep 23 03:38:37.430685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 108/199] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:37.437571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.437571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.437571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.437571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.437906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.437906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.444767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-74db1010-f73a-4981-be7e-28ac57a6cf54 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:37.485687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74db1010-f73a-4981-be7e-28ac57a6cf54 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.486190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74db1010-f73a-4981-be7e-28ac57a6cf54 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.486644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74db1010-f73a-4981-be7e-28ac57a6cf54 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.656025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:37.671152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0170736b-ecb2-4ff5-bf5f-fe107623e7da tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.269969 Sep 23 03:38:37.685793 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 92/200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:37 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:37.695196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:37.696077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:37.707214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.707642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.708077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.708796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.709286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.710259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.805792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-74db1010-f73a-4981-be7e-28ac57a6cf54 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.366695 Sep 23 03:38:37.806398 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 109/201] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:37.824513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b36bef28-513a-4805-8aee-2dab61554e68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:37.838153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b36bef28-513a-4805-8aee-2dab61554e68 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.018224 Sep 23 03:38:37.838762 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 110/202] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:38:37 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:37.856264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0c40e7d-080a-44c0-b5cc-9da1954e2c10 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:37.872374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:37.883194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0c40e7d-080a-44c0-b5cc-9da1954e2c10 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:37.883693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0c40e7d-080a-44c0-b5cc-9da1954e2c10 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:37.884132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0c40e7d-080a-44c0-b5cc-9da1954e2c10 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:37.950555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:37.971765 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-15320845-1e06-4816-ac97-3bcdbf9d7a82 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.284751 Sep 23 03:38:37.991598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 93/203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:37 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:38.005698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.009440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:38.021333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.022695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.023343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:38.024255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.025018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.025971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:38.037793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:38.141816 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0c40e7d-080a-44c0-b5cc-9da1954e2c10 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.291172 Sep 23 03:38:38.143024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 111/204] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:38.362929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:38.367408 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69f785ed-cb2f-4a8f-a35c-82033fce2707 tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-22T03%3A38%3A38.120137&end=2022-09-24T03%3A38%3A38.120137" status: 404 len: 112 microversion: - time: 0.221363 Sep 23 03:38:38.376329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 112/205] 10.222.0.25 () {58 vars in 1316 bytes} [Fri Sep 23 03:38:38 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-22T03%3A38%3A38.120137&end=2022-09-24T03%3A38%3A38.120137 => generated 112 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 03:38:38.387537 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-870b24ce-970e-494b-ae40-6e3b6ec8ce81 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.394604 Sep 23 03:38:38.389275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a257b13e-e4f3-4169-aae2-50757343cc96 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.389737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 94/206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:37 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:38.397326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf1362ba-395e-49ff-a1f4-bdd468db93ba tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] Calling method '.version_select at 0x7f0c8be9d670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.413798 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bf1362ba-395e-49ff-a1f4-bdd468db93ba tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf1362ba-395e-49ff-a1f4-bdd468db93ba tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] Request method failure captured: Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-simple-tenant-usage/4cd3b6c0315f424f9a4f0f0dbeec3663?start=2022-09-24T03%3A38%3A38.120137&end=2022-09-22T03%3A38%3A38.120137 HTTP/1.1 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSo9oup4lo-qodgEzFkIKQ0MG2M2wMDihmbkyCEi-fWTc00eJRq63h4xSPayXIE3md9bNlDtXNChHl5Mw24w_V2szmqy5ZdEYhpjTPEtyxbjDm8nmFY4UzFcn08OiUVF_s8yX3bkd5qWC41T5LhTrSEVZgp1BJHg3LqjEsc79DlmbZI Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 344e9bddb0b94a47a04aaf6ac56ccd08 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1616890109 Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:38.418136 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/344e9bddb0b94a47a04aaf6ac56ccd08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/344e9bddb0b94a47a04aaf6ac56ccd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/344e9bddb0b94a47a04aaf6ac56ccd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_344e9bddb0b94a47a04aaf6ac56ccd08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1616890109 Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 344e9bddb0b94a47a04aaf6ac56ccd08 Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1616890109 Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 3e48ad8358d6479fb7a8fcc579569d1a Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid start time. The start time cannot occur after the end time. Sep 23 03:38:38.419326 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4cd3b6c0315f424f9a4f0f0dbeec3663'} Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 03:38:38.419980 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 23 03:38:38.421049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.423702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf1362ba-395e-49ff-a1f4-bdd468db93ba tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:38.426111 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf1362ba-395e-49ff-a1f4-bdd468db93ba tempest-TenantUsagesNegativeTestJSON-1616890109 tempest-TenantUsagesNegativeTestJSON-1616890109-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/4cd3b6c0315f424f9a4f0f0dbeec3663?start=2022-09-24T03%3A38%3A38.120137&end=2022-09-22T03%3A38%3A38.120137" status: 400 len: 111 microversion: 2.1 time: 0.034225 Sep 23 03:38:38.427085 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 95/207] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Sep 23 03:38:38 2022] GET /compute/v2.1/os-simple-tenant-usage/4cd3b6c0315f424f9a4f0f0dbeec3663?start=2022-09-24T03%3A38%3A38.120137&end=2022-09-22T03%3A38%3A38.120137 => generated 111 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:38:38.441481 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a257b13e-e4f3-4169-aae2-50757343cc96 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.061102 Sep 23 03:38:38.443519 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 113/208] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:38 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:38.470676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2a4b63d-5ec7-4526-8cf6-c4fa9d6e36d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29895366"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:38.486121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-e2a4b63d-5ec7-4526-8cf6-c4fa9d6e36d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 108a675e-9581-4a25-ac9d-517463f1d9af for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:38.539299 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2a4b63d-5ec7-4526-8cf6-c4fa9d6e36d9 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.081128 Sep 23 03:38:38.541174 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 114/209] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:38 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:38.552729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d79d0e42-ec9c-4ef7-ac3c-760576825bdc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:38.583265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d79d0e42-ec9c-4ef7-ac3c-760576825bdc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.584079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d79d0e42-ec9c-4ef7-ac3c-760576825bdc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.587541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d79d0e42-ec9c-4ef7-ac3c-760576825bdc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:38.700374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80690b43-b617-47a4-91b0-ede7be49f0c5 tempest-TenantUsagesNegativeTestJSON-638269900 tempest-TenantUsagesNegativeTestJSON-638269900-project] Calling method '.version_select at 0x7f0c8be39ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.706425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80690b43-b617-47a4-91b0-ede7be49f0c5 tempest-TenantUsagesNegativeTestJSON-638269900 tempest-TenantUsagesNegativeTestJSON-638269900-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '724eb7f7d74649a18e993a6d53889bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd3b6c0315f424f9a4f0f0dbeec3663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80690b43-b617-47a4-91b0-ede7be49f0c5 tempest-TenantUsagesNegativeTestJSON-638269900 tempest-TenantUsagesNegativeTestJSON-638269900-project] Request method failure captured: Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T03%3A38%3A38.120137&end=2022-09-24T03%3A38%3A38.120137&detailed=1 HTTP/1.1 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSo8u5HFPJDposb_tJ480gTcM240vRie2mvEUj8_qDH_7b8U7RTkLnPMOfQ1B5f9CoionVvlbncq3G3FrtcRAhvsGcGq0F4uExVfYBTpfFbFDyq5dI0hSVf8ubOth049RHqk7jsg40L4v7cq1BQ9K76wLg0AQuMCqW2pJlrsuo4dqpA Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4cd3b6c0315f424f9a4f0f0dbeec3663 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-638269900 Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:38:38.711158 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd3b6c0315f424f9a4f0f0dbeec3663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd3b6c0315f424f9a4f0f0dbeec3663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd3b6c0315f424f9a4f0f0dbeec3663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd3b6c0315f424f9a4f0f0dbeec3663"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-638269900 Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4cd3b6c0315f424f9a4f0f0dbeec3663 Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-638269900 Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TenantUsagesNegativeTestJSON-638269900-project Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 724eb7f7d74649a18e993a6d53889bc7 Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-638269900-project Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: action_args: {} Sep 23 03:38:38.712743 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:38.713735 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:38.715451 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:38.716876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 03:38:38.716876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:38.725890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80690b43-b617-47a4-91b0-ede7be49f0c5 tempest-TenantUsagesNegativeTestJSON-638269900 tempest-TenantUsagesNegativeTestJSON-638269900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:38.727793 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-80690b43-b617-47a4-91b0-ede7be49f0c5 tempest-TenantUsagesNegativeTestJSON-638269900 tempest-TenantUsagesNegativeTestJSON-638269900-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T03%3A38%3A38.120137&end=2022-09-24T03%3A38%3A38.120137&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.292275 Sep 23 03:38:38.729322 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 96/210] 10.222.0.25 () {58 vars in 1335 bytes} [Fri Sep 23 03:38:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T03%3A38%3A38.120137&end=2022-09-24T03%3A38%3A38.120137&detailed=1 => generated 123 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:38.736519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.737400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:38.752616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.753123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.753617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:38.754482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.755011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.755624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:38.849503 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d79d0e42-ec9c-4ef7-ac3c-760576825bdc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 240 microversion: 2.1 time: 0.301339 Sep 23 03:38:38.851727 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 115/211] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 240 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:38.862927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-555bfaff-351d-48fa-ba40-03f9b9b47e18 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:38.881648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-555bfaff-351d-48fa-ba40-03f9b9b47e18 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.021191 Sep 23 03:38:38.890354 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 116/212] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:38:38 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:38.895845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a89e0ad8-8302-41ff-b98b-d248a870648e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:38.910867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89e0ad8-8302-41ff-b98b-d248a870648e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:38.911610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89e0ad8-8302-41ff-b98b-d248a870648e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:38.912414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89e0ad8-8302-41ff-b98b-d248a870648e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.141490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a89e0ad8-8302-41ff-b98b-d248a870648e tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.249738 Sep 23 03:38:39.144959 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 117/213] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:39.152324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:39.153384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:39.173983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:39.174840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:39.175510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.177208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:39.177607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:39.178249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.396515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:39.406947 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa0cab47-1f5c-460f-88db-f0b2f4e431b2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.675408 Sep 23 03:38:39.410058 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 97/214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:38 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:39.417909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2ce30ca-8f36-4c75-b06c-5395048c71bc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:39.473044 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2ce30ca-8f36-4c75-b06c-5395048c71bc tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.058822 Sep 23 03:38:39.473790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 98/215] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:39 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:39.482914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:39.484951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:39.501159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:39.502334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:39.504835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:39.505976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.508697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:39.510927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:39.511385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.512612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90efbb0e-00cf-4385-9355-618313caeef5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.366274 Sep 23 03:38:39.515419 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 118/216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:39 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:39.523811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3db17b47-82ad-4f90-9e64-ebaab15197d6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-918796990"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:39.536545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-3db17b47-82ad-4f90-9e64-ebaab15197d6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid fbcf942c-eb04-46e8-81bf-64d9f644d08d for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:39.576607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3db17b47-82ad-4f90-9e64-ebaab15197d6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059423 Sep 23 03:38:39.577930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 119/217] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:39.589513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e63d36d2-bb1c-4d7b-91ad-2bac4e38ce06 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:39.619617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e63d36d2-bb1c-4d7b-91ad-2bac4e38ce06 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:39.620118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e63d36d2-bb1c-4d7b-91ad-2bac4e38ce06 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:39.620562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e63d36d2-bb1c-4d7b-91ad-2bac4e38ce06 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:39.778399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e63d36d2-bb1c-4d7b-91ad-2bac4e38ce06 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.191292 Sep 23 03:38:39.781487 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 120/218] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:39.796804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4712b352-8ac6-42b9-95a2-36d9ba84c9b7 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:40.009474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:40.024552 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-277149d9-fa43-4c09-935f-66309743e4da tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.548044 Sep 23 03:38:40.027582 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 99/219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:39 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:40.060482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4712b352-8ac6-42b9-95a2-36d9ba84c9b7 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.060988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4712b352-8ac6-42b9-95a2-36d9ba84c9b7 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.061471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4712b352-8ac6-42b9-95a2-36d9ba84c9b7 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:40.304079 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4712b352-8ac6-42b9-95a2-36d9ba84c9b7 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.515761 Sep 23 03:38:40.307575 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 121/220] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:40.318806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb6d353b-91e6-4ab0-a4e4-750163e87a82 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:40.382053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb6d353b-91e6-4ab0-a4e4-750163e87a82 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.066921 Sep 23 03:38:40.383583 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 100/221] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:40 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:40.393153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4f33205-faa9-4002-84fa-20358b0e8a72 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1574054156"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:40.398852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-b4f33205-faa9-4002-84fa-20358b0e8a72 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 1b0251d5-871a-48ac-a36e-7f47b248fb9f for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:40.432761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-476f11c4-5f9e-45d1-be54-e147388c764e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-636948963"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:40.436566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.aggregate [None req-476f11c4-5f9e-45d1-be54-e147388c764e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 64aa6a5e-fc6b-4361-8def-7db9c3c36036 for aggregate {{(pid=128723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:40.475938 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4f33205-faa9-4002-84fa-20358b0e8a72 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085876 Sep 23 03:38:40.478553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 122/222] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:40.490106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:40.490788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:40.506450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.507050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.508700 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-476f11c4-5f9e-45d1-be54-e147388c764e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.079727 Sep 23 03:38:40.509934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 101/223] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:40.511994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:40.512848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.514730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.515179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:40.519295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d6b4acf-84a4-4051-91dd-9c72294785a6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:40.570958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0d6b4acf-84a4-4051-91dd-9c72294785a6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059043 Sep 23 03:38:40.571587 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 102/224] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:40 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:40.598698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9313ed2e-6524-4c89-8f37-ade175ad7661 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:40.626002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9313ed2e-6524-4c89-8f37-ade175ad7661 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.628704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9313ed2e-6524-4c89-8f37-ade175ad7661 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.630398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9313ed2e-6524-4c89-8f37-ade175ad7661 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:40.926579 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9313ed2e-6524-4c89-8f37-ade175ad7661 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.349911 Sep 23 03:38:40.927860 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 103/225] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:40 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:40.932898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:40.934459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:40.953575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.954329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.954909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:40.955781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:40.956489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:40.957077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.186639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:41.199926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f4e35bc9-5403-4c1d-84e3-d9d8d9e15abc tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.719076 Sep 23 03:38:41.201525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 123/226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:40 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:41.212500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-737d68b5-87f3-4903-b314-a435aa801c07 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:41.228342 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-737d68b5-87f3-4903-b314-a435aa801c07 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-737d68b5-87f3-4903-b314-a435aa801c07 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Request method failure captured: Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQKeUNyyKCgjGMhQvJ6Uk3qXIaN4MsDO0wmEsx-VrksrWMashbOU1CV4Bqd3I6FyY0zvn_t3GlgDKDlsPJFd6EmoMxHs2AQeojbB3_WcYgBSe7ywqsMbymoalERM-ufvNvfdxmounv8RAu3T08ou8FvTSHQRxaC3Tz6vernCP50h0 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:41.234861 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d0d3b98905574760b9b3bab707d84d91 Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate 5 could not be found. Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '5'} Sep 23 03:38:41.236088 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.236799 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 23 03:38:41.237838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.242121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-737d68b5-87f3-4903-b314-a435aa801c07 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:41.243818 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-737d68b5-87f3-4903-b314-a435aa801c07 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041095 Sep 23 03:38:41.245188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 124/227] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:38:41 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:41.251250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:41.286021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:41.286547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:41.287012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.305575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:41.340276 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d212e0b-495b-43e6-a569-0957ee844974 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.408386 Sep 23 03:38:41.341442 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 104/228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:40 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:41.348195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:41.351277 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-858495-2. Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 39 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:41.355368 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: {"add_host": {"host": "n-h1-858495-2"}} Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:41.356609 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate 6 already has host n-h1-858495-2. Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-858495-2'}}} Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:38:41.357487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858495-2-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 03:38:41.358481 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 03:38:41.360259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:38:41.361197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858495-2-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 3, 38, 41, 335407), 'updated_at': None, 'host': 'n-h1-858495-2', 'aggregate_id': 6}] Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.362168 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-858495-2. Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.364204 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-858495-2. Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:41.368159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:41.371825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-858495-2. Sep 23 03:38:41.371825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.371825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-858495-2. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:41.371825 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22e52338-fc1a-48ab-8580-a57ea1c85d18 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.113634 Sep 23 03:38:41.371825 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 125/229] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:41 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 23 03:38:41.374114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9f5cfe9-cdf9-47de-8fa5-4b16e29c6ef3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:41.378160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:41.405045 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a9f5cfe9-cdf9-47de-8fa5-4b16e29c6ef3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9f5cfe9-cdf9-47de-8fa5-4b16e29c6ef3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Request method failure captured: Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQKeUNyyKCgjGMhQvJ6Uk3qXIaN4MsDO0wmEsx-VrksrWMashbOU1CV4Bqd3I6FyY0zvn_t3GlgDKDlsPJFd6EmoMxHs2AQeojbB3_WcYgBSe7ywqsMbymoalERM-ufvNvfdxmounv8RAu3T08ou8FvTSHQRxaC3Tz6vernCP50h0 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:41.406776 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d0d3b98905574760b9b3bab707d84d91 Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate 5 could not be found. Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '5'} Sep 23 03:38:41.408292 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:41.409194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:41.410533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9f5cfe9-cdf9-47de-8fa5-4b16e29c6ef3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:41.413329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9f5cfe9-cdf9-47de-8fa5-4b16e29c6ef3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.046909 Sep 23 03:38:41.414153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:41.414284 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 126/230] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:41 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:41.418385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:41.418990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.419769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:41.420253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:41.420696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.423740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f423eba-9312-4b6b-be00-adf42c711fb1 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:41.454986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f423eba-9312-4b6b-be00-adf42c711fb1 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:41.455381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f423eba-9312-4b6b-be00-adf42c711fb1 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:41.456020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f423eba-9312-4b6b-be00-adf42c711fb1 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.728576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f423eba-9312-4b6b-be00-adf42c711fb1 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.303463 Sep 23 03:38:41.740035 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 127/231] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:41 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:41.748453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b2c4d36-2fa0-4bc5-8d5f-6f021a1b2c7d tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-219978218", "name": "tempest-test_aggregate-2057290709"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:41.797210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-9b2c4d36-2fa0-4bc5-8d5f-6f021a1b2c7d tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid e19010a0-0626-4c3c-b3f2-840f19a754fa for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:41.853186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b2c4d36-2fa0-4bc5-8d5f-6f021a1b2c7d tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.111371 Sep 23 03:38:41.854049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 128/232] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Sep 23 03:38:41 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:41.865003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10861b0-d066-4ae7-9fd0-7472797e0495", "tag": "865432a0-4f21-4df9-93e6-41b9dc22b324"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:41.890241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:41.891100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:41.891908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:41.917905 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] Creating event network-changed:865432a0-4f21-4df9-93e6-41b9dc22b324 for instance f10861b0-d066-4ae7-9fd0-7472797e0495 on n-h1-858495-2 Sep 23 03:38:41.935657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-bedf1bf3-2be3-4b96-a1c0-15dc02e4c7d5 req-c0cc0c2c-b143-433a-849a-9de8c9975903 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071130 Sep 23 03:38:41.935657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 129/233] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:41.950685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-558aaa11-4fca-4157-b787-d54c6c5bb7e9 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.003827 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-558aaa11-4fca-4157-b787-d54c6c5bb7e9 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.069089 Sep 23 03:38:42.006118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 130/234] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:41 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:42.028900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47f4fadf-e5f1-4e3f-8c27-2c8137d93350 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.072913 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47f4fadf-e5f1-4e3f-8c27-2c8137d93350 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.065316 Sep 23 03:38:42.074993 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 131/235] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:42.082384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66a3466e-c9dd-4232-bf29-c7662b6c866b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1553585912"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:42.090579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-66a3466e-c9dd-4232-bf29-c7662b6c866b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid c39e28fd-5fb4-4b03-84f8-773a081a7d0f for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:42.095322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:42.109980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d9264939-f0d9-4f50-8456-1518e2a68b5f tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.764357 Sep 23 03:38:42.111047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 105/236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:41 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:42.116023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:42.124862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2ed6749-7058-4077-84dc-ddc8b75108c6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.148736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c2ed6749-7058-4077-84dc-ddc8b75108c6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2ed6749-7058-4077-84dc-ddc8b75108c6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Request method failure captured: Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoQKeUNyyKCgjGMhQvJ6Uk3qXIaN4MsDO0wmEsx-VrksrWMashbOU1CV4Bqd3I6FyY0zvn_t3GlgDKDlsPJFd6EmoMxHs2AQeojbB3_WcYgBSe7ywqsMbymoalERM-ufvNvfdxmounv8RAu3T08ou8FvTSHQRxaC3Tz6vernCP50h0 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:42.167018 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d0d3b98905574760b9b3bab707d84d91 Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: exception: Aggregate 7 could not be found. Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7'} Sep 23 03:38:42.168524 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.169397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 23 03:38:42.170649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.173643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2ed6749-7058-4077-84dc-ddc8b75108c6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:42.176330 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c2ed6749-7058-4077-84dc-ddc8b75108c6 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.063246 Sep 23 03:38:42.177989 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66a3466e-c9dd-4232-bf29-c7662b6c866b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101662 Sep 23 03:38:42.179684 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 106/237] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:38:42 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:42.186020 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 132/238] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:42.197210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45f2aca0-b12f-405c-8f6d-a70683c3e354 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.233715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-45f2aca0-b12f-405c-8f6d-a70683c3e354 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45f2aca0-b12f-405c-8f6d-a70683c3e354 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Request method failure captured: Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoQKeUNyyKCgjGMhQvJ6Uk3qXIaN4MsDO0wmEsx-VrksrWMashbOU1CV4Bqd3I6FyY0zvn_t3GlgDKDlsPJFd6EmoMxHs2AQeojbB3_WcYgBSe7ywqsMbymoalERM-ufvNvfdxmounv8RAu3T08ou8FvTSHQRxaC3Tz6vernCP50h0 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:42.237557 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ee1ef690d0049da9b9790b2cfbefb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ee1ef690d0049da9b9790b2cfbefb40 Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-575702303 Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d0d3b98905574760b9b3bab707d84d91 Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AggregatesAdminTestJSON-575702303-project-admin Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: exception: Aggregate 7 could not be found. Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7'} Sep 23 03:38:42.238724 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:42.239410 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.240452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.241603 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.241603 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:42.241603 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:42.241603 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 23 03:38:42.241603 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.244299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45f2aca0-b12f-405c-8f6d-a70683c3e354 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:42.246339 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45f2aca0-b12f-405c-8f6d-a70683c3e354 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.062399 Sep 23 03:38:42.253068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 107/239] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:42.260193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.271554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:42.288973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:42.292439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:42.293137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:42.295820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:42.300848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=18 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:42.303962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:42.304685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:42.329339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:42.671729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf49b800-7dd2-44cc-9944-cd7f46c8e4e1 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:42.675928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bf49b800-7dd2-44cc-9944-cd7f46c8e4e1 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf49b800-7dd2-44cc-9944-cd7f46c8e4e1 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 39 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:42.684776 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: {"add_host": {"host": "n-h1-858495-2"}} Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:42.686053 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-858495-2'}}} Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:42.686778 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 03:38:42.688900 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:42.690230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf49b800-7dd2-44cc-9944-cd7f46c8e4e1 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:42.690230 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf49b800-7dd2-44cc-9944-cd7f46c8e4e1 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.491400 Sep 23 03:38:42.690230 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 133/240] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:42 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 494 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:42.704729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ac0b93b3-47ae-47bb-b663-08fb5f58a4c3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1140411828"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:42.714678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-ac0b93b3-47ae-47bb-b663-08fb5f58a4c3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 431ac5a1-bf9d-480a-9b3a-1ecafc174161 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:42.767236 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ac0b93b3-47ae-47bb-b663-08fb5f58a4c3 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078774 Sep 23 03:38:42.767981 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 134/241] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:42.780784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:42.781850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:42.797800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:42.798308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:42.801141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:42.804757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:42.805252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:42.805731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:42.817495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:42.898995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:42.930279 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49168699-6860-4211-9d32-e054de721729 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.675166 Sep 23 03:38:42.931246 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 108/242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:42 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:42.952570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf7d52de-d0d0-48dd-afc8-b1652fcbd23b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.006145 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf7d52de-d0d0-48dd-afc8-b1652fcbd23b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.073243 Sep 23 03:38:43.011609 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 109/243] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:42 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:43.034224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ed0656aa-995e-4bfd-8cff-beb8dc60bf16 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.047256 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ed0656aa-995e-4bfd-8cff-beb8dc60bf16 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.034033 Sep 23 03:38:43.048246 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 110/244] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:38:43 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:43.056719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b820c086-4805-4f0a-ad28-5da047a27aed tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-286011944"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.063859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.aggregate [None req-b820c086-4805-4f0a-ad28-5da047a27aed tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 82b58219-27c4-4c67-ac66-1103fe112d09 for aggregate {{(pid=128723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:43.123459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:43.144585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b820c086-4805-4f0a-ad28-5da047a27aed tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093576 Sep 23 03:38:43.145870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 111/245] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:43.161495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6b6944a-123c-4b43-a657-7a8e1d45a812 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.257165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6b6944a-123c-4b43-a657-7a8e1d45a812 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.084387 Sep 23 03:38:43.259324 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 112/246] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:43.276987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:43.281937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.284743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:43.292547 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5dee303-2427-47a0-9e89-69043f62fc7e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.523073 Sep 23 03:38:43.295228 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 135/247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:42 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:43.305194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-112445890"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.321118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:43.321702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:43.331908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:43.332931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:43.334217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:43.334931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:43.367068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:43.370898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:43.371498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:43.400943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:43.401838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:43.406111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:43.424911 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-112445890 could not be found. Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 57 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:43.431943 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: {"add_host": {"host": "tempest-nonexist_host-112445890"}} Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:43.433449 n-d-858495-2 devstack@n-api.service[128724]: exception: Compute host tempest-nonexist_host-112445890 could not be found. Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '10', 'body': {'add_host': {'host': 'tempest-nonexist_host-112445890'}}} Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-112445890' is not mapped to any cell Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.434156 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 23 03:38:43.435277 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-112445890 could not be found. Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-112445890 could not be found. Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.436393 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-112445890 could not be found. Sep 23 03:38:43.437480 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.442743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-112445890 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:43.450686 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab287b7c-7547-47f7-af72-a12cd6623dea tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 110 microversion: 2.1 time: 0.154047 Sep 23 03:38:43.459566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 136/248] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates/10/action => generated 110 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:43.481155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd62b5e6-1e86-44ed-aaf9-093016a5e0ab tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.530628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd62b5e6-1e86-44ed-aaf9-093016a5e0ab tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.069536 Sep 23 03:38:43.531253 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 137/249] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:38:43 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:43.542573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1cba36fd-f57d-4b2f-8a5d-05c9584b3f4d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.639392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1cba36fd-f57d-4b2f-8a5d-05c9584b3f4d tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.100406 Sep 23 03:38:43.647211 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 138/250] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:43 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:43.676483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-644a7688-4a9c-4015-9ce5-5fcf347baaa0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:43.749391 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-644a7688-4a9c-4015-9ce5-5fcf347baaa0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.093862 Sep 23 03:38:43.750011 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 139/251] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:43 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:43.773557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92fbb086-8139-4671-a62c-fbb63d1758a5 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92fbb086-8139-4671-a62c-fbb63d1758a5 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 283 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:43.799880 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.801127 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:38:43.801693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:43.802244 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.803808 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.804609 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:38:43.804609 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:38:43.804609 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:38:43.804609 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.804609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92fbb086-8139-4671-a62c-fbb63d1758a5 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:43.804958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92fbb086-8139-4671-a62c-fbb63d1758a5 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.045032 Sep 23 03:38:43.804958 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 140/252] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:38:43.816651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b96bdc22-9070-4c60-9f85-050473a37e44 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1627339278", "availability_zone": "tempest-test_az-40163102"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.830748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-b96bdc22-9070-4c60-9f85-050473a37e44 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 95aeeb60-652d-4589-aea9-0f02df067dfa for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:43.890257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b96bdc22-9070-4c60-9f85-050473a37e44 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.085955 Sep 23 03:38:43.890920 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 141/253] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:43.900216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8584998b-200f-45be-b8bb-52a9ccd1abcd tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8584998b-200f-45be-b8bb-52a9ccd1abcd tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 27 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:43.912698 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: {"aggregate": {"name": ""}} Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:43.914405 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:43.917478 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:38:43.925484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:43.930322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8584998b-200f-45be-b8bb-52a9ccd1abcd tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:43.931557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8584998b-200f-45be-b8bb-52a9ccd1abcd tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.032674 Sep 23 03:38:43.935182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 142/254] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:38:43.960680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "name": "network-vif-plugged", "status": "completed", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:43.986204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:43.987748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:43.989265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.009645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:44.032719 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f18aaff5-230b-4c52-be6e-8d7921605ade tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.769220 Sep 23 03:38:44.049569 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 113/255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:43 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:44.049848 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] Creating event network-vif-plugged:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h2-858495-2 Sep 23 03:38:44.050038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-327cca75-27c7-4274-9873-7861c854dabd tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1627339278_new", "availability_zone": "tempest-test_az-40163102_new"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.056203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b87d3261-6fdf-46a9-b737-1d43fe4d2097 req-cff7e5ab-769a-47f3-9949-15cf7cf628f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118929 Sep 23 03:38:44.056811 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 143/256] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.082908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e4988a9-ab50-4a24-b9f0-249e3ba5f8aa tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-625740042"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.114007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e4988a9-ab50-4a24-b9f0-249e3ba5f8aa tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e4988a9-ab50-4a24-b9f0-249e3ba5f8aa tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 59 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:44.127873 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: {"aggregate": {"name": "tempest-test_aggregate-625740042"}} Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:44.129169 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-625740042'}}} Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:44.129983 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:44.131008 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 03:38:44.132075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.132075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e4988a9-ab50-4a24-b9f0-249e3ba5f8aa tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:44.132251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e4988a9-ab50-4a24-b9f0-249e3ba5f8aa tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.071538 Sep 23 03:38:44.137188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 144/257] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:44 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:44.148768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.158822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:44.195114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:44.203318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:44.204436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.206758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:44.210915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:44.211643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.489924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-327cca75-27c7-4274-9873-7861c854dabd tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:44.491559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-327cca75-27c7-4274-9873-7861c854dabd tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:44.492895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-327cca75-27c7-4274-9873-7861c854dabd tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.559489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:44.570523 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2bfef8b6-f998-4bb7-9e7c-bc603968c892 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.431764 Sep 23 03:38:44.571482 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 145/258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:44 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:44.573151 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-327cca75-27c7-4274-9873-7861c854dabd tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 333 microversion: 2.1 time: 0.533471 Sep 23 03:38:44.575547 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 114/259] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 03:38:44 2022] PUT /compute/v2.1/os-aggregates/11 => generated 333 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.582606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3b922f0-7403-473d-9fda-97fd4ab3e67b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1058197335"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.586652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-e3b922f0-7403-473d-9fda-97fd4ab3e67b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid cf65d956-aee9-4de3-991a-e607fd6e01d8 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:44.587242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.593244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:44.607025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:44.607748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:44.610027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.612378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:44.616625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:44.617082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:44.629171 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3b922f0-7403-473d-9fda-97fd4ab3e67b tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056165 Sep 23 03:38:44.631270 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 146/260] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.642159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49dc5092-f469-4545-a296-3f8b3cde0433 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.655654 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49dc5092-f469-4545-a296-3f8b3cde0433 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.023149 Sep 23 03:38:44.665315 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 147/261] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:38:44 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.670693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1058197335"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.679602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 90cf9bd9-6f91-490b-8922-25233868776d for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:44.704662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1058197335 already exists. Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 60 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:44.706727 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: {"aggregate": {"name": "tempest-test_aggregate-1058197335"}} Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:44.707927 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate tempest-test_aggregate-1058197335 already exists. Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1058197335'}}} Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 23 03:38:44.708627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1058197335 already exists. Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:44.710239 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1058197335 already exists. Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1058197335 already exists. Sep 23 03:38:44.711293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:44.713529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1058197335 already exists. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:44.714622 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b9adf7e-119f-4223-bfcd-995cedf26553 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.047909 Sep 23 03:38:44.715406 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 148/262] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:44 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:44.723337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7cf99f69-0f45-401e-bbdc-a5bf764c68c0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.772803 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7cf99f69-0f45-401e-bbdc-a5bf764c68c0 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.052025 Sep 23 03:38:44.773951 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 149/263] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:44 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:44.785520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4591ded2-49d1-4aa0-9329-62c9df1d3447 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.827652 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4591ded2-49d1-4aa0-9329-62c9df1d3447 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.051594 Sep 23 03:38:44.830414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 150/264] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:44.839292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd2de27a-f150-40d3-b7c1-01001f9d9d88 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1476401710"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.844122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-bd2de27a-f150-40d3-b7c1-01001f9d9d88 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Generated uuid 2fe0d6f9-ef25-40bd-a8db-c202b9bb9b97 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:44.909861 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd2de27a-f150-40d3-b7c1-01001f9d9d88 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074710 Sep 23 03:38:44.911755 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 151/265] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.921038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37a6096f-4838-4c9a-864e-7167fb5436bc tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1630684615"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:44.923186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:44.929127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-37a6096f-4838-4c9a-864e-7167fb5436bc tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 0bf1cecb-884b-4e72-a0cc-0f178bd1636e for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:44.935236 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4afbcb9d-029d-4afe-8f17-729b2f1a10a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.354832 Sep 23 03:38:44.949283 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 115/266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:44 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:44.953101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16d6ce82-f398-4408-a793-55d9c5f40453 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:44.979560 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16d6ce82-f398-4408-a793-55d9c5f40453 tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.040362 Sep 23 03:38:44.980238 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 116/267] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:38:44 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:44.992242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ce7e158-6d19-4cd5-806a-ebd7ea003e3a tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.003424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37a6096f-4838-4c9a-864e-7167fb5436bc tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087703 Sep 23 03:38:45.006573 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 152/268] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:45.018286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33d5dab7-76de-4b83-95fd-340823e01551 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.024236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33d5dab7-76de-4b83-95fd-340823e01551 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33d5dab7-76de-4b83-95fd-340823e01551 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:45.029467 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 03:38:45.030918 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '14'} Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:45.031726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.033011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33d5dab7-76de-4b83-95fd-340823e01551 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.034089 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33d5dab7-76de-4b83-95fd-340823e01551 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.016985 Sep 23 03:38:45.034089 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 153/269] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:38:45.046025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be5fb0c6-dd05-4710-9862-fbf382917efe tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.060750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ce7e158-6d19-4cd5-806a-ebd7ea003e3a tempest-AggregatesAdminTestJSON-575702303 tempest-AggregatesAdminTestJSON-575702303-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.072153 Sep 23 03:38:45.065700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 117/270] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:44 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:45.080138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.080813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:45.109489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.112734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.113243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.114037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.117682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.118563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.119923 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be5fb0c6-dd05-4710-9862-fbf382917efe tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.079699 Sep 23 03:38:45.124899 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 154/271] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 23 03:38:45.134068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.137013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:45.152001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.152945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.153565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.154449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.159061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.159698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.186825 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] HTTP exception thrown: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Request method failure captured: Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 HTTP/1.1 Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoOqV3rPfL-1SsbOvFFn2BFT3JCdaP1ZhqWHknVFnkTSGN1gXatiu7WOHzOngPE8AcOLmvc_IWV-0zc4jDfhNkGobQt8dKW8SsZvOf5vExAk9ZEJDfiYS_DrYPi9B3j3t6RzAuVemQ53sxUZkUPwM2dw-KQxiNHUJjJSi6FFics_vQ Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:45.188728 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 23536c40f5b748d899efc0d94673ecaf Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.189954 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'af737615-a68c-46ef-8d01-6951b0b91115'} Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.190605 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.191650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.194856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Returning 404 to user: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.196217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fe7cdaf8-af8b-413f-b001-05e3e3a04779 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 404 len: 111 microversion: 2.1 time: 0.070094 Sep 23 03:38:45.197341 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 155/272] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:38:45 2022] DELETE /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:45.207195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6bf955d-643b-459f-b7a1-89e169545609 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.222588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c6bf955d-643b-459f-b7a1-89e169545609 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6bf955d-643b-459f-b7a1-89e169545609 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:45.225469 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate -1 could not be found. Sep 23 03:38:45.226659 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '-1'} Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:45.227299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.228263 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 23 03:38:45.230299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.232173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6bf955d-643b-459f-b7a1-89e169545609 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.233231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6bf955d-643b-459f-b7a1-89e169545609 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031233 Sep 23 03:38:45.234362 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 156/273] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:45.251451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.252396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] [instance: af737615-a68c-46ef-8d01-6951b0b91115] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:45.270080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.270646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.271098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.272609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.273068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.273527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.304365 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] HTTP exception thrown: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Request method failure captured: Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 HTTP/1.1 Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoOqV3rPfL-1SsbOvFFn2BFT3JCdaP1ZhqWHknVFnkTSGN1gXatiu7WOHzOngPE8AcOLmvc_IWV-0zc4jDfhNkGobQt8dKW8SsZvOf5vExAk9ZEJDfiYS_DrYPi9B3j3t6RzAuVemQ53sxUZkUPwM2dw-KQxiNHUJjJSi6FFics_vQ Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:45.306278 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2228ce9e638f4e829c8e5ee252994f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2228ce9e638f4e829c8e5ee252994f4f Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-439480181 Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 23536c40f5b748d899efc0d94673ecaf Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminTestJSON-439480181-project Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.307579 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'af737615-a68c-46ef-8d01-6951b0b91115'} Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.308231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. Sep 23 03:38:45.309267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.310811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] Returning 404 to user: Instance af737615-a68c-46ef-8d01-6951b0b91115 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.310811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13126cf9-574e-45a3-b251-a5534b8bc470 tempest-AggregatesAdminTestJSON-439480181 tempest-AggregatesAdminTestJSON-439480181-project] 10.222.0.25 "GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115" status: 404 len: 111 microversion: 2.1 time: 0.072000 Sep 23 03:38:45.312932 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 157/274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/servers/af737615-a68c-46ef-8d01-6951b0b91115 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:45.323570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7543105-a762-41f2-a613-6fae059c800e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-948898843"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:45.327145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-b7543105-a762-41f2-a613-6fae059c800e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid efbf4c6b-f58e-443f-b842-0d9a941fae18 for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:45.370662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7543105-a762-41f2-a613-6fae059c800e tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056419 Sep 23 03:38:45.371991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 158/275] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:45.383039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9be27f49-b450-4c45-971a-fa5f56c25168 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.390152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9be27f49-b450-4c45-971a-fa5f56c25168 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9be27f49-b450-4c45-971a-fa5f56c25168 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:45.397707 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 03:38:45.399272 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '15'} Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:45.400030 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 03:38:45.401538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.410177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9be27f49-b450-4c45-971a-fa5f56c25168 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.412196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9be27f49-b450-4c45-971a-fa5f56c25168 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.032574 Sep 23 03:38:45.412196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 159/276] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:38:45.430162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81332a5e-e02c-4d23-b0a0-a81b058d79c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.492292 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81332a5e-e02c-4d23-b0a0-a81b058d79c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.073742 Sep 23 03:38:45.498413 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 160/277] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:45.508829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f08e90b0-f280-44f5-b173-2f25067a477a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.545908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-f08e90b0-f280-44f5-b173-2f25067a477a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f08e90b0-f280-44f5-b173-2f25067a477a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:38:45.558638 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: exception: Aggregate -1 could not be found. Sep 23 03:38:45.560016 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '-1'} Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.560798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 23 03:38:45.561988 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.566303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f08e90b0-f280-44f5-b173-2f25067a477a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.574763 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f08e90b0-f280-44f5-b173-2f25067a477a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.072541 Sep 23 03:38:45.578437 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 161/278] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:45.601019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:45.612954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78b7bf03-5efe-4b23-a8fb-39b6390ff9bc tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.619807 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-905baadb-bd9f-4e3a-9f32-3108eb57dcd9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.552708 Sep 23 03:38:45.620677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-78b7bf03-5efe-4b23-a8fb-39b6390ff9bc tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78b7bf03-5efe-4b23-a8fb-39b6390ff9bc tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:45.622912 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 03:38:45.624246 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:45.625044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 03:38:45.626301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:45.627311 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 118/279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:45.640366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78b7bf03-5efe-4b23-a8fb-39b6390ff9bc tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:45.647114 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78b7bf03-5efe-4b23-a8fb-39b6390ff9bc tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.057370 Sep 23 03:38:45.654318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 162/280] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:45.659745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:45.662198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:45.672731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3155e626-5d39-44e3-aa15-218bf95c512a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2018039590"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:45.683929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-3155e626-5d39-44e3-aa15-218bf95c512a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 1d925440-de04-4f55-b01d-387d785039ad for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:45.687119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.687726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.689390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.696415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:45.698900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:45.699375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:45.782446 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3155e626-5d39-44e3-aa15-218bf95c512a tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.125512 Sep 23 03:38:45.806510 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 163/281] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:46.353640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41c7b692-49ff-479c-9d40-0023fb095b10 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:46.368202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-41c7b692-49ff-479c-9d40-0023fb095b10 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.556384 Sep 23 03:38:46.369063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 164/282] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:46.383582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c6b3e76-3ec2-44bb-b8da-e6e0617c2030 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:46.397130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6b3e76-3ec2-44bb-b8da-e6e0617c2030 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:46.397944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6b3e76-3ec2-44bb-b8da-e6e0617c2030 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:46.398577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6b3e76-3ec2-44bb-b8da-e6e0617c2030 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:46.406088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:46.417802 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d92de694-25b6-407f-80e0-810aaf733b00 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.777790 Sep 23 03:38:46.434043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 119/283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:45 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:46.448131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:46.449170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:46.461331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:46.462987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:46.464084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:46.464727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:46.465589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:46.466429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:46.467199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:46.850101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c6b3e76-3ec2-44bb-b8da-e6e0617c2030 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 243 microversion: 2.1 time: 0.475487 Sep 23 03:38:46.852738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 165/284] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 03:38:46 2022] POST /compute/v2.1/os-aggregates/16/action => generated 243 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:46.866706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6035db-8278-4bf6-89e6-04dbb50f9bec", "name": "network-vif-plugged", "status": "completed", "tag": "e1bab091-be7c-4397-a1ea-518ef7a1ab2f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:46.895642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:46.897856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:46.899699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:46.929374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] Creating event network-vif-plugged:e1bab091-be7c-4397-a1ea-518ef7a1ab2f for instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec on n-h2-858495-2 Sep 23 03:38:46.938016 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ec7bda08-c29b-4f69-9a2d-47f9f4f5b5ca req-465046c4-e98b-4726-b59e-323a973c2769 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083307 Sep 23 03:38:46.939130 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 166/285] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:46.953044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a9331cd-93cd-49c3-a211-500f111cf698 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:46.977879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:46.990013 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fefc6110-416d-44c6-82fc-cdd8a71e74e0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1313 microversion: 2.1 time: 0.554425 Sep 23 03:38:46.996915 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 120/286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:46 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:47.016312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.017566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:47.028837 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a9331cd-93cd-49c3-a211-500f111cf698 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3080 microversion: 2.1 time: 0.087377 Sep 23 03:38:47.031407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.035872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.040836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.040987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 167/287] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:38:46 2022] GET /compute/v2.1/flavors => generated 3080 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:47.043118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.045130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.049005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.050621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65bc3d4f-7b07-4638-a694-5eaffcbf6532 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:47.055447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65bc3d4f-7b07-4638-a694-5eaffcbf6532 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '49c48c3c6b1d4485934e6725c7d5ef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722361bba611402fb588a9236d42c277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65bc3d4f-7b07-4638-a694-5eaffcbf6532 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Request method failure captured: Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 42 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQq9hyPzyoZGxHT9mAl4hCLTjbA4mMN_w-hOrn2W-HDISdWUi80v3YUzeiGaEQFo8YSkizelvwI5Z89-5PznzIMp3MmX4IghsfFhkCyYBO6KUVvf4FVKIR9mN5k2G6JWggrjjLd39b07XWybq_KFoiPCnM53tbumtdUKmxM6eGHYs Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:38:47.064140 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722361bba611402fb588a9236d42c277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722361bba611402fb588a9236d42c277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722361bba611402fb588a9236d42c277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722361bba611402fb588a9236d42c277 Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335 Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 49c48c3c6b1d4485934e6725c7d5ef00 Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194991335-project Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: {"remove_host": {"host": "n-h1-858495-2"}} Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:38:47.065733 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h1-858495-2'}}} Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:47.066578 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 03:38:47.067825 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.071508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65bc3d4f-7b07-4638-a694-5eaffcbf6532 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:47.072844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65bc3d4f-7b07-4638-a694-5eaffcbf6532 tempest-AggregatesAdminNegativeTestJSON-1194991335 tempest-AggregatesAdminNegativeTestJSON-1194991335-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.030816 Sep 23 03:38:47.076260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 168/288] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 03:38:47 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:47.095278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ba61230-8222-41d7-84d8-05ec91b25d21 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.116439 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ba61230-8222-41d7-84d8-05ec91b25d21 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037693 Sep 23 03:38:47.135623 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 169/289] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.148332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04d1cb33-b2bc-4f90-a27c-6812472cb8be tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:47.187547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04d1cb33-b2bc-4f90-a27c-6812472cb8be tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.188346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04d1cb33-b2bc-4f90-a27c-6812472cb8be tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.190073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04d1cb33-b2bc-4f90-a27c-6812472cb8be tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.365946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:47.379291 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9dbcd91b-c780-44cb-90a8-4f5b5e9b7415 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.380391 Sep 23 03:38:47.382081 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 121/290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:46 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:47.393805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e100a0a3-a405-4495-9e85-b760c13984d3 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.406840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e100a0a3-a405-4495-9e85-b760c13984d3 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023013 Sep 23 03:38:47.409098 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 122/291] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.436933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c2e882f-6b3f-4bb6-9331-738b223c9a0d tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.446118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04d1cb33-b2bc-4f90-a27c-6812472cb8be tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 228 microversion: 2.1 time: 0.309045 Sep 23 03:38:47.447313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 170/292] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 03:38:47 2022] POST /compute/v2.1/os-aggregates/16/action => generated 228 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.452753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.455486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:47.478714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.479398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.480093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.482033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.487977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.488489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.515224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c2e882f-6b3f-4bb6-9331-738b223c9a0d tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.094829 Sep 23 03:38:47.516211 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 123/293] 10.222.0.25 () {58 vars in 1165 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:47.537260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5e8eaa8-de75-47fc-a502-48f14e95ab10 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.584427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5e8eaa8-de75-47fc-a502-48f14e95ab10 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.066295 Sep 23 03:38:47.585977 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 124/294] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:47 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:47.601904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54ca1660-3abb-4c4c-8a88-297696be8b22 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.610674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54ca1660-3abb-4c4c-8a88-297696be8b22 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022254 Sep 23 03:38:47.611693 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 125/295] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.616657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1f99d01-c7ac-4157-ad4f-7ec38b190769 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-698704418"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:47.621260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.aggregate [None req-a1f99d01-c7ac-4157-ad4f-7ec38b190769 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Generated uuid 7af9d611-32aa-405f-aa7f-480ab0620a6a for aggregate {{(pid=128723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:47.673108 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1f99d01-c7ac-4157-ad4f-7ec38b190769 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060009 Sep 23 03:38:47.676856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 126/296] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 03:38:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.695283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65bec500-6d60-4c36-b70b-c56c5cbfe37a tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.725402 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65bec500-6d60-4c36-b70b-c56c5cbfe37a tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.047112 Sep 23 03:38:47.726014 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 127/297] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:47.732975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:47.757265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.761262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.762033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.783158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:47.783979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:47.784651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:47.803363 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.compute.aggregates [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 23 03:38:47.808366 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Request method failure captured: Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 42 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoTuFhN_oNJm-sBzXEC_Ls36YwjvGkwVAC2f1y15DQJeYPRBHbdw26O4PKAPW51lDrB1RtG3aFf7S_n7OllsWKil8kfY_7bk6MoaXc6DMQzyvrtu1L-uPvvQiVTmjguMIOtiLDaYsASRqXwARll6yEKBA9q8llIddcEpxfdJpblb78 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:38:47.810514 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5412e696cbc437fa5b162b3f6395217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a5412e696cbc437fa5b162b3f6395217 Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-792910946 Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 8fc528b420f44ea3896e29c2598d804b Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: {"remove_host": {"host": "nonexist_host"}} Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:38:47.811993 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot remove host nonexist_host in aggregate 17 Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 23 03:38:47.812884 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 23 03:38:47.814234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.815513 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Sep 23 03:38:47.816861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:38:47.818801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:38:47.823420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e636d049-d2b1-4acc-9851-d3a2b4fa07c2 tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.096126 Sep 23 03:38:47.827116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 128/298] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 03:38:47 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:38:47.834188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c2f1ea2-cf7d-42d9-bb2a-d00b5c4d76e7 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.850667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c2f1ea2-cf7d-42d9-bb2a-d00b5c4d76e7 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.024832 Sep 23 03:38:47.855752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 129/299] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.872298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a19d8d18-5e28-4673-8ae2-daf89182669f tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.900747 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a19d8d18-5e28-4673-8ae2-daf89182669f tempest-AggregatesAdminNegativeTestJSON-792910946 tempest-AggregatesAdminNegativeTestJSON-792910946-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043646 Sep 23 03:38:47.903857 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 130/300] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:38:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 03:38:47.914111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f4636d9-1068-4542-a88f-07913700bb0f tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.930995 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f4636d9-1068-4542-a88f-07913700bb0f tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025826 Sep 23 03:38:47.941728 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 131/301] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:47.952884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3f5be05-6fce-45b1-b01a-87998d2f38ab tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:47.998919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:48.014014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5fcdd31-0154-46a6-8696-03bb8b1a1462 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1390 microversion: 2.1 time: 0.564635 Sep 23 03:38:48.016628 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 171/302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1390 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:48.028070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.028906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:48.050027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:48.051782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:48.054181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:48.056363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:48.059310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:48.060972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:48.105517 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3f5be05-6fce-45b1-b01a-87998d2f38ab tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.162550 Sep 23 03:38:48.120767 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 132/303] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 03:38:47 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:48.135459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8abe6ee7-4a99-4c79-a4ff-e10d924f7219 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.150979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8abe6ee7-4a99-4c79-a4ff-e10d924f7219 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027658 Sep 23 03:38:48.160490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 133/304] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:48.179078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ddf3bb1-b77e-45a7-b312-b1bddbf0eef8 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.245557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ddf3bb1-b77e-45a7-b312-b1bddbf0eef8 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.081540 Sep 23 03:38:48.250372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 134/305] 10.222.0.25 () {58 vars in 1144 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:48.268142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0ac10b17-cbbe-4dd0-9caa-f83c93f6dc27 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.298326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0ac10b17-cbbe-4dd0-9caa-f83c93f6dc27 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034212 Sep 23 03:38:48.299061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 135/306] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:48.312196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa5e1298-cb59-49f1-b1f7-ecad6dafb781 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.342483 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa5e1298-cb59-49f1-b1f7-ecad6dafb781 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.033987 Sep 23 03:38:48.350926 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 136/307] 10.222.0.25 () {58 vars in 1148 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:48.364276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad21d435-096e-4f9c-8ea5-a5129ff9ec0a tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.386356 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad21d435-096e-4f9c-8ea5-a5129ff9ec0a tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025702 Sep 23 03:38:48.391439 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 137/308] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:48.405741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd04e2af-7e05-4399-a8e8-1582e561694e tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.441420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd04e2af-7e05-4399-a8e8-1582e561694e tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036077 Sep 23 03:38:48.457961 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 138/309] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:48.472892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.474194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:48.491115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:48.491852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:48.492426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:48.501680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:48.502830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:48.503655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:48.554962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:48.567055 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05410ca0-0f30-4ea5-93da-8e204125b19d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1463 microversion: 2.1 time: 0.546643 Sep 23 03:38:48.568405 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 172/310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:48.589567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3c292b6-7dc0-44aa-afde-7c1a25da9875 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:48.694097 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3c292b6-7dc0-44aa-afde-7c1a25da9875 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.120710 Sep 23 03:38:48.707349 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 173/311] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:49.294407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:49.295453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:49.306034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:49.307139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:49.308350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:49.309273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:49.310628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:49.311171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:49.394272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:49.408138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91eeef94-a46a-4ad2-a938-5344941a488a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.948680 Sep 23 03:38:49.417410 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 139/312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:49.417410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45b1fd76-fed3-4ea4-84c2-e8a166b6f171 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:49.496915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45b1fd76-fed3-4ea4-84c2-e8a166b6f171 tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.086444 Sep 23 03:38:49.497544 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 140/313] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:38:49 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:49.536388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:49.537136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:49.562151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:49.562649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:49.563087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:49.563808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:49.564263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:49.584685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:50.005726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:50.026291 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c6414e2-8fde-46d5-8bec-05f50003a6d4 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1589 microversion: 2.1 time: 0.505099 Sep 23 03:38:50.028866 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 141/314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:49 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1589 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:50.044860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45b8710c-1348-411c-b5dd-71bae05b9dbe tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:50.068768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45b8710c-1348-411c-b5dd-71bae05b9dbe tempest-FlavorsV2TestJSON-860708043 tempest-FlavorsV2TestJSON-860708043-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037702 Sep 23 03:38:50.069732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 142/315] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:38:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:50.371452 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ce6b88c-51c2-4093-bd4c-b19b63a43b10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1614 microversion: 2.1 time: 1.662918 Sep 23 03:38:50.372035 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 174/316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:48 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1614 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:50.382593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:50.388108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:50.403765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:50.405085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:50.410328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:50.411314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:50.412039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:50.412734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:50.762299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1310882253", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "6f121f7c-6b72-46a2-9bbd-ba5658c47c71"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:50.797731 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de46072c-5b04-4bd2-a58c-367d2f77ea47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.421829 Sep 23 03:38:50.798324 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 175/317] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:38:50 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:50.803960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:50.804530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:50.818511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:50.818980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:50.819421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:50.820132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:50.820584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:50.822760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:50.890158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] validate_networks() for [('6f121f7c-6b72-46a2-9bbd-ba5658c47c71', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:38:51.019319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:51.534775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b7e40d7565384402aec88733ef3b39c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61ad557826942c5b4fff9004fa4c908', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:51.536803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] flavor_id is None. Assuming migration. {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 03:38:51.537444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 03:38:51.975479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b87254e1-1772-4c54-ac0d-7a8354093e10 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8/action" status: 202 len: 0 microversion: 2.1 time: 1.175975 Sep 23 03:38:51.979770 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 176/318] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:38:50 2022] POST /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:51.994139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:51.998939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:52.011874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:52.015823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:52.016316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:52.017070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:52.020528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:52.021117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:52.828008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:52.836596 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-beee7135-ef32-4070-bd64-b7a8d29ef07e tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.854722 Sep 23 03:38:52.837175 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 177/319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:51 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:52.852323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:52.871838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:52.893936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:52.894465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:52.895383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:52.898309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:52.899708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:52.902052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.317902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:53.327957 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b3ab50a-3632-477d-97f5-ea79e823a981 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1472 microversion: 2.1 time: 0.485971 Sep 23 03:38:53.328542 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 178/320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:52 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:53.389510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:38:53.390024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:38:53.390396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:38:53.390823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:38:53.391220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:38:53.394414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:53.395396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:53.427798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.428297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.428737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.429518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.429979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.430407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.519301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:38:53.530595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for user 9855cf6129a34302a7e3e39d6a15a345 and project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:38:53.560061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:38:53.562459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:38:53.573158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Calling method '.version_select at 0x7f0c8bb39790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:53.580452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.583072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.584419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.652508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb25864b-b8b2-41f1-a3b4-52c352574ae6 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.581489 Sep 23 03:38:53.657446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.657967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.658427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.662507 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 143/321] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:38:53.668288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:53.669162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:53.760471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.760986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.761445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.788198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03629f81-4493-4a50-8731-6ff7a551e36a tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.452139 Sep 23 03:38:53.801765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 179/322] 10.222.0.25 () {60 vars in 1208 bytes} [Fri Sep 23 03:38:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:53.807116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0bd88d2c-c592-4407-afef-86ab7d0558d4 tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1154745196"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:53.810503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.aggregate [None req-0bd88d2c-c592-4407-afef-86ab7d0558d4 tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Generated uuid 9c43eb5c-b6d8-483a-af61-0bfa4f4ef4df for aggregate {{(pid=128724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 03:38:53.819559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:53.827235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:53.828606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:53.829772 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d976b4ef-276b-430a-bef3-5f824fccefba tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1262 microversion: 2.25 time: 0.165948 Sep 23 03:38:53.850798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 144/323] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:38:53 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:53.867693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:53.868665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:53.883426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.883922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.884357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.885065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:53.885713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:53.887026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:53.905332 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0bd88d2c-c592-4407-afef-86ab7d0558d4 tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.101596 Sep 23 03:38:53.908221 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 180/324] 10.222.0.25 () {62 vars in 1205 bytes} [Fri Sep 23 03:38:53 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:53.953096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87ed96d9-b1d1-4fb1-915b-699f57c4353b tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2063380626"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:54.224948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87ed96d9-b1d1-4fb1-915b-699f57c4353b tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.305947 Sep 23 03:38:54.226424 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 181/325] 10.222.0.25 () {62 vars in 1213 bytes} [Fri Sep 23 03:38:53 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:54.245178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ad4319c-7cf9-4d56-ad53-68064e25d40f tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:54.261202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ad4319c-7cf9-4d56-ad53-68064e25d40f tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.027176 Sep 23 03:38:54.264140 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 182/326] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:38:54 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:54.282110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:54.306169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:54.311748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:54.312333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:54.363916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:54.381973 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b19eab0f-0326-4a01-8238-056d4ce2e043 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.518119 Sep 23 03:38:54.384236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 145/327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:53 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:54.410435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:54.417217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:54.444252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:54.444826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:54.445262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:54.446038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:54.448560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:54.448965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:54.468833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:38:54.622357 n-d-858495-2 devstack@n-api.service[128724]: WARNING nova.scheduler.client.report [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] [req-8b0abc4f-2214-44ac-b9d5-d1a306af0a3d] Failed to update aggregates to [9c43eb5c-b6d8-483a-af61-0bfa4f4ef4df] for resource provider with UUID 52272385-088a-45ae-9d52-5bea2c94d2cf. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-8b0abc4f-2214-44ac-b9d5-d1a306af0a3d"}]} Sep 23 03:38:54.856689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:54.871055 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4b07035-ab28-40a9-b437-ae127de33ce6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1472 microversion: 2.1 time: 0.485140 Sep 23 03:38:54.875690 n-d-858495-2 devstack@n-api.service[128724]: WARNING nova.scheduler.client.report [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] [req-eb47705e-e658-48cb-9541-9632cb57a17c] Failed to update aggregates to [9c43eb5c-b6d8-483a-af61-0bfa4f4ef4df] for resource provider with UUID 52272385-088a-45ae-9d52-5bea2c94d2cf. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-eb47705e-e658-48cb-9541-9632cb57a17c"}]} Sep 23 03:38:54.881063 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 146/328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:54 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:54.902834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10861b0-d066-4ae7-9fd0-7472797e0495", "name": "network-vif-plugged", "status": "completed", "tag": "865432a0-4f21-4df9-93e6-41b9dc22b324"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:54.919030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:54.922352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:54.923540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:54.962990 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] Creating event network-vif-plugged:865432a0-4f21-4df9-93e6-41b9dc22b324 for instance f10861b0-d066-4ae7-9fd0-7472797e0495 on n-h1-858495-2 Sep 23 03:38:54.988484 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fa6a38a1-a517-45e2-bae8-799f32d9b25f req-28f89724-2066-45c4-9100-baaceaf75249 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098751 Sep 23 03:38:54.989820 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 147/329] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:55.009026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.010172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:55.037389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.039031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.045047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2d4862d-de93-441b-8fcf-83f8780d1e8c tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.773453 Sep 23 03:38:55.046664 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 183/330] 10.222.0.25 () {62 vars in 1235 bytes} [Fri Sep 23 03:38:54 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:55.054293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.055699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.057156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6035db-8278-4bf6-89e6-04dbb50f9bec", "tag": "e1bab091-be7c-4397-a1ea-518ef7a1ab2f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:55.063839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.065902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.103849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.110777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.113290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.169686 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] Creating event network-changed:e1bab091-be7c-4397-a1ea-518ef7a1ab2f for instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec on n-h2-858495-2 Sep 23 03:38:55.192616 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fb100fc5-0646-4ea4-b11c-19fbd6e0f3ee req-26c6e174-b3ec-434c-86af-676ce40e7bfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141070 Sep 23 03:38:55.198299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 184/331] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:55.232469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.234053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:55.269066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.272167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.273702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.274830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.279813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.282085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.501178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.522708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.529264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.530776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83f4ba49-5152-4d83-880a-9ee846156e38 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1258 microversion: 2.25 time: 0.331025 Sep 23 03:38:55.534338 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 185/332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:38:55 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1258 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:55.539429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c07d526-7ffb-4694-ba1c-a9bdf98462cc tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:55.577614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c07d526-7ffb-4694-ba1c-a9bdf98462cc tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.578464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c07d526-7ffb-4694-ba1c-a9bdf98462cc tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.579178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c07d526-7ffb-4694-ba1c-a9bdf98462cc tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.604363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.615352 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-095b9654-c23b-4c33-ac53-79df6fa0bd88 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 200 len: 1589 microversion: 2.1 time: 0.620601 Sep 23 03:38:55.617046 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 148/333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:54 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 1589 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:55.622479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.623281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:55.631109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.631837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.645819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.648355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.649004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.651705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.826321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c07d526-7ffb-4694-ba1c-a9bdf98462cc tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.290601 Sep 23 03:38:55.847805 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 186/334] 10.222.0.25 () {62 vars in 1235 bytes} [Fri Sep 23 03:38:55 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:38:55.861149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a00987d-799c-46b5-a3fc-a7ad2ee121c2 tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.893097 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a00987d-799c-46b5-a3fc-a7ad2ee121c2 tempest-AggregatesAdminTestV241-905883249 tempest-AggregatesAdminTestV241-905883249-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.037104 Sep 23 03:38:55.894379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 187/335] 10.222.0.25 () {60 vars in 1196 bytes} [Fri Sep 23 03:38:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:55.909006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.909948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:55.942671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.944638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.946412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.949209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:55.953456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:55.954791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:55.979898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.993984 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ab0e6ce-ef87-4159-8988-94f699fd1284 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1320 microversion: 2.1 time: 0.373939 Sep 23 03:38:55.997264 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 149/336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:55 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:56.398222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:56.409674 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c9462c2-44a4-497e-bd47-203dba69d47d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1472 microversion: 2.1 time: 0.506324 Sep 23 03:38:56.413024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 188/337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:55 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:56.564191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:56.566462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:56.583492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:56.584257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:56.586027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:56.586892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:56.589405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:56.592264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:56.778449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:56.800623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:56.804842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:56.815506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b80a7db9-d473-431f-bfb3-291cdcfa53b3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1322 microversion: 2.25 time: 0.254193 Sep 23 03:38:56.817447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 150/338] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:38:56 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:57.025516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:57.026449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:57.059025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.060535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.060993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:57.063287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.064919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.065384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:57.437844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:57.438901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:57.446313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.448040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.448874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:57.450917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.451557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.452170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:57.865620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:57.887107 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d71a7215-e122-49a3-9641-a7c50daa604c tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1470 microversion: 2.1 time: 0.868366 Sep 23 03:38:57.889949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 189/339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:57 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1470 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:57.919543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:57.921734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:57.938315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.939049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.939446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:57.940212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:57.943593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:57.944141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.132529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.144643 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fda58ca4-d606-4e47-b1c5-9e0dc39ef9c4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1472 microversion: 2.1 time: 0.712319 Sep 23 03:38:58.145247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 151/340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:57 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:38:58.169090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:58.175884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:58.199646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.207018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.211432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.219248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.220776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.222407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.392523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.405945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2d0b0ae-e3a8-4330-844b-19a164d41f50 tempest-DeleteServersAdminTestJSON-984269862 tempest-DeleteServersAdminTestJSON-984269862-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495/action" status: 202 len: 0 microversion: 2.1 time: 0.259240 Sep 23 03:38:58.406626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.413279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.414176 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 152/341] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:38:58 2022] POST /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:38:58.414776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da507e4b-e0f2-414a-8466-2c878dc83bf3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1320 microversion: 2.25 time: 0.523414 Sep 23 03:38:58.415992 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 190/342] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:38:57 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:38:58.421541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:58.422173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:58.435201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.436033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.436704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.437620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.438235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.438819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.490626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.491374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.491992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.492602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lazy-loading 'fault' on Instance uuid f10861b0-d066-4ae7-9fd0-7472797e0495 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:38:58.770121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.782770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d3da336b-ec15-4f27-84c8-6c6c2936e75a tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1453 microversion: 2.1 time: 0.367399 Sep 23 03:38:58.783738 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 153/343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:58 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1453 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:58.811586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:58.812203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:58.826380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.827028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.828494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.831095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:58.832867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:58.833444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:58.924086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:38:59.173866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:59.175017 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d8a2f56-8a25-4d53-abc6-a91fc3ed3cb7 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 204 len: 0 microversion: 2.1 time: 0.366353 Sep 23 03:38:59.175215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:59.177753 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 191/344] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:38:58 2022] DELETE /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:38:59.189559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.190177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.192872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.197139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.200610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:59.201531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.202997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.203954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:59.228308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.234036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.234813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.237298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.239311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.242359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.321655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.323885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.326122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.327011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lazy-loading 'fault' on Instance uuid f10861b0-d066-4ae7-9fd0-7472797e0495 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:38:59.734714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:59.766890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c92a200-eacb-472c-a005-b59c3b7fd6a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1472 microversion: 2.1 time: 0.596370 Sep 23 03:38:59.768687 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 154/345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:59 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:59.782475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:59.784034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:38:59.797624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.798968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.800093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.802949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:38:59.805091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:38:59.806320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:38:59.820491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:59.846215 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97e1894a-4273-46ec-9fa8-b7d7d161d7a4 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1459 microversion: 2.1 time: 0.657368 Sep 23 03:38:59.848382 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 192/346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:38:59 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1459 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:00.124431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:00.135192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:00.136843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:00.138364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-64d9adc3-ad3a-4d51-90a1-bbd0af055cd2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.367954 Sep 23 03:39:00.159083 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 155/347] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:38:59 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:00.814848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:00.815482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:00.829374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:00.829875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:00.831611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:00.835572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:00.836394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:00.837735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:00.871824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:00.872457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:00.891077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:00.891724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:00.892176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:00.892890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:00.893370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:00.899036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:00.996354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:00.999567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:01.001578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:01.002732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lazy-loading 'fault' on Instance uuid f10861b0-d066-4ae7-9fd0-7472797e0495 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:01.494281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.507659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03939f0c-c4f6-47b2-b219-9bedfb52f028 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.697712 Sep 23 03:39:01.527603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 193/348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:00 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:01.542891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:01.547637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:01.557606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:01.563299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:01.563805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:01.564243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:01.571548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:01.572048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:01.572492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:01.670737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.693183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4186a3b3-2bf5-4691-a4fa-360da860c1ea tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1459 microversion: 2.1 time: 0.821750 Sep 23 03:39:01.710718 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 156/349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:00 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1459 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:01.964249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.976147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:01.981181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.983369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.986653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d888aac7-22da-4137-892c-c6cc9bb26006 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.457394 Sep 23 03:39:01.989085 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 194/350] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:01 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:02.554747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:02.555541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:02.574591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:02.575263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:02.575719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:02.578022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:02.578537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:02.578976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:02.718901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:02.719714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:02.736661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:02.742917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:02.743925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:02.746880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:02.748329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:02.749915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:02.856830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:02.857481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:02.857807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:02.861602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lazy-loading 'fault' on Instance uuid f10861b0-d066-4ae7-9fd0-7472797e0495 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:02.997535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d039b881c2b448d955103ba005f3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23102e21f8ad459d961a1ab32beaa312', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:03.011771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e5a6119-3de9-4aa4-ac97-9e77df42596d tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 200 len: 1417 microversion: 2.1 time: 0.299327 Sep 23 03:39:03.016724 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 195/351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:02 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 1417 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:03.028197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10861b0-d066-4ae7-9fd0-7472797e0495", "name": "network-vif-deleted", "tag": "865432a0-4f21-4df9-93e6-41b9dc22b324"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:03.060279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:03.060942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:03.063432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:03.105812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] Creating event network-vif-deleted:865432a0-4f21-4df9-93e6-41b9dc22b324 for instance f10861b0-d066-4ae7-9fd0-7472797e0495 on n-h1-858495-2 Sep 23 03:39:03.131425 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-816aa3b2-7ee7-4351-ac83-d75c0c3979e4 req-9704f4d3-8ea1-488b-ab4e-224480bf9cd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111311 Sep 23 03:39:03.134971 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 196/352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:03.160530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:03.162638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:03.181560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:03.182770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:03.183728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:03.185675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:03.187859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:03.190022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:03.489313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:03.713898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:03.724262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38ee8d44-a96f-4f7f-ba59-4b7a313b7f61 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 1.174053 Sep 23 03:39:03.724863 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 157/353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:02 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:03.826366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:04.160510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.163709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.164449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.165122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.166126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.168865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.170180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.172867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:04.189622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:04.191704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:04.193167 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc93e059-55de-4a90-938c-deb01b6e3e9b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 1.057029 Sep 23 03:39:04.196307 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 197/354] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:03 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:04.230069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.230947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.236477 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2420790-4425-4be1-b1d2-9d15e66846b0 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.505509 Sep 23 03:39:04.238200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 158/355] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Sep 23 03:39:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:04.248834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.249382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.249858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.250586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.254338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.255906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.256610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.258402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.261896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.264286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.267732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.271450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.272987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.294768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 HTTP/1.1 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:04.296485 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.298054 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f10861b0-d066-4ae7-9fd0-7472797e0495'} Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:04.298910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.300328 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.301591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:04.301591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f48717a-76d5-4293-9f48-66f31000f549 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 404 len: 111 microversion: 2.1 time: 0.100551 Sep 23 03:39:04.301591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 198/356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:04 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:04.323644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.324410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.338289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.338802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.339257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.339982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.340427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.340859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.369096 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 HTTP/1.1 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:04.371394 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.372946 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f10861b0-d066-4ae7-9fd0-7472797e0495'} Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:04.373887 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.375159 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.377163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:04.385003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9bc5a7d-a2ad-453d-91c1-62840be894b3 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 404 len: 111 microversion: 2.1 time: 0.058981 Sep 23 03:39:04.386171 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 199/357] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:39:04 2022] DELETE /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:04.391974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d6b0b64-1726-46d5-925a-e4be70a63217 tempest-AZAdminV2TestJSON-466775688 tempest-AZAdminV2TestJSON-466775688-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.139457 Sep 23 03:39:04.394336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.395110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: f10861b0-d066-4ae7-9fd0-7472797e0495] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.404595 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 159/358] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:39:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:04.412401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.413140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.413778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.415165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.415782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.416365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.446449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 HTTP/1.1 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:04.448151 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.449527 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f10861b0-d066-4ae7-9fd0-7472797e0495'} Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:04.450424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. Sep 23 03:39:04.452325 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.454586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance f10861b0-d066-4ae7-9fd0-7472797e0495 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:04.471637 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc3f9497-7cbb-4ca0-91c3-786736da23d9 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495" status: 404 len: 111 microversion: 2.1 time: 0.065432 Sep 23 03:39:04.472760 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 200/359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:04 2022] GET /compute/v2.1/servers/f10861b0-d066-4ae7-9fd0-7472797e0495 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:04.481342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.481927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.493230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.497938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.498706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.499661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.504818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.505609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.534433 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca HTTP/1.1 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:04.543041 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.544292 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4535d919-472e-488a-ae73-8149032868ca'} Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:04.544923 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.546157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.550265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:04.552880 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f97e180-3aff-4904-be0e-125a1abcb969 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 404 len: 111 microversion: 2.1 time: 0.075477 Sep 23 03:39:04.555396 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 160/360] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:39:04 2022] DELETE /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:04.564572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.565460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] [instance: 4535d919-472e-488a-ae73-8149032868ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.573987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.576585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.579803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.580923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.582685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.584727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.611495 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] HTTP exception thrown: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Request method failure captured: Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca HTTP/1.1 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoQ4cFgAh4vz5MPagjIzX1Jjuqpi8ufpoDVAxidpGbusI7QmF2xH2bSX1BBQQcHqNBJmzgZviIu5gmybsTRLYw9-yOpI-RZl1QGP3qMDoIELTPiKqiaWv-dJY5Eu2ODcBfl50Zx2HNMjEe25xTMIB6t8GecjUR7gF8S4XqlTiuBHUg Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:04.613720 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23102e21f8ad459d961a1ab32beaa312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 23102e21f8ad459d961a1ab32beaa312 Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2221651 Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5d039b881c2b448d955103ba005f3b97 Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersAdminTestJSON-2221651-project Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.615174 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '4535d919-472e-488a-ae73-8149032868ca'} Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:04.615937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. Sep 23 03:39:04.617197 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:04.619378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] Returning 404 to user: Instance 4535d919-472e-488a-ae73-8149032868ca could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:04.620967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-96f454c7-7f59-4fe0-8d01-235838519897 tempest-DeleteServersAdminTestJSON-2221651 tempest-DeleteServersAdminTestJSON-2221651-project] 10.222.0.25 "GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca" status: 404 len: 111 microversion: 2.1 time: 0.060972 Sep 23 03:39:04.622133 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 201/361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:04 2022] GET /compute/v2.1/servers/4535d919-472e-488a-ae73-8149032868ca => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:04.749101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.750255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:04.762282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.762779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.763215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:04.778862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:04.779368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:04.788369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:05.111825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:05.120399 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-167b435b-b2fb-4ef1-b617-4b275fe3ff8e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.376105 Sep 23 03:39:05.134712 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 161/362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:04 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:05.221482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:05.222793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:05.243041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:05.246317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:05.246787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:05.247528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:05.254453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:05.259090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:05.827733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47e79042-82c6-42ac-b7e8-64f6683caa46 tempest-AZAdminNegativeTestJSON-1502548789 tempest-AZAdminNegativeTestJSON-1502548789-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:05.829254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47e79042-82c6-42ac-b7e8-64f6683caa46 tempest-AZAdminNegativeTestJSON-1502548789 tempest-AZAdminNegativeTestJSON-1502548789-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '21293f06892f4e228942f00707a2e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9ca3c3b0f4f5fa56bfaa8fa7aa202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47e79042-82c6-42ac-b7e8-64f6683caa46 tempest-AZAdminNegativeTestJSON-1502548789 tempest-AZAdminNegativeTestJSON-1502548789-project] Request method failure captured: Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpX9sajqfV3Kgshgm0UOcrnmmMY7wErqvXZDpSOeyzKFhW_h11QC6mGgxAfHvyWsuSlEoZtywPCBpjjJBnfRU-Y0r2hmX7u6bNhB6YWn_b_q89KF3GixMYk3mfWfilMnNKsuWhfywM-Jex1HoXwCqORnXlgr1y1MPHgEndu_LuC3qM Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0be9ca3c3b0f4f5fa56bfaa8fa7aa202 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1502548789 Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:05.831386 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0be9ca3c3b0f4f5fa56bfaa8fa7aa202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0be9ca3c3b0f4f5fa56bfaa8fa7aa202"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0be9ca3c3b0f4f5fa56bfaa8fa7aa202"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0be9ca3c3b0f4f5fa56bfaa8fa7aa202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AZAdminNegativeTestJSON-1502548789 Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0be9ca3c3b0f4f5fa56bfaa8fa7aa202 Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1502548789 Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AZAdminNegativeTestJSON-1502548789-project Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 21293f06892f4e228942f00707a2e719 Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AZAdminNegativeTestJSON-1502548789-project Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 03:39:05.832622 n-d-858495-2 devstack@n-api.service[128723]: action_args: {} Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:05.833457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:05.834531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47e79042-82c6-42ac-b7e8-64f6683caa46 tempest-AZAdminNegativeTestJSON-1502548789 tempest-AZAdminNegativeTestJSON-1502548789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:05.835489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47e79042-82c6-42ac-b7e8-64f6683caa46 tempest-AZAdminNegativeTestJSON-1502548789 tempest-AZAdminNegativeTestJSON-1502548789-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.544796 Sep 23 03:39:05.840443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 162/363] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:39:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:05.846969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80824846-9527-4e64-a5af-ca2581e87502", "tag": "c85a94f1-4c3c-434e-bf3f-f49d96102895"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:05.888824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:05.889970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:05.891968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:05.925609 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] Creating event network-changed:c85a94f1-4c3c-434e-bf3f-f49d96102895 for instance 80824846-9527-4e64-a5af-ca2581e87502 on n-h1-858495-2 Sep 23 03:39:05.946691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-042989a9-a4c7-4e99-b3e1-5d374a07f497 req-a384a0a6-e19a-4bf2-a512-c8abcc5f6a93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103271 Sep 23 03:39:05.949245 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 163/364] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:06.150445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:06.152114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:06.176556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:06.177987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:06.178446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:06.182978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:06.183464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:06.186575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:06.315934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:06.326298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:06.330268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:06.331444 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6d54eaf-3cd1-435a-8f04-b1dd3bd35849 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 1.115050 Sep 23 03:39:06.332015 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 202/365] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:05 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:06.743163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:06.757685 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43474d20-34c5-449f-838a-bb27e6538916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.611207 Sep 23 03:39:06.777711 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 164/366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:06 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:07.369049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:07.371981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:07.391114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:07.392459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:07.394946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:07.397134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:07.404684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:07.407921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:07.783831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:07.784562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:07.791694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:07.807920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:07.812993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:07.817841 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9eeb2653-4365-4166-8b1a-6797e2b9e429 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.458692 Sep 23 03:39:07.819305 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 203/367] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:07 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:07.834710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:07.834710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:07.834710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:07.836588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:07.839109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:07.841770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:07.866763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:08.849244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:08.850486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:08.860985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:08.863605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:08.865934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:08.867018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:08.870163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:08.870915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:09.043128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:09.054578 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3878c6d2-f5d4-4892-8849-8078d783d818 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 1.275235 Sep 23 03:39:09.055183 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 165/368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:07 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:09.616725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:09.639455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:09.649138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:09.656375 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ddd37eb9-55ba-4713-b820-0b8cb22ec2d8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.806681 Sep 23 03:39:09.685270 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 204/369] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:08 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:10.085115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:10.085953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:10.102069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:10.103889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:10.106083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:10.109193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:10.110032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:10.112403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:10.695414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:10.695848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:10.711074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:10.714271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:10.714785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:10.715719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:10.724797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:10.725428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:11.120918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:11.139881 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e291119-adb7-4285-b721-3bc8d8bef9ba tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 1.061489 Sep 23 03:39:11.141266 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 166/370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:10 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:11.322456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:11.331727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:11.333998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:11.335314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d60706f3-e3ad-4c9f-87d7-cf1a8509aac7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.650635 Sep 23 03:39:11.337244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 205/371] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:10 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:12.070375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ce52ec3-1761-49a4-a635-db6b7c7842ae tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Action: 'create', calling method: .version_select at 0x7f0c8bb663a0>, body: {"pool": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:12.171739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:12.172358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:12.186229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:12.187756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:12.189536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:12.190766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:12.191589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:12.193867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:12.720522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:12.734269 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef2482d8-5cc1-4d9f-aaac-03543cfae4f3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.562453 Sep 23 03:39:12.760730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 206/372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:12 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:12.781923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:12.788834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:12.818814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:12.819820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:12.820278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:12.824340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:12.824838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:12.825282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:13.250102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:13.276369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:13.278170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:13.284071 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee8a63fb-ffdd-4f76-a0c3-c91cb7ef42b7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.516851 Sep 23 03:39:13.288722 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 207/373] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:12 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:13.615710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5522d471-68d8-48e1-a722-6541b7595e48 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1573835819", "id": 1595845192, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:13.641211 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5522d471-68d8-48e1-a722-6541b7595e48 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.349533 Sep 23 03:39:13.643291 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 208/374] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:13 2022] POST /compute/v2.1/flavors => generated 430 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:13.649974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80824846-9527-4e64-a5af-ca2581e87502", "name": "network-vif-plugged", "status": "completed", "tag": "c85a94f1-4c3c-434e-bf3f-f49d96102895"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:13.663392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:13.664298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:13.664952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:13.682194 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] Creating event network-vif-plugged:c85a94f1-4c3c-434e-bf3f-f49d96102895 for instance 80824846-9527-4e64-a5af-ca2581e87502 on n-h1-858495-2 Sep 23 03:39:13.690468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0a4019fb-fd2f-4765-b934-4b033e31720e req-d15a08b2-e67f-4aeb-a74f-5f0ecf2d3ad9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045632 Sep 23 03:39:13.691552 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 209/375] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:13.791290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8bae69d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:13.795709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:13.797710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:13.798413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:13.800066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:13.801917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:13.802628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:13.875616 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a89352a2-cb4b-4cea-9831-7a4924dd4503 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.182572 Sep 23 03:39:13.876304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 210/376] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:39:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:13.894462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-309592e5-f3d8-4b68-956f-1ed31ed88c73 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:13.929916 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-309592e5-f3d8-4b68-956f-1ed31ed88c73 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1595845192" status: 202 len: 0 microversion: 2.1 time: 0.052242 Sep 23 03:39:13.930651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 211/377] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:39:13 2022] DELETE /compute/v2.1/flavors/1595845192 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:13.935602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:13.936667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:13.952772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:13.953688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:13.954323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:13.955224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:13.956934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:13.958541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.208103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:14.219728 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53b5c70f-f6e3-4b65-ab9a-485c8c3dc27d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.285543 Sep 23 03:39:14.220421 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 212/378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:13 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:14.235235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8bb25820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.247232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.248243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.248959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.251233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.251805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.252286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.319641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:14.321118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5298c0a4-25b3-4153-80ad-24d8e0aee0f2 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.098396 Sep 23 03:39:14.322262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 213/379] 10.222.0.25 () {58 vars in 1139 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:14.327942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f7a5f51-d24e-4c75-9547-c5bc626881cb tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.364628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f7a5f51-d24e-4c75-9547-c5bc626881cb tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040709 Sep 23 03:39:14.365776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 214/380] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:14.373506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.374870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:14.399367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.403231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.403794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.406096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.407669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.408190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.688006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:14.697060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:14.698707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:14.699902 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-710958fb-5447-4450-b745-5a454c9a30aa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1362 microversion: 2.25 time: 0.332986 Sep 23 03:39:14.700538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 215/381] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:14.705301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8b8a1ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.709011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.709696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.710265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.712422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.714214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.719548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.748124 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b84ad988-259c-4a62-a385-ebd1fda72357 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.045933 Sep 23 03:39:14.756075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 216/382] 10.222.0.25 () {58 vars in 1145 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:14.761628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8358058c-3bb4-4553-a2e8-62c35450d9ef tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1257200233", "id": 157805235, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:14.785480 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8358058c-3bb4-4553-a2e8-62c35450d9ef tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.027816 Sep 23 03:39:14.787394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 217/383] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:14.793216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8be9ba60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.801672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.802389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.803564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.807186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.807966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.808806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.839985 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e085e8c6-eceb-410a-bfb2-6fda8fb0c821 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051240 Sep 23 03:39:14.847088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 218/384] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:14.852766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d576345-97a3-4f5c-9539-c599e1978d2c tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.892503 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d576345-97a3-4f5c-9539-c599e1978d2c tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.043266 Sep 23 03:39:14.894372 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 219/385] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:14.900718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8baa1310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.905174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.906371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.907508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.914046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:14.914909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:14.915610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:14.960349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccb4df3f-12e0-48fb-b263-d997a472d337 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.064069 Sep 23 03:39:14.961295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 220/386] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:14.967089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-862e931d-ac9f-486e-84df-8ad40bdb2e68 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.986473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-862e931d-ac9f-486e-84df-8ad40bdb2e68 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/157805235" status: 202 len: 0 microversion: 2.1 time: 0.023817 Sep 23 03:39:14.990150 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 221/387] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:39:14 2022] DELETE /compute/v2.1/flavors/157805235 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:15.002828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8bae69d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.006593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.007078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.007523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.008259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.008718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.009148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.068019 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec965cc2-ca64-4d5c-a051-e0d3de3f788e tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.079635 Sep 23 03:39:15.071032 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 222/388] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:39:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.077426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e36b5fa-cee8-4eb2-96d8-aa2591fd2770 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.122833 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e36b5fa-cee8-4eb2-96d8-aa2591fd2770 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.050593 Sep 23 03:39:15.125023 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 223/389] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:15.130505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8bb39790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.149910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.150770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.151286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.167209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.168734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.169895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.189397 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db2a6301-88b1-45de-aac5-7328b69d0626 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-858495-2" status: 200 len: 467 microversion: 2.1 time: 0.062924 Sep 23 03:39:15.190930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 224/390] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/os-hosts/n-h1-858495-2 => generated 467 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.196294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4870c7f8-a8bb-45eb-830d-5a0916aa9fcc tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1628199467", "id": 1607740252, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:15.218838 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4870c7f8-a8bb-45eb-830d-5a0916aa9fcc tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026559 Sep 23 03:39:15.228045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 225/391] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:15 2022] POST /compute/v2.1/flavors => generated 429 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.233700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Calling method '.version_select at 0x7f0c8b801160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.242523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.243149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.243667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.260865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:15.263587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.264299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.264908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.290814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ae2e679-81d0-42e5-b146-bb14a31e6487 tempest-HostsAdminTestJSON-903898087 tempest-HostsAdminTestJSON-903898087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-858495-2" status: 200 len: 598 microversion: 2.1 time: 0.061203 Sep 23 03:39:15.292035 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 226/392] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/os-hosts/n-h2-858495-2 => generated 598 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.301572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8723c7d-36b1-453b-bd72-8817446e5eb6 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.323682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8723c7d-36b1-453b-bd72-8817446e5eb6 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1607740252" status: 202 len: 0 microversion: 2.1 time: 0.030300 Sep 23 03:39:15.325460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 227/393] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:39:15 2022] DELETE /compute/v2.1/flavors/1607740252 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:15.341615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.342247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:15.355056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.355578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.356031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.356765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.357236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.357702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.383473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:15.558702 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ce52ec3-1761-49a4-a635-db6b7c7842ae tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.885134 Sep 23 03:39:15.568153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 167/394] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:39:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.568153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d0388af-a4dc-4f03-9448-978684475fab tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.624477 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d0388af-a4dc-4f03-9448-978684475fab tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.063692 Sep 23 03:39:15.626926 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 168/395] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:15.633586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a57429c3-991a-4fc7-bb49-e0afdd530383 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Action: 'create', calling method: .version_select at 0x7f0c8bbe9700>, body: {"pool": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:15.687027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:15.698023 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06e70ed8-aafb-40f3-8a92-3a8f4e9fff95 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.368429 Sep 23 03:39:15.701155 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 228/396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:15.706856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be329055-99c1-4ddf-92f8-a5ac7bcec711 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1749847942", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:15.727335 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be329055-99c1-4ddf-92f8-a5ac7bcec711 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024771 Sep 23 03:39:15.730091 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 229/397] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.740072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.741752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:15.754411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.755129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.757713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:15.758795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:15.759422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:15.760042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:16.021372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:16.030111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:16.031584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:16.032764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69a1dc44-c3bb-44ac-93d8-903608a2d70e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1557 microversion: 2.25 time: 0.301410 Sep 23 03:39:16.052667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 230/398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:15 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1557 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:16.057630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba2e7f68-f9ac-49b7-b23c-25235511f1ce tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:16.078649 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba2e7f68-f9ac-49b7-b23c-25235511f1ce tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/57be22b3-be90-41a6-8394-9cc6f67f9055" status: 202 len: 0 microversion: 2.1 time: 0.024084 Sep 23 03:39:16.085086 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 231/399] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:39:16 2022] DELETE /compute/v2.1/flavors/57be22b3-be90-41a6-8394-9cc6f67f9055 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:16.428472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:16.429961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:16.444134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:16.445048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:16.445696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:16.448236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:16.449434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:16.452236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:16.807472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 80824846-9527-4e64-a5af-ca2581e87502 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:16.883507 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c11082c6-650c-4a52-810c-338cbfedb4b1 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 2050 microversion: 2.25 time: 0.795891 Sep 23 03:39:16.885431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 232/400] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:16 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 2050 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:16.890511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d04ebf9-a528-4a50-ae28-b8650b9fbea8 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:16.914968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d04ebf9-a528-4a50-ae28-b8650b9fbea8 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028275 Sep 23 03:39:16.916208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 233/401] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:16 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:16.921340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:16.922147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:16.931254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:16.932438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:16.933092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:16.934224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:16.934888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:16.935558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.274502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:17.284353 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-729435f8-8991-413d-a5c8-1d753698182e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1477 microversion: 2.1 time: 0.366901 Sep 23 03:39:17.288591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 234/402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:16 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:17.317824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:17.318439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:17.337937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.341495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.346942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.347696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.350402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.351065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.732020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 80824846-9527-4e64-a5af-ca2581e87502 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:17.748874 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e6836f8-6995-4664-8536-5a329dda576f tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 2050 microversion: 2.25 time: 0.434754 Sep 23 03:39:17.750014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 235/403] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:17 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 2050 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:17.755680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b55e41b6-e83f-418e-b6cc-acdd387559a7 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-160805128", "id": "2eb5de47-1b00-4d00-8735-e4de738b91ce", "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:17.781889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b55e41b6-e83f-418e-b6cc-acdd387559a7 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030492 Sep 23 03:39:17.782497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 236/404] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:17 2022] POST /compute/v2.1/flavors => generated 506 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:17.820238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:17.824002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.824504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.824948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.825728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.826316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.826836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.852385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb7b43ee-73aa-4c3a-bfd8-b64026bba87d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068541 Sep 23 03:39:17.860884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 237/405] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Sep 23 03:39:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:39:17.866851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c775ae10-fd1c-4901-b1da-4fc22e7d4643 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:17.886896 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c775ae10-fd1c-4901-b1da-4fc22e7d4643 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2eb5de47-1b00-4d00-8735-e4de738b91ce" status: 202 len: 0 microversion: 2.1 time: 0.024660 Sep 23 03:39:17.888008 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 238/406] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:39:17 2022] DELETE /compute/v2.1/flavors/2eb5de47-1b00-4d00-8735-e4de738b91ce => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:17.896896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858495-2", "block_migration": "auto"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:17.899938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:17.908585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.910258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.910970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:17.911973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:17.912647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:17.913435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:18.038971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'flavor' on Instance uuid 80824846-9527-4e64-a5af-ca2581e87502 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:18.097603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Going to try to live migrate instance to n-h2-858495-2 {{(pid=128724) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:39:18.210134 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a57429c3-991a-4fc7-bb49-e0afdd530383 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.581931 Sep 23 03:39:18.211855 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 169/407] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:39:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:18.218419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77014772-9159-4d55-ad25-bd373f739645 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:18.246008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77014772-9159-4d55-ad25-bd373f739645 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.032739 Sep 23 03:39:18.263830 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 170/408] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:18 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:18.269075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbba24d1-d9b3-4fa3-84ea-ec03b4df8427 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Action: 'create', calling method: .version_select at 0x7f0c8bbb6670>, body: {"pool": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:19.687066 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbba24d1-d9b3-4fa3-84ea-ec03b4df8427 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.421713 Sep 23 03:39:19.701647 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 171/409] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:39:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:19.706775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5f7c80e-9a9f-4cf9-8d2d-1b309f8cbf6b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-668593802", "id": 522952847, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:19.728045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5f7c80e-9a9f-4cf9-8d2d-1b309f8cbf6b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.024583 Sep 23 03:39:19.728669 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 172/410] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:19 2022] POST /compute/v2.1/flavors => generated 410 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:19.734495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:19.735665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:19.743014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:19.743733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:19.744328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:19.745375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:19.746984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:19.747579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:19.908526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:19.918082 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28203df0-7ca2-477d-b906-b1e467d85383 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1476 microversion: 2.1 time: 0.188106 Sep 23 03:39:19.918895 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 173/411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:19 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:19.949619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "name": "network-vif-unplugged", "status": "completed", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:19.962692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:19.963172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:19.963602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:19.975443 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Creating event network-vif-unplugged:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h1-858495-2 Sep 23 03:39:19.988422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:39:19.999669 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ab3da5dc-2791-44ef-ad58-ece6562072f4 req-3bf91c7e-de9c-4a4f-a6d6-16fc266d0a6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058169 Sep 23 03:39:20.000347 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 174/412] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:20.006331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0a643dd-ad7b-4b52-9dfe-6707ada8b57f tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Action: 'create', calling method: .version_select at 0x7f0c8bb56670>, body: {"pool": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:21.188355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7bbaa7b-4986-471b-993f-3de92f20c48b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502/action" status: 202 len: 0 microversion: 2.25 time: 3.298928 Sep 23 03:39:21.189184 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 239/413] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:39:17 2022] POST /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502/action => generated 0 bytes in 3300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:39:21.194592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f5c5443-10f4-4a02-b507-c686a678d61b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:21.207707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f5c5443-10f4-4a02-b507-c686a678d61b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/522952847" status: 200 len: 410 microversion: 2.1 time: 0.016825 Sep 23 03:39:21.213841 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 240/414] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 03:39:21 2022] GET /compute/v2.1/flavors/522952847 => generated 410 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:21.220479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:21.230492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:21.247465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:21.247975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:21.248420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:21.249150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:21.249639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:21.250076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.036530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:22.057928 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ff72d3c2-b2f7-4de2-a7a5-932976cd04ce tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1476 microversion: 2.1 time: 0.841447 Sep 23 03:39:22.058545 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 241/415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:21 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1476 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:22.290153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Calling method '.version_select at 0x7f0c8b71c5e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:22.291915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.292584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.293368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.324776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.325608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.328246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.345602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.352763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.353790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.367662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-146b4754-6490-4d72-9ba6-4bd7e10a1e86 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.306187 Sep 23 03:39:22.370405 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 242/416] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:22.382083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:22.385505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:22.400078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.401396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.402478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.403472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.404087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.404789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:22.876558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:22.895226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:22.898898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:22.901618 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4072754f-5290-4878-bc66-683fca9dfc3d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.526346 Sep 23 03:39:22.903267 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 243/417] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:22 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:22.948621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0a643dd-ad7b-4b52-9dfe-6707ada8b57f tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.946792 Sep 23 03:39:22.949292 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 175/418] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:39:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:22.954176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:22.976287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:22.978297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:22.978964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.011698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Creating event network-changed:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h1-858495-2 Sep 23 03:39:23.020701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:39:23.043895 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6d9cdd08-7838-4435-85f0-e71d124d7c46 req-b3ca44cb-e918-4383-99ba-b2736dedaccb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093119 Sep 23 03:39:23.045080 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 176/419] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:23.188577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7c8bfaf-b9f7-4960-a751-dd33a79c919e tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.218544 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7c8bfaf-b9f7-4960-a751-dd33a79c919e tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.311980 Sep 23 03:39:23.219319 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 244/420] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:22 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:23.227927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1b5d360-a877-4232-bbf9-61975da7f6f1 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Calling method '.version_select at 0x7f0c8bbb60d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.229212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-036989b3-e4d7-44de-8f15-19bd399ba6c9 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8b71c670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.230386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1b5d360-a877-4232-bbf9-61975da7f6f1 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '356b331aaf1942ef9d48ac3f7bda8904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0391547be34dbbb56cc76fcef74c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1b5d360-a877-4232-bbf9-61975da7f6f1 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Request method failure captured: Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/n-h1-858495-2/search HTTP/1.1 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpoINdE_FeKo0xz-1eb3ZX_gEuAQJvRp5JA0N_nl_PDMnXQ_4eL4nc6d0iRoITIwV9QcY0fb6_01nu0XGSMKNufpwLXedXhcnEcaEBRPhItsCNkLYyb_P7j6lUJPGJ3RlTONlSadp8mG5pBfrL_fOfUOSKusmQfFybZLgkOF2pzi6g Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 3e0391547be34dbbb56cc76fcef74c68 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:23.233799 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 3e0391547be34dbbb56cc76fcef74c68 Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474899873-project Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 356b331aaf1942ef9d48ac3f7bda8904 Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873-project Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 03:39:23.235142 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'n-h1-858495-2'} Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:23.235951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 03:39:23.237050 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.239355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1b5d360-a877-4232-bbf9-61975da7f6f1 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:23.240244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1b5d360-a877-4232-bbf9-61975da7f6f1 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858495-2/search" status: 403 len: 117 microversion: 2.1 time: 0.193116 Sep 23 03:39:23.240984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 177/421] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/os-hypervisors/n-h1-858495-2/search => generated 117 bytes in 195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:23.246414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.248010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:23.258701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.259392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.260034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.260850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.261633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.262105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.650231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:23.661185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e5cc1d2-fd4c-45e0-a921-f7b915f2477d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1474 microversion: 2.1 time: 0.417344 Sep 23 03:39:23.676733 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 178/422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1474 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:23.704216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41745a03-94e8-4392-9cd5-960926403fee tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.710011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:23.772196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41745a03-94e8-4392-9cd5-960926403fee tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/522952847" status: 202 len: 0 microversion: 2.1 time: 0.093582 Sep 23 03:39:23.772802 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 179/423] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:39:23 2022] DELETE /compute/v2.1/flavors/522952847 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:23.794780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Calling method '.version_select at 0x7f0c901358b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.799211 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-036989b3-e4d7-44de-8f15-19bd399ba6c9 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/1d884255-94a5-4573-a2dd-78cf405dc058" status: 200 len: 142 microversion: 2.1 time: 0.578779 Sep 23 03:39:23.799964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 245/424] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/os-floating-ips/1d884255-94a5-4573-a2dd-78cf405dc058 => generated 142 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:23.804563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-979dbf25-cc59-4db7-b209-d358a9785de3 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.807753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.808251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.808695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.841530 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Request method failure captured: Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpoThBVgY3xg9WyF3TLcHC-YYEVD83rXgZLCTtc1lQ2DnytoNWGf94S-U2jPHXszAdg_fEhdk-MqvmIn93dCh4FNhXXvT9JbiEYR4pvCcUxZTDikox7K9cBOy2mOSk7TfC0QlaD0odP8KQLvbzXIFjB4FOWhNEhyzaiYtbYqtZ30No Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f1a01745240a4a268c0e135bb5e53413 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:23.845494 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f1a01745240a4a268c0e135bb5e53413 Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d6debb42b79a4c788ff2673eda888e73 Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 03:39:23.847166 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:23.848429 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:23.850212 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:23.850212 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:23.850212 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:23.850212 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 03:39:23.850212 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:23.854504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:23.855589 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ceb2951-e685-46fd-9d87-16ac7e28defd tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.080026 Sep 23 03:39:23.860506 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 180/425] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:23.860663 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-979dbf25-cc59-4db7-b209-d358a9785de3 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.057816 Sep 23 03:39:23.862611 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 246/426] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:23.866645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f375a98f-9cb0-48fb-8af6-bec3df849ccc tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8bb23550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.880256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Calling method '.version_select at 0x7f0c8b7353a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:23.884192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.885008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.885566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.924973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.925795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.926474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.939246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:23.940094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:23.940727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:23.949368 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-975858ab-5cc2-4ee7-9ca3-5302f8eaaed3 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.083998 Sep 23 03:39:23.950719 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 247/427] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:23.965155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c04bb95-4645-4dd0-97db-3a0c64d807bd tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-485792070", "id": 1564623793, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:23.988259 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c04bb95-4645-4dd0-97db-3a0c64d807bd tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.036164 Sep 23 03:39:23.989561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 248/428] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:23 2022] POST /compute/v2.1/flavors => generated 429 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:23.999056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:24.004107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:24.020128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:24.020757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:24.021207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:24.022154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:24.022500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:24.023029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:24.696884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:24.706657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:24.716391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:24.720702 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aeb1600f-dda0-4313-9df6-fc37a98c6021 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.728772 Sep 23 03:39:24.721308 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 249/429] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:23 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:24.750073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f29965a-fc05-42a2-bf64-c7de07a7e869 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Calling method '.version_select at 0x7f0c8b71cf70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:24.752674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3f29965a-fc05-42a2-bf64-c7de07a7e869 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '356b331aaf1942ef9d48ac3f7bda8904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0391547be34dbbb56cc76fcef74c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f29965a-fc05-42a2-bf64-c7de07a7e869 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Request method failure captured: Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpoINdE_FeKo0xz-1eb3ZX_gEuAQJvRp5JA0N_nl_PDMnXQ_4eL4nc6d0iRoITIwV9QcY0fb6_01nu0XGSMKNufpwLXedXhcnEcaEBRPhItsCNkLYyb_P7j6lUJPGJ3RlTONlSadp8mG5pBfrL_fOfUOSKusmQfFybZLgkOF2pzi6g Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 3e0391547be34dbbb56cc76fcef74c68 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:24.755149 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0391547be34dbbb56cc76fcef74c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 3e0391547be34dbbb56cc76fcef74c68 Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873 Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474899873-project Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 356b331aaf1942ef9d48ac3f7bda8904 Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474899873-project Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 03:39:24.756583 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '1'} Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:24.757651 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 03:39:24.758987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.761656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f29965a-fc05-42a2-bf64-c7de07a7e869 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:24.762881 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f29965a-fc05-42a2-bf64-c7de07a7e869 tempest-HypervisorAdminNegativeUnderV252Test-474899873 tempest-HypervisorAdminNegativeUnderV252Test-474899873-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022644 Sep 23 03:39:24.763968 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 250/430] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:39:24 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:24.789287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a577b3cc-4a6b-4360-be7f-56c77277b2f8 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "1564623793"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:24.804939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a577b3cc-4a6b-4360-be7f-56c77277b2f8 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] HTTP exception thrown: Flavor 1564623793 could not be found. Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a577b3cc-4a6b-4360-be7f-56c77277b2f8 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Request method failure captured: Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 107 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpeU8em3Kexu_anJgzz22qkkTptoi7t0nuJ0lmWK_GEZxiUF4UN8-UMHKkvO0MTg6NaRuw01HSSWMiVR3iEag8_MC3spjZ5WDKJhqhik58PIllPs07nd9ivn1CfZe6R_XufSg8FA-LLOjt3DgGsDKeZ1LuQtPDD8oDh_ZvdVB7KT0k Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: af817257e58c4cb4bedd5e134a9cc864 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FlavorsAdminTestJSON-2106792006 Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:24.808612 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af817257e58c4cb4bedd5e134a9cc864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af817257e58c4cb4bedd5e134a9cc864"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af817257e58c4cb4bedd5e134a9cc864"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af817257e58c4cb4bedd5e134a9cc864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FlavorsAdminTestJSON-2106792006 Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: af817257e58c4cb4bedd5e134a9cc864 Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2106792006 Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FlavorsAdminTestJSON-2106792006-project Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 87199b05e36840a689edc8e16bd32211 Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FlavorsAdminTestJSON-2106792006-project Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "test", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "1564623793"}} Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:39:24.810065 n-d-858495-2 devstack@n-api.service[128724]: exception: Flavor 1564623793 could not be found. Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '1564623793'}}} Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1564623793 could not be found. Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.810973 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1564623793 could not be found. Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:24.813074 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:24.814476 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:24.814476 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:24.814476 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:24.814476 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1564623793 could not be found. Sep 23 03:39:24.814476 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:24.816380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a577b3cc-4a6b-4360-be7f-56c77277b2f8 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Returning 400 to user: Flavor 1564623793 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:24.817474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a577b3cc-4a6b-4360-be7f-56c77277b2f8 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.052124 Sep 23 03:39:24.818669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 251/431] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:24 2022] POST /compute/v2.1/servers => generated 81 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:39:24.824111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:24.826481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:24.834686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:24.835544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:24.836970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:24.837832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:24.838387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:24.838887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.274086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:25.288665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3afefeb-f250-4682-8339-34bb509e0c0a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1471 microversion: 2.1 time: 0.468683 Sep 23 03:39:25.289601 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 252/432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:24 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:25.303865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80824846-9527-4e64-a5af-ca2581e87502", "name": "network-vif-unplugged", "status": "completed", "tag": "c85a94f1-4c3c-434e-bf3f-f49d96102895"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:25.327856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.328335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.329999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.346379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] Creating event network-vif-unplugged:c85a94f1-4c3c-434e-bf3f-f49d96102895 for instance 80824846-9527-4e64-a5af-ca2581e87502 on n-h1-858495-2 Sep 23 03:39:25.351543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-dfe66c18-103a-4ace-a678-a9ddd57b408f req-4dca4e2e-e0ad-44b3-8ec0-63dfd8ef5888 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060552 Sep 23 03:39:25.352490 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 253/433] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:25.357726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Calling method '.version_select at 0x7f0c8b723d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:25.360257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.362408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.364304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.376638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] HTTP exception thrown: No hypervisor matching '730db28a-7463-4fe2-a19d-6f875ca08801' could be found. Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Request method failure captured: Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hypervisors/730db28a-7463-4fe2-a19d-6f875ca08801/servers HTTP/1.1 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpoThBVgY3xg9WyF3TLcHC-YYEVD83rXgZLCTtc1lQ2DnytoNWGf94S-U2jPHXszAdg_fEhdk-MqvmIn93dCh4FNhXXvT9JbiEYR4pvCcUxZTDikox7K9cBOy2mOSk7TfC0QlaD0odP8KQLvbzXIFjB4FOWhNEhyzaiYtbYqtZ30No Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f1a01745240a4a268c0e135bb5e53413 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:39:25.378435 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a01745240a4a268c0e135bb5e53413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f1a01745240a4a268c0e135bb5e53413 Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905 Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d6debb42b79a4c788ff2673eda888e73 Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: exception: No hypervisor matching '730db28a-7463-4fe2-a19d-6f875ca08801' could be found. Sep 23 03:39:25.380525 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '730db28a-7463-4fe2-a19d-6f875ca08801'} Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '730db28a-7463-4fe2-a19d-6f875ca08801' could be found. Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:25.381278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '730db28a-7463-4fe2-a19d-6f875ca08801' could be found. Sep 23 03:39:25.383065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:25.385309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] Returning 404 to user: No hypervisor matching '730db28a-7463-4fe2-a19d-6f875ca08801' could be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:25.386917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fdcbfb7f-f8ae-4535-b7f9-c6c1f9e57c55 tempest-HypervisorAdminNegativeUnderV252Test-860154905 tempest-HypervisorAdminNegativeUnderV252Test-860154905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/730db28a-7463-4fe2-a19d-6f875ca08801/servers" status: 404 len: 123 microversion: 2.1 time: 0.032903 Sep 23 03:39:25.388557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 254/434] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Sep 23 03:39:25 2022] GET /compute/v2.1/os-hypervisors/730db28a-7463-4fe2-a19d-6f875ca08801/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:25.400943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b432a92b-a0e8-4794-b14e-8b8e1ad1ff6c tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:25.429783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b432a92b-a0e8-4794-b14e-8b8e1ad1ff6c tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1564623793" status: 202 len: 0 microversion: 2.1 time: 0.039893 Sep 23 03:39:25.431998 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 255/435] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:39:25 2022] DELETE /compute/v2.1/flavors/1564623793 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:25.443770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:25.445219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:25.478699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.479413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.480031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.480923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.481583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.482742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.542519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:25.575691 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6875303-0e61-49e7-9f1f-ed0ee5877fa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8/action" status: 204 len: 0 microversion: 2.1 time: 0.140146 Sep 23 03:39:25.576973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 256/436] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:39:25 2022] POST /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8/action => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:39:25.583014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e322be5-4b91-4ddd-a8f0-fa739539c7cc tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:25.608456 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e322be5-4b91-4ddd-a8f0-fa739539c7cc tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029641 Sep 23 03:39:25.609968 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 257/437] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:25.614882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:25.615729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:25.621816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.624942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.626009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:25.626943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:25.627867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:25.628506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:26.058321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:26.068973 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3925e9bb-32b7-4d7f-b98b-76f33d793b1b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1471 microversion: 2.1 time: 0.457715 Sep 23 03:39:26.071827 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 258/438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:25 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:26.084461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b763d8c-6de3-4eef-a472-89eedc0bed74 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2052586239", "id": 699213587, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:26.115569 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b763d8c-6de3-4eef-a472-89eedc0bed74 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.042151 Sep 23 03:39:26.119350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 259/439] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:26.136453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:26.137510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:26.154219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:26.156015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:26.157086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:26.157900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:26.158368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:26.158809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:26.223341 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f375a98f-9cb0-48fb-8af6-bec3df849ccc tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/1d884255-94a5-4573-a2dd-78cf405dc058" status: 202 len: 0 microversion: 2.1 time: 2.361112 Sep 23 03:39:26.224179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 181/440] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:39:23 2022] DELETE /compute/v2.1/os-floating-ips/1d884255-94a5-4573-a2dd-78cf405dc058 => generated 0 bytes in 2363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:26.235134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c994686-b11c-468e-8186-6ab926104f8b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1464919697", "id": 234032339, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:26.276626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c994686-b11c-468e-8186-6ab926104f8b tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044228 Sep 23 03:39:26.285664 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 182/441] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:26 2022] POST /compute/v2.1/flavors => generated 411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:26.291678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-476494df-8eee-42f0-81d0-6323b7dca4ee tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8bac3f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:26.660480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-476494df-8eee-42f0-81d0-6323b7dca4ee tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.370142 Sep 23 03:39:26.660480 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 183/442] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Sep 23 03:39:26 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:26.675788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95ecf138-5d39-4b2f-b62a-07a3b424a0e8 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:26.735491 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95ecf138-5d39-4b2f-b62a-07a3b424a0e8 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.074294 Sep 23 03:39:26.736111 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 184/443] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Sep 23 03:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:26.759859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d8e054e-d82c-4d77-bb28-ecf73d4c7a22 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8bac3430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:27.103472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:27.120964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:27.125892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:27.129692 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8b890e3-f874-4210-a75d-fd40341c586b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 1.008484 Sep 23 03:39:27.133165 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 260/444] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:26 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:27.152671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dedeabb9-19f5-4e30-be5a-83610f98c61e tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:27.162345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:27.210481 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dedeabb9-19f5-4e30-be5a-83610f98c61e tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.075065 Sep 23 03:39:27.211162 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 261/445] 10.222.0.25 () {58 vars in 1177 bytes} [Fri Sep 23 03:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:27.215830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:27.216421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:27.239640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:27.240151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:27.240593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:27.241314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:27.246094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:27.247034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:27.273606 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d8e054e-d82c-4d77-bb28-ecf73d4c7a22 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.523563 Sep 23 03:39:27.274397 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 185/446] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:39:26 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:27.290698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75ad4c98-6fa2-4ec9-b881-10dad195f258 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:27.327077 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75ad4c98-6fa2-4ec9-b881-10dad195f258 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.048933 Sep 23 03:39:27.330225 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 186/447] 10.222.0.25 () {58 vars in 1171 bytes} [Fri Sep 23 03:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:27.343812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e616461-a6e0-44ba-b742-2591dedcc5b3 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8bbab8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:27.833957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:28.034507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:28.045586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89c46dd9-a88d-4927-830d-1c0cb17fc11e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1471 microversion: 2.1 time: 0.833331 Sep 23 03:39:28.046725 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 262/448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:27 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1471 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:28.062604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fc19b69-2931-4d8b-abba-446d2d87a381 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:28.085735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fc19b69-2931-4d8b-abba-446d2d87a381 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.035125 Sep 23 03:39:28.088851 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 263/449] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Sep 23 03:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:28.099623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80824846-9527-4e64-a5af-ca2581e87502", "tag": "c85a94f1-4c3c-434e-bf3f-f49d96102895"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:28.123129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:28.126178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:28.127895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:28.158444 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] Creating event network-changed:c85a94f1-4c3c-434e-bf3f-f49d96102895 for instance 80824846-9527-4e64-a5af-ca2581e87502 on n-h1-858495-2 Sep 23 03:39:28.198551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ac013e2e-d865-48a5-bb55-3acb84ea6097 req-0366ea56-1b2c-4a7e-94a3-500d84c5d242 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106357 Sep 23 03:39:28.202343 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 264/450] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:28.209183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c5ccbde-04c8-4fbf-afbd-933d68c318fb tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:28.259071 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c5ccbde-04c8-4fbf-afbd-933d68c318fb tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6220 microversion: 2.1 time: 0.054046 Sep 23 03:39:28.261066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 265/451] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Sep 23 03:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6220 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:28.272309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:28.273772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:28.285497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:28.286726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:28.288046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:28.289010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:28.289911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:28.290613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:28.619290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:28.633206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:28.640061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:28.643349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-629e3c22-cc52-469e-8fcb-cc549e7bc927 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.380566 Sep 23 03:39:28.648374 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 266/452] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:28 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:28.869394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1438636530", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:28.965096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:29.189677 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e616461-a6e0-44ba-b742-2591dedcc5b3 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/093839dc-616c-4bf4-bcf6-b251c460396a" status: 202 len: 0 microversion: 2.1 time: 1.857250 Sep 23 03:39:29.192484 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 187/453] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:39:27 2022] DELETE /compute/v2.1/os-floating-ips/093839dc-616c-4bf4-bcf6-b251c460396a => generated 0 bytes in 1861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:29.201100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b4159e3-bebb-405a-8836-6fb55f9e8dd9 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:29.258278 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b4159e3-bebb-405a-8836-6fb55f9e8dd9 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6220 microversion: 2.1 time: 0.062511 Sep 23 03:39:29.261188 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 188/454] 10.222.0.25 () {58 vars in 1175 bytes} [Fri Sep 23 03:39:29 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6220 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:29.267566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "name": "network-vif-plugged", "status": "completed", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:29.281439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.282201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.282971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.299244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] Creating event network-vif-plugged:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h1-858495-2 Sep 23 03:39:29.306844 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-466e16df-0358-4be9-b4ef-5c105357d791 req-f5f251a2-b7ac-4657-96c8-f1c5d4f6bf8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043761 Sep 23 03:39:29.308571 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 189/455] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:29.314750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:29.315717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:29.323580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.324281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.324902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.325791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.326401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.326984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.544321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:29.544884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:29.545221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:29.545659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:29.546261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:29.561771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.562847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.565807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.569784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.570452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.571174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.608585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Getting quotas for project 47018162001a4ff299b57c1a7ba58f39. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:29.621855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Getting quotas for user 9f7b47ab46f84b01866c48e5bd9892f3 and project 47018162001a4ff299b57c1a7ba58f39. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:29.636456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:29.640445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:29.695092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:29.707014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-48684437-9522-49ee-8b89-eaf8da96813e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056784 Sep 23 03:39:29.708157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 267/456] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:29.713070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f74db6c-615a-476b-87bd-cb5e1cb0cd79 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8b69a160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:29.726536 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-337d84a9-0c6f-426b-97ac-4da50651175f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1463 microversion: 2.1 time: 0.416395 Sep 23 03:39:29.727139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 190/457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:29 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1463 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:29.746155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-354791da-128b-45aa-bf42-cf6999b005c1 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:29.840252 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-354791da-128b-45aa-bf42-cf6999b005c1 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6220 microversion: 2.1 time: 0.111257 Sep 23 03:39:29.844685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 191/458] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Sep 23 03:39:29 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:29.852470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:29.854802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:29.868430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.869707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.870429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:29.871368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:29.872036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:29.872700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:30.313905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:30.325054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:30.334727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:30.343899 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fbca737f-06fa-48d4-baa7-9e47049779a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.497268 Sep 23 03:39:30.357339 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 192/459] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:29 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:30.368407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2331a57-bc53-4822-9375-4a7a86d2b047 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:30.369234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2331a57-bc53-4822-9375-4a7a86d2b047 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:30.674867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2331a57-bc53-4822-9375-4a7a86d2b047 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:30.688023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2331a57-bc53-4822-9375-4a7a86d2b047 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1222 microversion: 2.1 time: 0.322042 Sep 23 03:39:30.689891 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 193/460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:30 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1222 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:30.707180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:30.708029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:30.724326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:30.725425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:30.725996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:30.726963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:30.727693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:30.728445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:31.338204 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f597c2de-1a6f-45db-896b-b6d95c534186 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1614 microversion: 2.1 time: 0.645265 Sep 23 03:39:31.342951 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 194/461] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:30 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1614 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:31.371601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-192ba544-0db0-4e45-8b66-abd1bfe69342 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:31.427750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-192ba544-0db0-4e45-8b66-abd1bfe69342 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6220 microversion: 2.1 time: 0.063536 Sep 23 03:39:31.428979 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 195/462] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Sep 23 03:39:31 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6220 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:31.435385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07726024-febc-4ffc-b782-6cd8a156b91c tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '.version_select at 0x7f0c8bb66550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:31.450874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07726024-febc-4ffc-b782-6cd8a156b91c tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:31.451631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07726024-febc-4ffc-b782-6cd8a156b91c tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:31.452454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07726024-febc-4ffc-b782-6cd8a156b91c tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:31.479040 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07726024-febc-4ffc-b782-6cd8a156b91c tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.047434 Sep 23 03:39:31.481849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 196/463] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:39:31 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:31.491773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:31.492758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:31.512185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:31.513212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:31.516247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:31.517279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:31.518949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:31.520384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:31.829816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:31.846316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:31.850671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:31.856891 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d45b9485-c8c2-418e-baa9-8792cce479f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.372206 Sep 23 03:39:31.858047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 197/464] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:31 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:31.869835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0717fa6a-1501-4025-8f69-0f173471537d tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:31.905055 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0717fa6a-1501-4025-8f69-0f173471537d tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/234032339" status: 202 len: 0 microversion: 2.1 time: 0.045595 Sep 23 03:39:31.905669 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 198/465] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:39:31 2022] DELETE /compute/v2.1/flavors/234032339 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:31.921319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:31.922744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:31.939606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:31.940112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:31.941690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:31.944856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:31.945760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:31.949603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:32.099661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:32.116605 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8dd3c9a0-aaaa-4568-9074-96c7b6ec4740 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1274 microversion: 2.1 time: 0.209545 Sep 23 03:39:32.116913 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 199/466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:31 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:32.123961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f74db6c-615a-476b-87bd-cb5e1cb0cd79 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/8dad7e58-0c3f-4792-8e26-931846e5804b" status: 202 len: 0 microversion: 2.1 time: 2.414582 Sep 23 03:39:32.124554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 268/467] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:39:29 2022] DELETE /compute/v2.1/os-floating-ips/8dad7e58-0c3f-4792-8e26-931846e5804b => generated 0 bytes in 2416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:32.130479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-673c30ee-5718-41d0-873a-59fb086e7578 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:32.134945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2060841259", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:32.176631 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-673c30ee-5718-41d0-873a-59fb086e7578 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.050653 Sep 23 03:39:32.181978 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 269/468] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:32.247279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:32.434390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b412da80-04f8-4b09-bdf7-14ed8e9b37b6 tempest-InstanceUsageAuditLogTestJSON-439875882 tempest-InstanceUsageAuditLogTestJSON-439875882-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:32.482978 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b412da80-04f8-4b09-bdf7-14ed8e9b37b6 tempest-InstanceUsageAuditLogTestJSON-439875882 tempest-InstanceUsageAuditLogTestJSON-439875882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23 03:39:32" status: 200 len: 318 microversion: 2.1 time: 0.299800 Sep 23 03:39:32.483822 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 270/469] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 03:39:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2003%3A39%3A32 => generated 318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:32.489252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3a4ce345-aa5b-41b3-a430-dbc4dcbb3212 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] Calling method '.version_select at 0x7f0c8b735ee0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:33.056721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:33.057822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:33.058730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:33.059372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:33.060343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:33.079094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:33.080807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:33.082379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:33.084737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:33.085334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:33.089205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:33.137533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:33.153747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:33.175832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:33.178216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:33.231231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21bbcee1-7543-40fe-a112-16df7d7bc0bc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100543 Sep 23 03:39:33.232705 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 200/470] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:33.237723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f445f3d3-8639-4394-bd30-0e6b665f95ac tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:33.273078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f445f3d3-8639-4394-bd30-0e6b665f95ac tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/699213587" status: 202 len: 0 microversion: 2.1 time: 0.037694 Sep 23 03:39:33.274398 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 201/471] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:39:33 2022] DELETE /compute/v2.1/flavors/699213587 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:33.293424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67e4ce1a-a9bb-496c-b3f0-b42a1f69776a tempest-InstanceUsageAuditLogTestJSON-439875882 tempest-InstanceUsageAuditLogTestJSON-439875882-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:33.342565 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67e4ce1a-a9bb-496c-b3f0-b42a1f69776a tempest-InstanceUsageAuditLogTestJSON-439875882 tempest-InstanceUsageAuditLogTestJSON-439875882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.062076 Sep 23 03:39:33.352606 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 202/472] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:39:33 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:33.352606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:33.352606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:33.370304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:33.372163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:33.372696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:33.375385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:33.375892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:33.380486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:34.007311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:34.029057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:34.033182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:34.037198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb6a7c94-3e23-4d2a-bb45-647a91f9e4a4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.692169 Sep 23 03:39:34.039951 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 203/473] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:33 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:34.046618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.047465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:34.058876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:34.059832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:34.059832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:34.061310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:34.061533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:34.067176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:34.248099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:34.260129 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc08f2f1-cd41-4fde-bbfe-e9595e58346c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1280 microversion: 2.1 time: 0.219006 Sep 23 03:39:34.260968 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 204/474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:34.273141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.274071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:34.290585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:34.292116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:34.294325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:34.295292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:34.296719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:34.299508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:34.492107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:34.509646 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-081aad62-1ac8-4079-a257-2044b05ec807 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1209 microversion: 2.1 time: 0.246953 Sep 23 03:39:34.512876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 205/475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1209 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:34.543255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b9ed8fb-dabb-46d1-8f41-d1f112ef53ca tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.577661 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b9ed8fb-dabb-46d1-8f41-d1f112ef53ca tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.062974 Sep 23 03:39:34.590793 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 206/476] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:34.605109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d7e2afb-92fb-4b9e-8582-5e51b5caded4 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2075525157", "id": 1708865206, "os-flavor-access:is_public": "False"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:34.644880 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d7e2afb-92fb-4b9e-8582-5e51b5caded4 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.045637 Sep 23 03:39:34.645504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 207/477] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:34 2022] POST /compute/v2.1/flavors => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:34.662061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c01f259-f177-4b15-a62a-4a2102571cea tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.703364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c01f259-f177-4b15-a62a-4a2102571cea tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.049170 Sep 23 03:39:34.704006 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 208/478] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:34.727469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82cad50b-dbbe-4228-8d6d-7e037a95bfa0 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.786145 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-82cad50b-dbbe-4228-8d6d-7e037a95bfa0 tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.037941 Sep 23 03:39:34.788075 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 209/479] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:34.809098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-499b4e56-f39f-4e13-8b70-5af01b1a8aca tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.846309 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-499b4e56-f39f-4e13-8b70-5af01b1a8aca tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1708865206" status: 202 len: 0 microversion: 2.1 time: 0.044719 Sep 23 03:39:34.850967 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 210/480] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:39:34 2022] DELETE /compute/v2.1/flavors/1708865206 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:34.864400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c89a275-ef21-4bc7-af45-6caf0713b641 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:34.925703 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c89a275-ef21-4bc7-af45-6caf0713b641 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.073442 Sep 23 03:39:34.927404 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 211/481] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:34 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:34.952881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2db78556-dc45-44e7-ab64-0fb01aebc60f tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-523666751", "id": 304475090, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:35.011350 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2db78556-dc45-44e7-ab64-0fb01aebc60f tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.063797 Sep 23 03:39:35.026218 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 212/482] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:34 2022] POST /compute/v2.1/flavors => generated 410 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:35.039880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-708316c9-a2ee-4831-b15e-aef467bd7fba tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:35.104613 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3a4ce345-aa5b-41b3-a430-dbc4dcbb3212 tempest-FloatingIPDetailsTestJSON-2052574841 tempest-FloatingIPDetailsTestJSON-2052574841-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/f57757df-cb4f-4314-98b4-99d23412b37d" status: 202 len: 0 microversion: 2.1 time: 2.619513 Sep 23 03:39:35.111236 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 271/483] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:39:32 2022] DELETE /compute/v2.1/os-floating-ips/f57757df-cb4f-4314-98b4-99d23412b37d => generated 0 bytes in 2627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:35.121914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:35.122759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:35.154051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:35.160287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:35.161098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:35.162114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:35.163113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:35.163966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-708316c9-a2ee-4831-b15e-aef467bd7fba tempest-FlavorsAdminTestJSON-2106792006 tempest-FlavorsAdminTestJSON-2106792006-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.123752 Sep 23 03:39:35.167320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 213/484] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:35 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:35.167980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:35.198053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81472e42-659d-4dd8-a8cd-b48de4ddd245 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:35.212908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:35.300680 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81472e42-659d-4dd8-a8cd-b48de4ddd245 tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/304475090" status: 202 len: 0 microversion: 2.1 time: 0.109756 Sep 23 03:39:35.301694 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 214/485] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:39:35 2022] DELETE /compute/v2.1/flavors/304475090 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:35.326870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:35.333678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:35.370450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:35.376692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:35.377486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:35.378985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:35.379644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:35.380221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:36.346274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:36.360698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:36.363593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:36.377026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:36.388687 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e37a7f4b-7632-411f-82f5-a9140ad9f7e1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 1.084746 Sep 23 03:39:36.390096 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9203acd6-41a4-4095-a498-cbbf390d1854 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 1.277550 Sep 23 03:39:36.410865 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 272/486] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:35 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:36.415899 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 215/487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:35 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:36.421614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:36.430306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:36.438027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1039e00-e4b4-4905-8128-82ed1e873bfa tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:36.442999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:36.443754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:36.444367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:36.445481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:36.446092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:36.448004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:36.494599 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1039e00-e4b4-4905-8128-82ed1e873bfa tempest-FlavorsAdminTestJSON-1410093147 tempest-FlavorsAdminTestJSON-1410093147-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.080478 Sep 23 03:39:36.496040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 273/488] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:36 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:36.645919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:36.657867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0e9b9e6-fcb4-4164-b304-f23ace818b8b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1271 microversion: 2.1 time: 0.240452 Sep 23 03:39:36.658433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 216/489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:36 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:37.424092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:37.424795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:37.429897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:37.430508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:37.439178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:37.440133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:37.440681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:37.440923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:37.441246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:37.441392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:37.442008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:37.442122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:37.442459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:37.442894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:37.446587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:37.447086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:37.455910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:38.076366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:38.094238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:38.095699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:38.097475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db76b0f6-94e9-4dba-8960-c83073577679 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1567 microversion: 2.25 time: 0.672342 Sep 23 03:39:38.098043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 217/490] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:37 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1567 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:39:38.121073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:38.131220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea9838c5-cd22-4dd6-bcbd-0ab03b3e825c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.711900 Sep 23 03:39:38.132360 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 274/491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:37 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:38.137855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:38.138828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:38.145953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:38.146660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:38.148709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:38.149664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:38.150553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:38.151269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:38.599382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-400859429", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a1aece03-8cc5-4dd7-a1d8-55f60f30a37a"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:38.694619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] validate_networks() for [('a1aece03-8cc5-4dd7-a1d8-55f60f30a37a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:39.124807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:39.139482 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9c8f57d-d772-4e44-818b-30d64ad56916 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 1.005867 Sep 23 03:39:39.158023 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 275/492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:38 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:39.167231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:39.170756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:39.177819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:39.179089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:39.179692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:39.180573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:39.181186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:39.182182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:39.594653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:39.947609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:39.964538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:40.011685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:40.018203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-70b79c8e-b860-48cf-a4c6-c9dc42042e57 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1557 microversion: 2.25 time: 0.856987 Sep 23 03:39:40.029997 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 276/493] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:39 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1557 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:40.034882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:40.043809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:40.074834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.076470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.079064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.085248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.087160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.089796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.652171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:40.665790 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-606ecf55-f153-4586-901f-ace6ad6c5154 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.642552 Sep 23 03:39:40.666657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 277/494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:40 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:40.671028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2789bf-6e16-4bd6-8943-6128aef2e33d", "tag": "7232efb7-1806-4fa1-ade3-f3a8d499ebe3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:40.689031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.689800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.690244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.702150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] Creating event network-changed:7232efb7-1806-4fa1-ade3-f3a8d499ebe3 for instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d on n-h2-858495-2 Sep 23 03:39:40.707485 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-48340e2f-223a-4bc1-bc1a-a46f8a4da88d req-1c6ec916-03f5-4fcd-b7f5-9f4f3fed7c98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 Sep 23 03:39:40.708093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 278/495] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:40.713496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d6cc8b-acac-49a5-a872-07e776dccc70", "tag": "d4811bc1-dad1-45e7-b932-16ece79a1dd4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:40.725266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.726015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.726658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.739014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] Creating event network-changed:d4811bc1-dad1-45e7-b932-16ece79a1dd4 for instance 50d6cc8b-acac-49a5-a872-07e776dccc70 on n-h1-858495-2 Sep 23 03:39:40.743904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b6908872-0de9-497b-b08a-3edcab121a89 req-bfa7e531-ccb1-4443-8c3c-37dd91791cf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034302 Sep 23 03:39:40.744509 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 279/496] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:40.749614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1242c53-ea22-4965-83e9-81856ddacd65 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '.version_select at 0x7f0c8b8a1ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:40.753507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1242c53-ea22-4965-83e9-81856ddacd65 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.754077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1242c53-ea22-4965-83e9-81856ddacd65 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.754583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1242c53-ea22-4965-83e9-81856ddacd65 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.766101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1242c53-ea22-4965-83e9-81856ddacd65 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 860 microversion: 2.25 time: 0.020080 Sep 23 03:39:40.766701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 280/497] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Sep 23 03:39:40 2022] GET /compute/v2.1/os-migrations => generated 860 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:39:40.771700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:40.773120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:40.781580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.782817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.783511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:40.784987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:40.786372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:40.786894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.055241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:41.055742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:41.056131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:41.056532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:41.056942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:41.071656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.074674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.075132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.075900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.076363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.076784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.113451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:41.120452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for user 27045855dd484c7fbcbb75721afdcc9a and project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:41.151134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:41.154943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:41.245639 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d944cef3-2076-4320-8df3-3195c0ad79fc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.141008 Sep 23 03:39:41.246273 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 218/498] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:41.284943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:41.313239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97cb834b-a245-4c78-890c-0705e6a39897 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.545135 Sep 23 03:39:41.316225 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 281/499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:40 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:41.333503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:41.334952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:41.351965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.352690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.356637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.357835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.358237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.358675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.654150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-854762757", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:41.741431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 80824846-9527-4e64-a5af-ca2581e87502 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:39:41.759563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:41.763072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-333eb099-3865-4327-9259-654940356a8a tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 2050 microversion: 2.25 time: 0.443171 Sep 23 03:39:41.771115 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 282/500] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:41 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 2050 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:41.780750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ff97f56-7313-47b1-81da-62476c7c567a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:41.782023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ff97f56-7313-47b1-81da-62476c7c567a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:41.927472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ff97f56-7313-47b1-81da-62476c7c567a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:41.938067 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ff97f56-7313-47b1-81da-62476c7c567a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1210 microversion: 2.1 time: 0.165437 Sep 23 03:39:41.956501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 283/501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:41 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:41.965676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:41.969538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:41.984704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.987977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.988616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:41.989587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:41.993700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:41.994319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.209549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:42.210151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:42.211178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:42.211794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:42.212532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:42.227730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.229191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.229900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.231109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.231821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.232659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.247735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:42.255989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Getting quotas for project c098c592d846492e80f8a2d4e6386028. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:42.263230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Getting quotas for user 49cf4988421d4b27b0b55fa08cbf4360 and project c098c592d846492e80f8a2d4e6386028. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:42.263943 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c80060cc-77fc-4432-ac2a-7a50ef4ae94d tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.305493 Sep 23 03:39:42.278890 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 284/502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:41 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:42.279870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:42.287254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-790633806", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "6f121f7c-6b72-46a2-9bbd-ba5658c47c71"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:42.287456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:42.362239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ced476f5-97a6-4a29-8df5-08b4b0966065 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109917 Sep 23 03:39:42.362653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] validate_networks() for [('6f121f7c-6b72-46a2-9bbd-ba5658c47c71', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:42.368770 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 219/503] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:42.380452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:42.381402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:42.405694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.406374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.406867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.407710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.408188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.408669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.745166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:42.761677 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-78fd2bef-3f7f-4c4f-97cb-9806a01a9361 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.392531 Sep 23 03:39:42.762325 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 220/504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:42 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:42.787152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae841111-b47b-4ef8-b952-6c2cc0b095a6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:42.788193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae841111-b47b-4ef8-b952-6c2cc0b095a6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:42.872157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ae841111-b47b-4ef8-b952-6c2cc0b095a6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:42.881208 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae841111-b47b-4ef8-b952-6c2cc0b095a6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1213 microversion: 2.1 time: 0.101915 Sep 23 03:39:42.882385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 221/505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:42 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:42.964996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:42.966299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:42.978840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.983349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.984173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:42.987846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:42.988969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:42.991131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.208121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:43.223280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8cb7976d-b737-42ab-ba7f-ec22890d0fc0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1270 microversion: 2.1 time: 0.261093 Sep 23 03:39:43.229639 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 222/506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:42 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:43.295605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:43.296467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:43.303838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:43.304341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:43.304773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:43.305195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:43.305420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.305650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:43.306269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.306895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.307910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.308594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.309401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.319368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.320526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.320991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.322033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.322536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.323171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.349021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:43.353611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for user 9855cf6129a34302a7e3e39d6a15a345 and project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:43.368210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:43.386148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:43.474134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:43.484029 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d858fb9-0e2d-4117-b7df-9d79ab09ce62 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.192817 Sep 23 03:39:43.485141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 223/507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:43 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:43.494952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5955ca9c-e7aa-4221-9c1f-71951fafe5dd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.214663 Sep 23 03:39:43.503640 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 285/508] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:39:43.510117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:43.511171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:43.600035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:43.612712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:43.614014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:43.616431 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1c02971-930f-4881-ad59-d543029c66ab tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1261 microversion: 2.25 time: 0.110728 Sep 23 03:39:43.624605 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 286/509] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:43 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:43.795265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Calling method '.version_select at 0x7f0c8baed3a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:43.795588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:43.798823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:43.806426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.809019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.811937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.816229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.818503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.821948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.829233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.835435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.836606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.840088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.842365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.846240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.943984 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b36967fd-6512-4b57-b010-36d37dd4039d tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.454010 Sep 23 03:39:43.944613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 224/510] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:39:43 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:43.955786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:43.956619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:43.963709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.964653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.965263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:43.966996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:43.967629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:43.968207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.081487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.107465 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3aa1c02b-e9a3-4979-8204-2ef6d6e2ca49 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1209 microversion: 2.1 time: 0.160985 Sep 23 03:39:44.108059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 225/511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:43 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:44.329167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.339100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e824a7b-9b73-4519-990b-0f3f05110c8f tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Calling method '.version_select at 0x7f0c8ba83e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.340785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a860a3b-991e-4687-a4ba-359503b646d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.558713 Sep 23 03:39:44.343819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1e824a7b-9b73-4519-990b-0f3f05110c8f tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.344241 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 287/512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:43 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e824a7b-9b73-4519-990b-0f3f05110c8f tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:44.354653 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: action_args: {} Sep 23 03:39:44.356031 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:44.356836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 03:39:44.358038 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.359143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.359143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:44.360909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e824a7b-9b73-4519-990b-0f3f05110c8f tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.361997 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e824a7b-9b73-4519-990b-0f3f05110c8f tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.252889 Sep 23 03:39:44.362611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 226/513] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:44.370697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.371196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.372592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-670c06ba-6c00-490d-ae61-844a3ace5ce7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Calling method '.version_select at 0x7f0c8bac3820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.375170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.375908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-670c06ba-6c00-490d-ae61-844a3ace5ce7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.376052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.378333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.378791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-670c06ba-6c00-490d-ae61-844a3ace5ce7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/n-d-858495-2/reboot HTTP/1.1 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:44.381546 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'n-d-858495-2'} Sep 23 03:39:44.382814 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:44.383548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 03:39:44.384730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.387303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-670c06ba-6c00-490d-ae61-844a3ace5ce7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.388808 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-670c06ba-6c00-490d-ae61-844a3ace5ce7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858495-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.020925 Sep 23 03:39:44.395783 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 227/514] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts/n-d-858495-2/reboot => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:39:44.406071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98a4ae32-acb9-4658-8491-adbaa2c186bd tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Calling method '.version_select at 0x7f0c8bac3ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.416269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:44.440770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-98a4ae32-acb9-4658-8491-adbaa2c186bd tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98a4ae32-acb9-4658-8491-adbaa2c186bd tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:44.442901 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'nonexistent_hostname'} Sep 23 03:39:44.444188 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:39:44.445020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 03:39:44.446153 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.447207 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.449655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98a4ae32-acb9-4658-8491-adbaa2c186bd tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.451518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98a4ae32-acb9-4658-8491-adbaa2c186bd tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.054272 Sep 23 03:39:44.452322 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 228/515] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:39:44.468125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6417b763-0a3d-4c73-a338-fd0cd5ee2569 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Calling method '.version_select at 0x7f0c8ba839d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.470837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6417b763-0a3d-4c73-a338-fd0cd5ee2569 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6417b763-0a3d-4c73-a338-fd0cd5ee2569 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/n-d-858495-2 HTTP/1.1 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:44.474588 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'n-d-858495-2'} Sep 23 03:39:44.476003 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:44.476762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 03:39:44.478048 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.489851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6417b763-0a3d-4c73-a338-fd0cd5ee2569 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.490900 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6417b763-0a3d-4c73-a338-fd0cd5ee2569 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858495-2" status: 403 len: 109 microversion: 2.1 time: 0.027367 Sep 23 03:39:44.493800 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 229/516] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts/n-d-858495-2 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:39:44.500494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87153bfe-24b9-4413-ba5e-ddd8b489f9b2 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Calling method '.version_select at 0x7f0c8bab9550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.517386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-87153bfe-24b9-4413-ba5e-ddd8b489f9b2 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87153bfe-24b9-4413-ba5e-ddd8b489f9b2 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:44.524099 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'nonexistent_hostname'} Sep 23 03:39:44.525976 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.526874 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:44.528186 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.529436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87153bfe-24b9-4413-ba5e-ddd8b489f9b2 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.529436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87153bfe-24b9-4413-ba5e-ddd8b489f9b2 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031264 Sep 23 03:39:44.529436 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 230/517] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:39:44.540226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.541045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:44.549502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.550489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.551116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.553341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.554140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.555555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.584428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.594966 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bdff1044-5dc3-4a3a-8f3f-cb5f75f57fce tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1268 microversion: 2.1 time: 0.249631 Sep 23 03:39:44.595560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 288/518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:44.611344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3caff8f-f3a1-460b-b56e-68f37b1eaa17 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Calling method '.version_select at 0x7f0c8b673550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.613809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3caff8f-f3a1-460b-b56e-68f37b1eaa17 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3caff8f-f3a1-460b-b56e-68f37b1eaa17 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hosts/n-d-858495-2/shutdown HTTP/1.1 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:44.617524 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'n-d-858495-2'} Sep 23 03:39:44.619512 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:44.620521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 03:39:44.621662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:44.623172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3caff8f-f3a1-460b-b56e-68f37b1eaa17 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:44.627504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3caff8f-f3a1-460b-b56e-68f37b1eaa17 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858495-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.025041 Sep 23 03:39:44.635752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 289/519] 10.222.0.25 () {58 vars in 1194 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/os-hosts/n-d-858495-2/shutdown => generated 113 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:44.645843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:44.646863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:44.655073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.655950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.656866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:44.658099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:44.658876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:44.660143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.198633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.206796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.208286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.222321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a190177b-a697-4660-9111-5dcd09fbb4c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1257 microversion: 2.25 time: 0.570282 Sep 23 03:39:45.222620 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 290/520] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1257 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:45.229927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76dff66f-7ef4-424d-a17b-889033773e9b tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Calling method '.version_select at 0x7f0c8b6193a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.256250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.258591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-76dff66f-7ef4-424d-a17b-889033773e9b tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76dff66f-7ef4-424d-a17b-889033773e9b tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:39:45.260400 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'nonexistent_hostname'} Sep 23 03:39:45.261915 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:39:45.262864 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 03:39:45.264153 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.265687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.268455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76dff66f-7ef4-424d-a17b-889033773e9b tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.269892 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76dff66f-7ef4-424d-a17b-889033773e9b tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.046239 Sep 23 03:39:45.270071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8075e27-7ff8-4700-8ab7-4e61ed4cd27e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.734380 Sep 23 03:39:45.271123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 231/521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:44 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:45.282264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 291/522] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:39:45.284916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.289982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:45.299169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3185b400-eacf-4b06-93d7-149cc9d249e7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Calling method '.version_select at 0x7f0c8baed940>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.301690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3185b400-eacf-4b06-93d7-149cc9d249e7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.306932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.307435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.307869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.308573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.309025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3185b400-eacf-4b06-93d7-149cc9d249e7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/n-d-858495-2/startup HTTP/1.1 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:39:45.310638 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'n-d-858495-2'} Sep 23 03:39:45.311876 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:45.312623 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 03:39:45.313719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.314678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3185b400-eacf-4b06-93d7-149cc9d249e7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.314678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3185b400-eacf-4b06-93d7-149cc9d249e7 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858495-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.023777 Sep 23 03:39:45.314809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.314893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 232/523] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/os-hosts/n-d-858495-2/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:45.324025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f15ae6c9-0d51-4a73-9925-254206739d39 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Calling method '.version_select at 0x7f0c8bab9040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.340047 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f15ae6c9-0d51-4a73-9925-254206739d39 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f15ae6c9-0d51-4a73-9925-254206739d39 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:45.343551 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'nonexistent_hostname'} Sep 23 03:39:45.344816 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:39:45.345569 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 03:39:45.347158 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.348397 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.349315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f15ae6c9-0d51-4a73-9925-254206739d39 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.350180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f15ae6c9-0d51-4a73-9925-254206739d39 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030396 Sep 23 03:39:45.350740 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 233/524] 10.222.0.25 () {58 vars in 1215 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:39:45.365980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b22202d-e315-42ea-9e7c-4355ef2ae55f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8bf17670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b22202d-e315-42ea-9e7c-4355ef2ae55f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/os-hosts/n-d-858495-2 HTTP/1.1 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 51 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:45.375194 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: {"status": "enable", "maintenance_mode": "invalid"} Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:39:45.376742 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'n-d-858495-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance: Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.377751 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.380517 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.382509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.382509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:39:45.382509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:39:45.382509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.382509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.383963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b22202d-e315-42ea-9e7c-4355ef2ae55f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.384834 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b22202d-e315-42ea-9e7c-4355ef2ae55f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858495-2" status: 400 len: 199 microversion: 2.1 time: 0.026085 Sep 23 03:39:45.385624 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 234/525] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:39:45 2022] PUT /compute/v2.1/os-hosts/n-d-858495-2 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:39:45.404092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.405634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:45.409489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.416073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.416809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.417247 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b587e68-6979-45ab-8ebb-a126d2390cd8 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1271 microversion: 2.1 time: 0.141541 Sep 23 03:39:45.417675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.419141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.420012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.420706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.426545 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 292/526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:45.441337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2eff41cd-3491-4fad-bfee-5ce37000091f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b673ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2eff41cd-3491-4fad-bfee-5ce37000091f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-hosts/n-d-858495-2 HTTP/1.1 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 51 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:39:45.446252 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: {"status": "invalid", "maintenance_mode": "enable"} Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:45.447655 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'n-d-858495-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance: Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.448397 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.450042 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.451555 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.451555 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:39:45.451555 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:39:45.451555 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 03:39:45.451555 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.452361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2eff41cd-3491-4fad-bfee-5ce37000091f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.454153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2eff41cd-3491-4fad-bfee-5ce37000091f tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858495-2" status: 400 len: 189 microversion: 2.1 time: 0.017219 Sep 23 03:39:45.455497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 293/527] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:39:45 2022] PUT /compute/v2.1/os-hosts/n-d-858495-2 => generated 189 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba4f6b8d-a598-4fbf-80a4-ddf3a84fabe5 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Action: 'update', calling method: .version_select at 0x7f0c8b619550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba4f6b8d-a598-4fbf-80a4-ddf3a84fabe5 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f471fb397b82461dbdd8d248b521764b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62496fa0caef480ba7cdfa0cf40cdb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba4f6b8d-a598-4fbf-80a4-ddf3a84fabe5 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Request method failure captured: Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-hosts/n-d-858495-2 HTTP/1.1 Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 50 Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp-5xEVd_H8Weo8oApTtjCRLWIIw9m5bCk6URn837tjC9KLh2gHd8XLC0oHPaS1mdMs5DRETk1Vq_8fOeJSayUzDNvYAwFn0E1yZNBvRz2vlsZ1VUc9qMxoTP8XZ-vOTEczlcv7lzI75CWaSz9XLOFoHelm88lv0TlsUi2sdMP64MM Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:45.487668 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62496fa0caef480ba7cdfa0cf40cdb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 62496fa0caef480ba7cdfa0cf40cdb95 Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-377143444 Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f471fb397b82461dbdd8d248b521764b Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-377143444-project Sep 23 03:39:45.488823 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: {"status": "enable", "maintenance_mode": "enable"} Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'n-d-858495-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:39:45.491544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:39:45.494968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba4f6b8d-a598-4fbf-80a4-ddf3a84fabe5 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba4f6b8d-a598-4fbf-80a4-ddf3a84fabe5 tempest-HostsAdminNegativeTestJSON-377143444 tempest-HostsAdminNegativeTestJSON-377143444-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858495-2" status: 403 len: 111 microversion: 2.1 time: 0.015342 Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 294/528] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:39:45 2022] PUT /compute/v2.1/os-hosts/n-d-858495-2 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:39:45.498111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be08a883-b24e-4f2c-b138-b1824ea5b91e tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b8688b0>, body: {"status": null, "maintenance_mode": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be08a883-b24e-4f2c-b138-b1824ea5b91e tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-hosts/n-d-858495-2 HTTP/1.1 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 42 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:39:45.502645 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: {"status": null, "maintenance_mode": null} Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 03:39:45.503902 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'n-d-858495-2', 'body': {'status': None, 'maintenance_mode': None}} Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance: Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi None Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.504774 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.507717 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be08a883-b24e-4f2c-b138-b1824ea5b91e tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be08a883-b24e-4f2c-b138-b1824ea5b91e tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858495-2" status: 400 len: 127 microversion: 2.1 time: 0.012703 Sep 23 03:39:45.511301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 295/529] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:39:45 2022] PUT /compute/v2.1/os-hosts/n-d-858495-2 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:39:45.513161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b6195e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:45.516283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.hosts [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Enabling host nonexistent_hostname. Sep 23 03:39:45.526570 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Request method failure captured: Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 50 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSp_KJIlyLL_QSrxxDgBVZcNX-tlb0am1RYuwSuSNnkCvtpxkJEc0ptpZ4cb39Gd-7Cz0LsQZUuns3n4yQ9OtON0cxPy3_vjKt4izb_miGdBk3ytLkWJf2Ml7Ikt1TCtuqGEHwU3zlPmdKjFZAxBi7goKLe-R0lsbQRtDxdNwEU2-yo Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:39:45.528327 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/722916a3083343a8a42d0c560b3928e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_722916a3083343a8a42d0c560b3928e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 722916a3083343a8a42d0c560b3928e0 Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1191421459 Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2cf2cf122e864b68a399b69acb2f22cd Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1191421459-project-admin Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: {"status": "enable", "maintenance_mode": "enable"} Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.534591 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 03:39:45.537007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:45.538278 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:39:45.540348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:45.541679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aea32104-12c6-4b3e-b0ac-30baeff787f0 tempest-HostsAdminNegativeTestJSON-1191421459 tempest-HostsAdminNegativeTestJSON-1191421459-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021953 Sep 23 03:39:45.541679 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 296/530] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Sep 23 03:39:45 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:39:45.621735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:45.623273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:45.632532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.633691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.634632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.635563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:45.636788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:45.637406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:45.757564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.762581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:45.767718 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b989ac5-cb82-47c5-994e-e49e11740f59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1268 microversion: 2.1 time: 0.151192 Sep 23 03:39:45.769436 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 297/531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:45.775069 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48cdf50b-9ee2-44fe-8311-2fc256bed8fa tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.388120 Sep 23 03:39:45.781894 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 235/532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:45 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:46.126993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2789bf-6e16-4bd6-8943-6128aef2e33d", "name": "network-vif-plugged", "status": "completed", "tag": "7232efb7-1806-4fa1-ade3-f3a8d499ebe3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:46.151902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.153968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.156808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.176486 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] Creating event network-vif-plugged:7232efb7-1806-4fa1-ade3-f3a8d499ebe3 for instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d on n-h2-858495-2 Sep 23 03:39:46.211120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7aadae5d-6b9c-4152-8f64-37c1b4ad46a8 req-e4dce70e-6281-4655-b1bd-9c4a5f351efd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087822 Sep 23 03:39:46.212817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 298/533] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:46.251658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:46.253603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:46.281475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.282853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.283601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.284678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.285591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.286325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.300740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:46.301506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:46.315925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.316440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.316898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.317668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.319406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.325142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.459234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:46.468545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:46.470050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:46.471179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-315f60ec-5d7b-4d04-9c3d-3093189eb443 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1319 microversion: 2.25 time: 0.227099 Sep 23 03:39:46.485613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 236/534] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:46 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:46.489521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:46.489521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:46.506427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.507519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.508622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.509784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.510400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.511003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.682438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:46.698783 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63a7d897-d2d5-4c23-8094-76eccaf6612d tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1271 microversion: 2.1 time: 0.215771 Sep 23 03:39:46.702168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 237/535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:46 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:46.795168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:46.796972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:46.805180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.805998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.806419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.807508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.808317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.809551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.814176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:46.826394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5968ea3-2085-48ba-89fb-fb6348af1fed tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.531709 Sep 23 03:39:46.836707 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 299/536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:46 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:46.863369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:46.864164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:46.873397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.873896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.874335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:46.875042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:46.880067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:46.880770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.185146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.194755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7de2133f-7a00-4bbc-a79e-72f78199aaa7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.356332 Sep 23 03:39:47.211815 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 300/537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:46 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:47.227393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.237007 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fff5a105-2662-4031-80cc-4bf916763a4c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.446144 Sep 23 03:39:47.237908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 238/538] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:46 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:47.498483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:47.499095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:47.510847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.511568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.512205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.512841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.513308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.513787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.725616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.733198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:47.745428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.746190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:47.748637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.750460 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e091779-2367-4086-88ae-29b87d1ad5f5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.256395 Sep 23 03:39:47.767854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.769250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.769876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.771300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.772358 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 301/539] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:47 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:47.773867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.774076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.867229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:47.870430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:47.874546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:47.900372 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6afae423-c74f-4bb1-8d75-9448c509cd46 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1271 microversion: 2.1 time: 0.175809 Sep 23 03:39:47.904155 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 239/540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:47 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:47.906593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.908664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.910321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:47.913136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:47.914920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:47.916363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.220863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:48.222062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:48.238550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.239080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.239528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.240295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.240777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.241212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.335915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:48.343509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b976814f-99d2-479c-a9e5-94d0ab7156cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1322 microversion: 2.1 time: 0.483199 Sep 23 03:39:48.357651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 302/541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:47 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:48.365453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:48.366269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:48.368625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:48.374410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.375105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.375734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.376693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.377414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.378076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.669269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:48.677867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29e151d4-0b4e-45a9-99cc-69703bae5540 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.461107 Sep 23 03:39:48.678548 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 240/542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:48 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:48.682999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d6cc8b-acac-49a5-a872-07e776dccc70", "name": "network-vif-plugged", "status": "completed", "tag": "d4811bc1-dad1-45e7-b932-16ece79a1dd4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:48.693158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.693860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.694428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.707538 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] Creating event network-vif-plugged:d4811bc1-dad1-45e7-b932-16ece79a1dd4 for instance 50d6cc8b-acac-49a5-a872-07e776dccc70 on n-h1-858495-2 Sep 23 03:39:48.713037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5bfe5bda-f341-4e86-927c-e1decd49f495 req-276f603e-ba99-459b-99ea-bd6607678c5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Sep 23 03:39:48.714179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 241/543] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:48.777448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:48.778179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:48.793320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.795399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.796951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.797740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.801294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.801805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.854376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:48.862753 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e9c2304-c2de-4953-b06d-d61b9cdadd68 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.501551 Sep 23 03:39:48.863939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 303/544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:48 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:48.869948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4", "tag": "60142906-a522-49bf-aba3-a4aa63827558"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:48.889582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.890838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.891548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.923957 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] Creating event network-changed:60142906-a522-49bf-aba3-a4aa63827558 for instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 on n-h1-858495-2 Sep 23 03:39:48.929007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-08f09ef1-298d-422d-b471-a40a41259a18 req-f2e8ad72-7f48-48f3-ad05-c6fca1572843 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063701 Sep 23 03:39:48.931042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 304/545] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:48.949430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:48.951958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:48.961193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.961742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.962192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:48.962884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:48.963338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:48.963762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.274580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:49.285185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:49.288252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:49.289698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c3e60c2-9dc3-44db-88fa-75f292eec322 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.516855 Sep 23 03:39:49.290808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 242/546] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:48 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:49.351384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:49.361621 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7f027f6-d11a-4094-a38c-589451952a27 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.415924 Sep 23 03:39:49.366827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:49.367811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:49.374547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:49.375244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 305/547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:48 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:49.376298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:49.377621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.378652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:49.379330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:49.380398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.625801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277ec34b-5e32-4cb8-9bf6-415e69c91490", "tag": "4e104d32-d7cc-479a-aa07-77c2ae6fba1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:49.657772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:49.659694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:49.661320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.692753 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] Creating event network-changed:4e104d32-d7cc-479a-aa07-77c2ae6fba1d for instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 on n-h2-858495-2 Sep 23 03:39:49.707706 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8b6518b6-6e9e-40fa-8087-62bc70ec9445 req-6683d0c4-7ba3-4406-9832-2d92fe5a5cd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086780 Sep 23 03:39:49.708313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 306/548] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:49.713918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:49.714615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:49.724938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:49.728895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:49.729621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:49.730225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.731098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:49.731701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:49.732276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:49.739402 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ec5cf55-c7ae-4818-bec0-0c6b238f5754 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1472 microversion: 2.1 time: 0.376471 Sep 23 03:39:49.740621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 243/549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:49 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:49.993374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:50.002120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3058da25-0ac5-4e38-a3ac-09b1c90b32c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1313 microversion: 2.1 time: 0.292417 Sep 23 03:39:50.002750 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 307/550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:49 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:50.019551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:50.020163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:50.026458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.026844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.027269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.027970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.028425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.028841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.111877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:50.112462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] [instance: 98b422d4-ac40-40ce-901a-1d1f0e07d87d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:50.124562 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] HTTP exception thrown: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Request method failure captured: Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/98b422d4-ac40-40ce-901a-1d1f0e07d87d/action HTTP/1.1 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 15 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpvoWHv0VfCqtc3bT0gQxJXajA9LhreAUV4qqhYVLiNyiEdchieLHWFcIdFYDuwBFnNjT6hSwI4m_iUqfcCmtPgjisp-ISKwhaBaVrbYtxQgisaPKDxY_MM3UmcKzl1W_v7HZm9yChBTvUQ75trHpE0lxOMY4WLhv_n5piJOT4oPsA Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:39:50.128841 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89ed5d80f8864d54bb6708e5fa758a9f Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: {"migrate": {}} Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:39:50.130497 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '98b422d4-ac40-40ce-901a-1d1f0e07d87d', 'body': {'migrate': {}}} Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:39:50.131474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. Sep 23 03:39:50.133392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:39:50.137777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Returning 404 to user: Instance 98b422d4-ac40-40ce-901a-1d1f0e07d87d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:39:50.142803 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdf539ee-3bbd-48fa-aad2-a91b0003d278 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/98b422d4-ac40-40ce-901a-1d1f0e07d87d/action" status: 404 len: 111 microversion: 2.1 time: 0.381853 Sep 23 03:39:50.144401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 244/551] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:39:49 2022] POST /compute/v2.1/servers/98b422d4-ac40-40ce-901a-1d1f0e07d87d/action => generated 111 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:39:50.246361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:50.255652 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83ef0deb-58da-4976-ba83-334fa56b318b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.247423 Sep 23 03:39:50.256392 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 308/552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:50 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:50.294665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-267595032", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:50.314375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:50.315020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:50.336212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.338769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.340019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.343037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.347670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.348453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.378866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:50.700262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:50.714752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:50.719998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:50.722071 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7aaa3d8b-5eaf-481a-83ac-8386dd41c14a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.411613 Sep 23 03:39:50.723225 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 309/553] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:50 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:50.729606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:50.730464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:50.741637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.743168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.744227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.745520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.746353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.747399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.901747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:50.902174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:50.902799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:50.903335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:50.903879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:50.927350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.927930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.928273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.929070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:50.930511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:50.930735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:50.980930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Getting quotas for project 47018162001a4ff299b57c1a7ba58f39. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:50.987133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Getting quotas for user 9f7b47ab46f84b01866c48e5bd9892f3 and project 47018162001a4ff299b57c1a7ba58f39. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:50.999959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.008533 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f0789d2-9ae4-4a5e-9108-ed8be0796cf1 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.283952 Sep 23 03:39:51.011347 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 310/554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:50 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:51.016503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:39:51.019812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:39:51.029728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc03571f-4581-473d-b3e5-a2791f080cfd", "tag": "e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:51.040313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:51.041943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.042545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.043227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.058509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] Creating event network-changed:e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce for instance dc03571f-4581-473d-b3e5-a2791f080cfd on n-h2-858495-2 Sep 23 03:39:51.064451 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-19685d6c-a681-47f0-830d-4558a15d9f21 req-fadde6e6-e361-4879-be31-3ab032aad203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051572 Sep 23 03:39:51.065481 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 311/555] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:51.070653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.079319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.093069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.094620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.096005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.099003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.099666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.101043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.103230 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0855e959-54ef-4621-8464-1d44cadb93b7 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812808 Sep 23 03:39:51.104754 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 245/556] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:51.116733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc72939c-e3e9-4b2e-9801-4aa77c8f56e3 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.117466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc72939c-e3e9-4b2e-9801-4aa77c8f56e3 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.210220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc72939c-e3e9-4b2e-9801-4aa77c8f56e3 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.218201 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc72939c-e3e9-4b2e-9801-4aa77c8f56e3 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1221 microversion: 2.1 time: 0.106202 Sep 23 03:39:51.219457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 246/557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:51.287048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.287708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.298033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.298728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.299440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.300375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.301537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.302413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.430254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.442329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17d6ea2d-399c-4e7a-b259-85be326871d4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1462 microversion: 2.1 time: 0.375860 Sep 23 03:39:51.443164 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 312/558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1462 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:51.466620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:51.469384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.477264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.478213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.478720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.479773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.480386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.481235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.573845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.584594 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dfa11267-3b22-4c61-adee-096e6b240e09 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.306381 Sep 23 03:39:51.585751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 247/559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:51.590713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c26464c3-687c-4024-8819-dffa9a489344 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8baed700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.610584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.619355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Old instance type m1.heat2, new instance type m1.heat {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 03:39:51.626123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:51.629112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:51.629587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:51.630053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:51.630483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:51.630964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:51.655649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c26464c3-687c-4024-8819-dffa9a489344 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92" status: 200 len: 637 microversion: 2.1 time: 0.068522 Sep 23 03:39:51.656986 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 248/560] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92 => generated 637 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:51.673125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41ce684d-35b8-423b-9b93-e0ab72f8d971 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8bb563a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:51.734113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-41ce684d-35b8-423b-9b93-e0ab72f8d971 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:51.738803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-41ce684d-35b8-423b-9b93-e0ab72f8d971 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:51.769376 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bdf2de9-6f7a-4ca3-b2a8-28b5ba911b8d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70/action" status: 202 len: 0 microversion: 2.1 time: 0.307086 Sep 23 03:39:51.770308 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 313/561] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:39:51 2022] POST /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:39:51.775512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.776123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.783377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.784347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.784683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.785405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.785878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.786307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.927236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.936650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.938125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:51.940196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2619fadf-00c5-4f83-acb9-0b8b3150a089 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.168120 Sep 23 03:39:51.943519 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 314/562] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:51.948935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:51.949834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:51.961213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.961748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.962190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:51.962896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:51.963353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:51.963778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.072057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41ce684d-35b8-423b-9b93-e0ab72f8d971 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.402919 Sep 23 03:39:52.072660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 249/563] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:51 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:39:52.140934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:52.151367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2ad25b3-6c95-464d-b1d0-b2da46f50073 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1471 microversion: 2.1 time: 0.206400 Sep 23 03:39:52.151943 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 315/564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:51 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:52.156780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.157529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:52.163660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.164685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.165389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.166286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.166965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.167487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.208892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Calling method '.version_select at 0x7f0c8ba83ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.210765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.211322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.211829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.214897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:52.245515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.246276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.247099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.261769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.262251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.262708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.275629 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51a8609e-631e-45b3-8038-ac185d385674 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.201555 Sep 23 03:39:52.276554 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 250/565] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:52.282646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c8149e5-39c7-41ad-b7ad-6bc27b5c901d tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8baeddc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.331728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:52.341077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd65d62e-a963-47b8-82b9-0cda37203150 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.187921 Sep 23 03:39:52.341959 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 316/566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:52.358293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.358903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:52.366009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.366499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.367097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.367794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.368251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.368840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.478448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:52.489329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-915285f4-2bca-406c-af4c-a484286ee946 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1217 microversion: 2.1 time: 0.144164 Sep 23 03:39:52.490927 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 317/567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:52.517215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Calling method '.version_select at 0x7f0c8b64e8b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.520105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.520605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.521043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.535384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.535871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.536309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.564464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.564999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.565463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.573662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9dcadb99-693e-47dd-8f65-8fc22a39870f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858495-2/servers" status: 200 len: 433 microversion: 2.1 time: 0.069567 Sep 23 03:39:52.582413 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 318/568] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/os-hypervisors/n-h1-858495-2/servers => generated 433 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:52.589310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Calling method '.version_select at 0x7f0c8b8118b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.591798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.592369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.593047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.610273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.610911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.611354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.623735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.624467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.624827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.632682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9420ae52-ab42-4c3b-8834-f1b154248b5f tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048329 Sep 23 03:39:52.638400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 319/569] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:52.638910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c8149e5-39c7-41ad-b7ad-6bc27b5c901d tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "DELETE /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.357721 Sep 23 03:39:52.638910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 251/570] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Sep 23 03:39:52 2022] DELETE /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_version => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:39:52.639063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.639063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:52.644295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Calling method '.version_select at 0x7f0c8baedee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.645487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.646050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.646174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.646521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.646628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.646973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.647223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.647658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.648175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.673319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.673829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.674583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.682173 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4361be24-de66-45ba-a57e-15a8818e18b2 tempest-HypervisorAdminUnderV252Test-1170088945 tempest-HypervisorAdminUnderV252Test-1170088945-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858495-2/search" status: 200 len: 104 microversion: 2.1 time: 0.041905 Sep 23 03:39:52.682793 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 252/571] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/os-hypervisors/n-h1-858495-2/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:52.690493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f703abc2-086a-456f-8ec2-0aaaac132bde tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8ba83040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.738353 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f703abc2-086a-456f-8ec2-0aaaac132bde tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 37 microversion: 2.1 time: 0.054375 Sep 23 03:39:52.739598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 253/572] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:52.751393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b0c92f3-7deb-4fbb-ac57-4f6036353bf2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8bac3310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:52.806378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:52.817823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e01e3515-3ce3-4229-918e-cc854d06e3f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.182024 Sep 23 03:39:52.818983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 320/573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:52.823760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1b0c92f3-7deb-4fbb-ac57-4f6036353bf2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:52.838941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1b0c92f3-7deb-4fbb-ac57-4f6036353bf2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:52.965913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:52.966770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:52.973833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.974598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.975354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:52.976383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:52.977277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:52.978048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.221867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b0c92f3-7deb-4fbb-ac57-4f6036353bf2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.475404 Sep 23 03:39:53.227273 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 254/574] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:52 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:39:53.232445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:53.233070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:53.239707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.240209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.240642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.241340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.241969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.242556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.339775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:53.590349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:53.601909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:53.603679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:53.605392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6af81cc6-057b-4108-beb2-f1b341c2947e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.643199 Sep 23 03:39:53.621387 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 321/575] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:52 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:39:53.621387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=20 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:53.627990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d1d2c68-bc18-4466-8f58-76ed3b3c12ca tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8b5dad30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:53.688570 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d1d2c68-bc18-4466-8f58-76ed3b3c12ca tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.071576 Sep 23 03:39:53.689170 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 322/576] 10.222.0.25 () {58 vars in 1290 bytes} [Fri Sep 23 03:39:53 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_distro => generated 33 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:53.697264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:53.697882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:53.707893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.708584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.709042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.710216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.710902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.711340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.749313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:53.761831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-910fec47-9a22-452a-a976-e59e1cdc029a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1471 microversion: 2.1 time: 0.533286 Sep 23 03:39:53.762685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 255/577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:53 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1471 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:53.770522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:53.772202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:53.780838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.781582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.782528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.790080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:53.790751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:53.791540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:53.943402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:53.954181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8124e2f-a3c7-49a5-bf17-9096216380cc tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1279 microversion: 2.1 time: 0.189549 Sep 23 03:39:53.961131 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 256/578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:53 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:53.970452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d8a250f-5450-45eb-9737-99c56d9e8edf tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8ba491f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:54.035669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=43 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:54.037487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7d8a250f-5450-45eb-9737-99c56d9e8edf tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:54.042566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7d8a250f-5450-45eb-9737-99c56d9e8edf tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:54.054372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:54.068442 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8fa6bada-6351-4e73-a680-6ccd808cfc8a tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.376898 Sep 23 03:39:54.069200 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 323/579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:53 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:54.074708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:54.075532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:54.081901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:54.083111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:54.083784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:54.085416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:54.086131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:54.087298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:54.240639 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d8a250f-5450-45eb-9737-99c56d9e8edf tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.277936 Sep 23 03:39:54.241245 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 257/580] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:53 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:54.250757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5662ff08-64c8-472a-b3a7-849188e389a2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8baedb80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:54.331057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5662ff08-64c8-472a-b3a7-849188e389a2 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.084319 Sep 23 03:39:54.338023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 258/581] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:54 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:39:54.344066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8305c36a-29d2-4a68-b6c2-611a8741046e tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8ba83040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:54.419454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8305c36a-29d2-4a68-b6c2-611a8741046e tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:54.436151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8305c36a-29d2-4a68-b6c2-611a8741046e tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:54.494291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:54.504377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd9bf761-304f-499c-9055-4d5e439b056e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.433879 Sep 23 03:39:54.504960 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 324/582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:54 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:54.630888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:54.631490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:54.641057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:54.642455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:54.644600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:54.646118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:54.648036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:54.648450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:54.681160 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8305c36a-29d2-4a68-b6c2-611a8741046e tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.341069 Sep 23 03:39:54.682869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 259/583] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:54 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:39:54.706003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89bf5089-69bd-43be-83bf-cc187c561532 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8bac3820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:54.780976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-89bf5089-69bd-43be-83bf-cc187c561532 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:54.797867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-89bf5089-69bd-43be-83bf-cc187c561532 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:54.993709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.007470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.010005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.012032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7f1a59f-fe00-476c-b0d5-3173b4510301 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.385021 Sep 23 03:39:55.013207 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 325/584] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:54 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:55.028846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:55.041596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:55.048314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.049176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.049989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.050900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.051519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.052107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.278672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.279890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89bf5089-69bd-43be-83bf-cc187c561532 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 64 microversion: 2.1 time: 0.591635 Sep 23 03:39:55.286043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 260/585] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:54 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 64 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:55.290422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:55.291248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:55.295429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc911087-0b09-47c2-a217-2eeacf284096 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1471 microversion: 2.1 time: 0.280625 Sep 23 03:39:55.296368 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 326/586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:55 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:55.299930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.300782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.301764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.302646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:55.303541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:55.303663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.304248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.304768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.311371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.312209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.314296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.315425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.316149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.317172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.552445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.573750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e71d611-cabc-43ba-9250-b537cf598e85 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.291232 Sep 23 03:39:55.575339 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 261/587] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:55 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:55.579934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4744a981-d4fb-4044-8dc9-db2374a6412c tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8ba49ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:55.601078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.611742 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b92bd485-4814-4149-b59b-d69de7903400 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.313559 Sep 23 03:39:55.612653 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 327/588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:55 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:55.617443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:55.618060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:55.625131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.625858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.626470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.627873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:55.628657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:55.630107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:55.657630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4744a981-d4fb-4044-8dc9-db2374a6412c tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080725 Sep 23 03:39:55.659157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 262/589] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:55 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 64 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:55.672393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6682285b-e8e8-4a86-a98e-e8afa35b3823 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8baed3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:55.730342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6682285b-e8e8-4a86-a98e-e8afa35b3823 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:55.735775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6682285b-e8e8-4a86-a98e-e8afa35b3823 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:55.883295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:55.895398 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-353bb49b-48f9-4d5a-a8cb-1eee2e16c2d1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.281568 Sep 23 03:39:55.904934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 328/590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:55 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:56.040727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:56.041762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:56.053933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.054693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.055530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.056580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.057471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.058217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.202866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6682285b-e8e8-4a86-a98e-e8afa35b3823 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.535442 Sep 23 03:39:56.206623 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 263/591] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:55 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:56.222395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6e66461-0464-4670-82b8-726521ed15b9 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update', calling method: .version_select at 0x7f0c8ba83ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:56.306968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b6e66461-0464-4670-82b8-726521ed15b9 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:56.325666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:56.329458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:56.345154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b6e66461-0464-4670-82b8-726521ed15b9 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:56.356749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:56.361175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:56.363163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40517393-f771-4f81-88c8-10e059bee370 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.328156 Sep 23 03:39:56.365705 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 329/592] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:56 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:56.373171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ec34b-5e32-4cb8-9bf6-415e69c91490", "name": "network-vif-plugged", "status": "completed", "tag": "4e104d32-d7cc-479a-aa07-77c2ae6fba1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:56.397684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.398301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.399001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.413576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] Creating event network-vif-plugged:4e104d32-d7cc-479a-aa07-77c2ae6fba1d for instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 on n-h2-858495-2 Sep 23 03:39:56.420099 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e25a4e1e-2c08-454e-957b-28e9c65ca7e6 req-589af510-a3cb-4483-8dd0-d7e8ae2e1d82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050922 Sep 23 03:39:56.421417 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 330/593] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:56.426576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:56.433058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:56.440205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.450543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.451194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.452495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.453585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.453585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.703243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:56.721415 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69e842c6-ba7d-4a20-8e46-7f34d8a97cf9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.294794 Sep 23 03:39:56.723681 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 331/594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:56 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:56.731974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:56.732595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:56.744325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.745235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.746168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.747125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.748109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.749212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.784608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6e66461-0464-4670-82b8-726521ed15b9 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.571095 Sep 23 03:39:56.785216 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 264/595] 10.222.0.25 () {60 vars in 1313 bytes} [Fri Sep 23 03:39:56 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata/os_version => generated 31 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:56.790305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:56.794082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:56.805790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.806626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.808583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.811058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:56.811543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:56.812025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:56.990240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.002245 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec83966b-8454-4cf5-a6b6-16b2e217d2c5 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.277232 Sep 23 03:39:57.021990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 332/596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:56 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:57.022518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.027946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0ef419-ab26-4571-b84d-3707a31ec362", "tag": "5221c1db-4345-4ec0-9eec-2e885a85d2a3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:57.031825 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0979292d-ae76-4ac2-91b8-b8a1b5b2aa92 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.245469 Sep 23 03:39:57.033485 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 265/597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:56 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:57.039052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c8b92b36-88b6-4990-9ce4-f6bdf0113751 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8ba49820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.039438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.039931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.040369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.057613 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] Creating event network-changed:5221c1db-4345-4ec0-9eec-2e885a85d2a3 for instance 3a0ef419-ab26-4571-b84d-3707a31ec362 on n-h1-858495-2 Sep 23 03:39:57.063629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fe6a4579-07e3-4795-a4d8-a1912cc7da52 req-db769a81-4840-4ca5-bad9-7ff6d961a3d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039670 Sep 23 03:39:57.064938 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 333/598] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:57.071146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.071942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:57.078669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.079158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.079610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.080845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.081291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.082087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.092455 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c8b92b36-88b6-4990-9ce4-f6bdf0113751 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 58 microversion: 2.1 time: 0.057556 Sep 23 03:39:57.093250 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 266/599] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 58 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:57.105239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ff8f3d1-0497-45a0-9795-98c597ad0270 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'update_all', calling method: .version_select at 0x7f0c8baedc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:57.183256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9ff8f3d1-0497-45a0-9795-98c597ad0270 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:57.187668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9ff8f3d1-0497-45a0-9795-98c597ad0270 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:57.256958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.266968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae1b8ff7-1be3-4e34-92e5-543d8bfc1757 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.200274 Sep 23 03:39:57.268452 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 334/600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:57.462803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Calling method '.version_select at 0x7f0c8b5355e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.465388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.465952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.466461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.483171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.483705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.484157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.494356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.494853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.495278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.501341 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad1a4036-fdff-4ae3-8c1b-80cda27f3a70 tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.164962 Sep 23 03:39:57.505413 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 335/601] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:39:57.506951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ff8f3d1-0497-45a0-9795-98c597ad0270 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.405878 Sep 23 03:39:57.507412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.507556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 267/602] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:39:57 2022] PUT /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 61 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:57.508281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:57.514231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.514724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.515165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.515866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.516342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.516763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.517657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02093546-5de0-4411-9c81-75646b3a1320 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Action: 'create', calling method: .version_select at 0x7f0c8ba49d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:57.566372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-02093546-5de0-4411-9c81-75646b3a1320 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:39:57.570245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-02093546-5de0-4411-9c81-75646b3a1320 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Getting quotas for user 107c81a4715d4426b5557495a1981c64 and project 146e4f862e714f819c9d6bcf1b751f4e. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:39:57.647061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.655522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.656978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.658107 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a833a2b-1d56-4f7f-9355-0f136ce383ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.154579 Sep 23 03:39:57.673521 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 336/603] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:39:57.673521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Calling method '.version_select at 0x7f0c8b5383a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.673521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.673521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.674635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.683749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.684234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.684675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.691841 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd1545b3-9888-49d1-bcda-288db6ae3acd tempest-HypervisorAdminV228Test-653137703 tempest-HypervisorAdminV228Test-653137703-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.031909 Sep 23 03:39:57.692409 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 337/604] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:39:57.749460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.750685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:57.758011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.758604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.759266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.760057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:57.760723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:57.761253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:57.881676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02093546-5de0-4411-9c81-75646b3a1320 tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "POST /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 85 microversion: 2.1 time: 0.368444 Sep 23 03:39:57.882360 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 268/605] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Sep 23 03:39:57 2022] POST /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 85 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:39:57.891856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-773de725-f0c3-4a1f-9dd1-6a66582a1e3d tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] Calling method '.version_select at 0x7f0c8baed550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:57.913291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:57.921315 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e879fed-710d-48f2-a1d9-ec904c92efe7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.177621 Sep 23 03:39:57.923114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 338/606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:57.943981 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-773de725-f0c3-4a1f-9dd1-6a66582a1e3d tempest-ImagesMetadataTestJSON-199450908 tempest-ImagesMetadataTestJSON-199450908-project] 10.222.0.25 "GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata" status: 200 len: 85 microversion: 2.1 time: 0.055967 Sep 23 03:39:57.944713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 269/607] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:39:57 2022] GET /compute/v2.1/images/ae968713-f902-419f-88b7-89c02d4c0e92/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:39:58.025644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.026262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.032422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.032846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.033336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.034047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.034613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.035046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.057721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.058351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.071058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.071584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.072034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.075200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.076658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.077777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.282149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.291198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5be43b1-fc18-4a3e-abb6-32e5cf458fcd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.270300 Sep 23 03:39:58.293689 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 339/608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:58 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:58.303463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.304424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.314465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.315456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.316277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.317313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.317905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.318400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.379487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.387882 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e1f737c-425d-4d9e-a596-3213e5d9f1b6 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.335606 Sep 23 03:39:58.401379 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 270/609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:58 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:58.472475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4", "name": "network-vif-plugged", "status": "completed", "tag": "60142906-a522-49bf-aba3-a4aa63827558"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:58.483284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.483770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.484314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.500020 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] Creating event network-vif-plugged:60142906-a522-49bf-aba3-a4aa63827558 for instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 on n-h1-858495-2 Sep 23 03:39:58.511210 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-016ae1ce-ef08-47cd-83fb-e88b67cd9ca2 req-8f3b06a3-04b7-430d-8df5-6934c09e4205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057573 Sep 23 03:39:58.514889 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 271/610] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:58.561297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.562239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.562774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.565384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:39:58.574010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.574497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.574934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.575641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.576099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.576535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.577573 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0e080e6-03c9-4d27-800b-89555397eafb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.279518 Sep 23 03:39:58.593304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 340/611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:58 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:58.610499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:39:58.687709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.689279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.702276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.703073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.704553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.706037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.707288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.708344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.749661 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a23a1cb-0071-41ad-89f0-151d46c19a4e tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 204 len: 0 microversion: 2.1 time: 0.189786 Sep 23 03:39:58.757449 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 272/612] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:39:58 2022] DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:39:58.902920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1028589305", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "1923747897", "adminPass": "***", "networks": [{"uuid": "ee17bb46-2848-4e80-a0a1-19a4bd202d49"}], "security_groups": [{"name": "tempest-securitygroup--1875985936"}], "key_name": "tempest-keypair-1958524183", "user_data": "}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:58.955052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.966773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.968617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:58.977840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa102616-a8ae-4092-8cea-b9d9c874c615 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1361 microversion: 2.25 time: 0.296396 Sep 23 03:39:58.978403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 341/613] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:39:58 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:39:58.984114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:58.984718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:58.996201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.996772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:58.997303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:58.999302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:58.999848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:59.000357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:59.108530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] validate_networks() for [('ee17bb46-2848-4e80-a0a1-19a4bd202d49', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:39:59.295580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:59.303875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaebc0cf-fa15-4864-853c-d9246989551b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.324169 Sep 23 03:39:59.304767 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 342/614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:58 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:59.314228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:59.319511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:59.327223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:59.327657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:59.328093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:59.328796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:59.329252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:59.329704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:59.578796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:59.587436 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ecfe6a82-e897-40c7-88c8-f779cd267c9c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.277065 Sep 23 03:39:59.588055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 343/615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:59 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:59.592704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:59.593548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:39:59.600097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:59.600883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:59.601692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:39:59.602663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:39:59.603341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:39:59.603995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.094704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.104255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af04ec0a-f1f3-46cc-890e-9a0f73adfcfd tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.515039 Sep 23 03:40:00.108043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 344/616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:39:59 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:00.118487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.118487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.135120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.135899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.136339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.144167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.144765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.145790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.185513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:00.186466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:00.187105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:00.187521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:00.187940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:00.217198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.219406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.221439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.222244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.225767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.239167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.260935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=11 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:00.276561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for project f14ba31b92a6476e83d865495e9320f6. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:00.281286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Getting quotas for user 0d3b2ab940804d72aac837e7d6264aed and project f14ba31b92a6476e83d865495e9320f6. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:00.296281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:00.300096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:00.382713 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98c7fa55-d202-4efd-b7f7-69cf02c9da09 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.482222 Sep 23 03:40:00.383641 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 273/617] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:39:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:00.398526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.400461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.407779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.413265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.414361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.414879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.415924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.416398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.417134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.417237 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-516512cf-84a7-4732-8cda-af13bc4adc65 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1310 microversion: 2.1 time: 0.307678 Sep 23 03:40:00.417800 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 345/618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:00.425215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.426018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.432452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.433274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.452315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.453113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.453752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.454442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.755452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.768516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.772827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.776532 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39af7160-f64e-4f93-8c47-91a4e8c575c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1557 microversion: 2.25 time: 0.391059 Sep 23 03:40:00.779914 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 274/619] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1557 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:00.797645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6686c4cf-5bb0-4e3f-8ea8-12a6171b03de tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.798271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6686c4cf-5bb0-4e3f-8ea8-12a6171b03de tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.857660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.870414 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d4a0a23-9b4f-4d95-a54b-c2dd0c4792d2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.449944 Sep 23 03:40:00.887538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 346/620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:00.894954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc03571f-4581-473d-b3e5-a2791f080cfd", "name": "network-vif-plugged", "status": "completed", "tag": "e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:00.902803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6686c4cf-5bb0-4e3f-8ea8-12a6171b03de tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:00.907192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.909183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.910539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.910663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6686c4cf-5bb0-4e3f-8ea8-12a6171b03de tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1265 microversion: 2.1 time: 0.129665 Sep 23 03:40:00.911223 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 275/621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:00.917511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.918102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.937691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.938115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.938560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.939299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.939764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:00.940193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:00.942142 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] Creating event network-vif-plugged:e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce for instance dc03571f-4581-473d-b3e5-a2791f080cfd on n-h2-858495-2 Sep 23 03:40:00.954864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1a1dae35-d630-4fd1-b196-534af1e23ec5 req-9b954f58-6b5b-4e82-b54a-85fe58f69f97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064168 Sep 23 03:40:00.960827 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 347/622] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:00.976703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:00.977948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:00.998812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:00.999587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.000401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.001084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.001709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.002446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.387476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:01.404021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-33043ebf-5b7e-4730-9031-ba21f0c812bd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.491287 Sep 23 03:40:01.406373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 276/623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:01.414478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:01.417439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:01.429389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.435219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.435679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.437025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.437546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.438006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.678625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:01.693737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 277ec34b-5e32-4cb8-9bf6-415e69c91490 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:01.712283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b2d4d6b-74fa-4ef9-ae57-b55871b79a2e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 2049 microversion: 2.25 time: 0.749046 Sep 23 03:40:01.712877 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 348/624] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:00 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 2049 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:01.740221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:01.744856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:01.753186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:01.758460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:01.762005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-efa0fcbb-b654-4b85-a29b-3a91e8927fcf tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1313 microversion: 2.1 time: 0.353572 Sep 23 03:40:01.763221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.763820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.766856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.767925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.768630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.770981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.784000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 277/625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:01 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:01.793773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:01.794777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:01.806617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.807131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.810893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:01.811668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:01.812167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:01.812599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.213187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:02.223871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07dfb66e-2cdc-4486-8996-6a4c8be25763 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1492 microversion: 2.1 time: 0.492748 Sep 23 03:40:02.224464 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 349/626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:01 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1492 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:02.241181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:02.242344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:02.248416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 277ec34b-5e32-4cb8-9bf6-415e69c91490 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:02.249121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.249727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.250343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.251228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.252127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.252774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.371910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-adb2626d-cbfb-42ff-8bb9-1075e47fd1f7 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 2049 microversion: 2.25 time: 0.586487 Sep 23 03:40:02.372619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 278/627] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:01 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 2049 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:02.602823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:02.617185 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d6e47560-fd6b-4362-887c-140ed6e6e624 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.389302 Sep 23 03:40:02.619372 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 350/628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:02 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:02.624910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:02.625986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:02.634969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.636006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.636735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.637751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.638440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.639107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.653487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da6b4722-5b53-4e0e-85c9-d62a5065b859 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Action: 'create', calling method: .version_select at 0x7f0c8b9c88b0>, body: {"keypair": {"name": "tempest-keypair-1010165280", "type": "ssh", "user_id": "3ca6160affca481797f4cc3a18c6a4c5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXIdHLtK6WnPaGGnZ+w4pEzeGXfRNWhE5+vNqToYGHRYXTq2SxzRT3JOBdYYR8zhYWthJVxmuDgO23LFUayiPphOp2+3V1l/r2F0C7QopR9dkqYEdLWoqme1wuxfhJtMg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:02.691467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-da6b4722-5b53-4e0e-85c9-d62a5065b859 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:02.705257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-da6b4722-5b53-4e0e-85c9-d62a5065b859 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for user 213f981b78a1420ba66c98b714424c67 and project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:02.773819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:02.776766 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da6b4722-5b53-4e0e-85c9-d62a5065b859 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.402039 Sep 23 03:40:02.778860 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 279/629] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:40:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:40:02.783724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b544dd93-22a6-4b61-a2b8-7e72b48ad6e3 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1323 microversion: 2.1 time: 0.162453 Sep 23 03:40:02.789894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 351/630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:02 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:02.799077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:02.810522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.814238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.814870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.815845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.817541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.818140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.878137 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c2574641-f730-4518-8145-293375988d3b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084971 Sep 23 03:40:02.880660 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 352/631] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Sep 23 03:40:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:40:02.891151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:02.893181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:02.907265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.910466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.913402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:02.914351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:02.915044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:02.916211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.060247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:03.060954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:03.073949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.074813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.076863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.077874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.083206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.083949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.282672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:03.295772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5311ce4b-4395-4115-ab3b-335b83be3678 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.413236 Sep 23 03:40:03.296689 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 353/632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:02 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:03.318250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:03.325014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:03.351664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.352691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.353383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.354341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.355247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.355901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.565564 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9978788c-de1a-4fc2-b477-7721c67dacc3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1643 microversion: 2.1 time: 0.782171 Sep 23 03:40:03.569478 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 280/633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:02 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1643 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:03.579615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fd03c72-daf5-4b88-b260-d77cedb8c17c tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Action: 'create', calling method: .version_select at 0x7f0c8ba83af0>, body: {"keypair": {"name": "tempest-keypair-1498235349", "type": "ssh", "user_id": "3ca6160affca481797f4cc3a18c6a4c5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQPMkQulxS//TGFjTZ0aTPfA/cppZmH6rWzvR4e/wPNXNKTZmhAKDcwLAmaaq0zHghXVafqD2D4UuKGuKx/MrMMd75JyA2D97rb3LpCy9lEhZt18A9r3OfTvOEAnhBIoA=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:03.619492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9fd03c72-daf5-4b88-b260-d77cedb8c17c tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:03.626479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9fd03c72-daf5-4b88-b260-d77cedb8c17c tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for user 213f981b78a1420ba66c98b714424c67 and project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:03.660236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:03.676973 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9662e5c5-8ed9-4206-b076-2f5631941104 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1463 microversion: 2.1 time: 0.363846 Sep 23 03:40:03.681946 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fd03c72-daf5-4b88-b260-d77cedb8c17c tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.111120 Sep 23 03:40:03.685421 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 281/634] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:40:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:40:03.694830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:03.697914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:03.699431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 354/635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:03 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1463 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:03.711173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0ef419-ab26-4571-b84d-3707a31ec362", "name": "network-vif-plugged", "status": "completed", "tag": "5221c1db-4345-4ec0-9eec-2e885a85d2a3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:03.713218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.713843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.719172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.720057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.720693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.721428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.722697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.723485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.724077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.751134 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] Creating event network-vif-plugged:5221c1db-4345-4ec0-9eec-2e885a85d2a3 for instance 3a0ef419-ab26-4571-b84d-3707a31ec362 on n-h1-858495-2 Sep 23 03:40:03.760514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9d7b0153-0b74-4012-972d-e2c67a4be59a req-22154b82-cd31-4d68-b309-a295b9eeb240 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059808 Sep 23 03:40:03.761430 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 355/636] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:03.786766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6035db-8278-4bf6-89e6-04dbb50f9bec", "name": "network-vif-deleted", "tag": "e1bab091-be7c-4397-a1ea-518ef7a1ab2f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:03.800321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.801091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.801725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.817716 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] Creating event network-vif-deleted:e1bab091-be7c-4397-a1ea-518ef7a1ab2f for instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec on n-h2-858495-2 Sep 23 03:40:03.829398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:03.838741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-00ae24a9-743d-4134-95c3-423b5b997fc5 req-ad194430-9e51-4ac1-a10f-3ddab05b6aaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074477 Sep 23 03:40:03.839769 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 356/637] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:03.847999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:03.849468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:03.857708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.858503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.859405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.876263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.878277 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c5dd994-ef5f-4047-820a-e20a0dbe72cb tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490/action" status: 202 len: 0 microversion: 2.25 time: 0.191319 Sep 23 03:40:03.878540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.880184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.894583 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 282/638] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:40:03 2022] POST /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:03.914921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:03.916419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:03.925934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.928823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.932339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:03.933428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:03.934202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:03.934874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.294360 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b178e7ca-c5f4-4f98-9e53-f0935cfa98cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1643 microversion: 2.1 time: 0.452793 Sep 23 03:40:04.295149 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 357/639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:03 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1643 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:04.323697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aff6bb6e-5f85-4ae5-abd7-de99797ce032 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Calling method '.version_select at 0x7f0c8b5efaf0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.351396 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aff6bb6e-5f85-4ae5-abd7-de99797ce032 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1010165280?user_id=3ca6160affca481797f4cc3a18c6a4c5" status: 200 len: 512 microversion: 2.10 time: 0.034573 Sep 23 03:40:04.352252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 358/640] 10.222.0.25 () {60 vars in 1340 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1010165280?user_id=3ca6160affca481797f4cc3a18c6a4c5 => generated 512 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:40:04.372358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:04.391333 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdd46d7f-82a5-414a-b803-409fbed4e8da tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.491953 Sep 23 03:40:04.394113 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 283/641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:03 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:04.400259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.401119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:04.424088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.425259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.430106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.431010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.431649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.432234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.572394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:04.588797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf2d0d00-2548-4420-8ad8-e36570469781 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1323 microversion: 2.1 time: 0.193120 Sep 23 03:40:04.618441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 284/642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:04.644564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.649861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:04.654865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Calling method '.version_select at 0x7f0c8b5389d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.662565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.663998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.665943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.668711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.672717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.673966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.675873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.676415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.676871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.724790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.725601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.726204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.789033 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f09a954d-72ed-4cce-98f9-8775e50e344f tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/c098c592d846492e80f8a2d4e6386028?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368" status: 200 len: 693 microversion: 2.1 time: 0.430185 Sep 23 03:40:04.802962 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 359/643] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/os-simple-tenant-usage/c098c592d846492e80f8a2d4e6386028?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368 => generated 693 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:04.813873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.815461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:04.822230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.826307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.826995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.827911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.829458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.832157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.897961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 277ec34b-5e32-4cb8-9bf6-415e69c91490 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:04.931858 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c935750c-93ab-4e42-b86b-aff0b7581421 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 2034 microversion: 2.25 time: 0.311861 Sep 23 03:40:04.933134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 285/644] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 2034 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:04.953460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:04.957690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.958628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.959365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:04.962698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:04.963602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:04.964314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.065303 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e49f88d2-04d2-4278-8477-85b18e21b1d0 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.130852 Sep 23 03:40:05.066853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 286/645] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:05.073561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0eb2648-e664-4807-9a53-c1d60768d3e2 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Action: 'create', calling method: .version_select at 0x7f0c8bac3c10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-123382719", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD5YHdxMWX8nKJbsYcsQNbtdM3tB3HJNlActa14PBvls1tyZLbYIKjo0SZQpYL2xa7ME2E1n94fafN0nhRi+KhHkEgVlBh6APp+sT99M9HRbcHUqiyxEpvs72buRI5y8g=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:05.137397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f0eb2648-e664-4807-9a53-c1d60768d3e2 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:05.153483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f0eb2648-e664-4807-9a53-c1d60768d3e2 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Getting quotas for user 213f981b78a1420ba66c98b714424c67 and project b51eba847ba24c759e259f57323810cc. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:05.176083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:05.189965 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-43ae72ca-6ba9-4b68-8fba-904b1de2a7c1 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1321 microversion: 2.1 time: 0.384738 Sep 23 03:40:05.191255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 360/646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:04 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:05.197560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '.version_select at 0x7f0c8b538310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:05.211055 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0eb2648-e664-4807-9a53-c1d60768d3e2 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.141526 Sep 23 03:40:05.212626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.213107 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 287/647] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:40:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:40:05.214545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.215161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.218350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858495-2", "block_migration": "auto"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:05.221304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:05.228923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.229678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.230466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.236562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.237915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.238625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.239523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.240131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.240711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.245412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06a75a6b-fe37-4c12-b1ea-32e4321503f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/c098c592d846492e80f8a2d4e6386028?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368" status: 200 len: 694 microversion: 2.1 time: 0.052723 Sep 23 03:40:05.256829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 361/648] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Sep 23 03:40:05 2022] GET /compute/v2.1/os-simple-tenant-usage/c098c592d846492e80f8a2d4e6386028?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368 => generated 694 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:05.262783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858495-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:05.265712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:05.274690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.276000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.277662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.279327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:05.280031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:05.280620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:05.324763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lazy-loading 'flavor' on Instance uuid 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:05.340114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'flavor' on Instance uuid 277ec34b-5e32-4cb8-9bf6-415e69c91490 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:05.341614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Going to try to live migrate instance to n-h2-858495-2 {{(pid=128724) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:40:05.393239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Going to try to live migrate instance to n-h1-858495-2 {{(pid=128723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:40:08.180560 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c23fc133-28e8-4da1-879c-6393da7dff7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490/action" status: 202 len: 0 microversion: 2.25 time: 2.965969 Sep 23 03:40:08.181187 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 288/649] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:40:05 2022] POST /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490/action => generated 0 bytes in 2967 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:08.205728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-913667bd-b339-43ed-af48-e48f26077eb7 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Calling method '.version_select at 0x7f0c8bab9280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:08.212991 n-d-858495-2 devstack@n-api.service[128723]: WARNING oslo_db.sqlalchemy.utils [None req-913667bd-b339-43ed-af48-e48f26077eb7 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:40:08.236862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-913667bd-b339-43ed-af48-e48f26077eb7 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=3ca6160affca481797f4cc3a18c6a4c5" status: 200 len: 726 microversion: 2.10 time: 0.053466 Sep 23 03:40:08.238319 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 289/650] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 23 03:40:08 2022] GET /compute/v2.1/os-keypairs?user_id=3ca6160affca481797f4cc3a18c6a4c5 => generated 726 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:40:08.243709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Calling method '.version_select at 0x7f0c8bac3ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:08.255957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.256776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.257311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.282377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.283049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.283581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.335901 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-464e3d20-90ae-42a0-bafa-824f41745a3c tempest-TenantUsagesTestJSON-1909885872 tempest-TenantUsagesTestJSON-1909885872-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368&detailed=1" status: 200 len: 7060 microversion: 2.1 time: 0.096197 Sep 23 03:40:08.336806 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 290/651] 10.222.0.25 () {58 vars in 1335 bytes} [Fri Sep 23 03:40:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T03%3A40%3A03.696368&end=2022-09-24T03%3A40%3A03.696368&detailed=1 => generated 7060 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:08.341618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:08.342344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:08.353304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.354035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.354610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.355772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.356329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.356933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.426000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9eaee73-7657-485f-9228-80bc6ec56bad tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4/action" status: 202 len: 0 microversion: 2.1 time: 3.166780 Sep 23 03:40:08.426687 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 362/652] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:05 2022] POST /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4/action => generated 0 bytes in 3169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:08.433853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:08.438098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:08.475328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.475824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.479004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.479993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.485492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.487440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.692673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:08.702421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ea7b108-6981-48db-a524-4a9595c5e2d8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.364313 Sep 23 03:40:08.703883 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 291/653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:08 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:08.709753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:08.710359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:08.717891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.718383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.718820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.719745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.720834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.721267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:08.915695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:08.929088 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f70aa7e3-3119-4279-b1e8-33a9a71d7dc1 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.496484 Sep 23 03:40:08.930658 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 363/654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:08 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:08.937795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19e69bb-33e0-4255-9811-268f04c45fc7", "tag": "874566c3-73c9-4318-92e0-d851d74bb1fe"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:08.950082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:08.952491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:08.953285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.018580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.029929 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ccd88947-15d6-454b-abea-6733f0f9340c tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1471 microversion: 2.1 time: 0.324723 Sep 23 03:40:09.031287 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 292/655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:08 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:09.063360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.064320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.072283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:09.075448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.076355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.077067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.078042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.078770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.079928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.206289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] Creating event network-changed:874566c3-73c9-4318-92e0-d851d74bb1fe for instance e19e69bb-33e0-4255-9811-268f04c45fc7 on n-h1-858495-2 Sep 23 03:40:09.221117 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e89652c8-da18-4b0d-b1b3-b7aed00cd6dd req-8c331a33-feed-4903-9116-b1831cb3d7c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281794 Sep 23 03:40:09.223397 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 364/656] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:09.233862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82b961c8-0347-4749-883e-c2e94b0df584 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Calling method '.version_select at 0x7f0c8b4140d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.297843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82b961c8-0347-4749-883e-c2e94b0df584 tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-123382719" status: 204 len: 0 microversion: 2.10 time: 0.073051 Sep 23 03:40:09.298487 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 365/657] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Sep 23 03:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-123382719 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:40:09.306191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.307164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.327892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.328735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.329527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.331080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.332788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.337153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.378887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:40:09.418838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.428806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.439787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.446533 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-757d0d95-2ce4-43d2-9fa6-4f8423d1c77a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.413979 Sep 23 03:40:09.447388 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 293/658] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:09 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:09.452123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.472886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.485673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.486511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.488617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.500221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.501044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.502276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.518672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-801e0d87-31dc-4573-aa2f-54b09030380e tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 204 len: 0 microversion: 2.1 time: 0.218684 Sep 23 03:40:09.520851 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 366/659] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:40:09 2022] DELETE /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:09.533861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:09.536842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.549455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.551721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.553515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.555245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.558348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.558957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.581998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:09.601323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lazy-loading 'flavor' on Instance uuid 3a0ef419-ab26-4571-b84d-3707a31ec362 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:09.702731 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d524519-ad41-42a7-9186-09ca74d75cde tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362/action" status: 202 len: 0 microversion: 2.1 time: 0.177794 Sep 23 03:40:09.707017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 367/660] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:09 2022] POST /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:09.713229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b5088c7-67b6-474f-ba80-fa18c04d9f4e tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Calling method '.version_select at 0x7f0c8b535d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.728563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.733266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b5088c7-67b6-474f-ba80-fa18c04d9f4e tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498235349?user_id=3ca6160affca481797f4cc3a18c6a4c5" status: 204 len: 0 microversion: 2.10 time: 0.024642 Sep 23 03:40:09.733890 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 368/661] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498235349?user_id=3ca6160affca481797f4cc3a18c6a4c5 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:40:09.738963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.739691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.745941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56ef2ec4-c61a-4f48-b716-ced33ae356e8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.297345 Sep 23 03:40:09.746531 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 294/662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:09 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:09.750850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:09.752038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:09.758017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.758508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.758946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.759813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.760355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.760786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.768333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.768976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.769738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.770563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:09.771151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:09.771671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:09.978741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:09.988091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f83cdeb-0c47-4403-bbbc-653fb9b64134 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1469 microversion: 2.1 time: 0.253067 Sep 23 03:40:10.003447 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 369/663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:09 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:10.003447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:10.003447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:10.003447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.003447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.004189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.004189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.004189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.004189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.147103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7b9fae5-fb37-4e0a-b6cd-06886993cc20 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1630 microversion: 2.1 time: 0.399516 Sep 23 03:40:10.147769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 295/664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:09 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1630 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:10.156598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d50422d-7e22-475c-bba5-a32b94f3dd2f tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] Calling method '.version_select at 0x7f0c8b848280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:10.194234 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d50422d-7e22-475c-bba5-a32b94f3dd2f tempest-KeyPairsV210TestJSON-1966024937 tempest-KeyPairsV210TestJSON-1966024937-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010165280?user_id=3ca6160affca481797f4cc3a18c6a4c5" status: 204 len: 0 microversion: 2.10 time: 0.044308 Sep 23 03:40:10.195121 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 296/665] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:40:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010165280?user_id=3ca6160affca481797f4cc3a18c6a4c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:40:10.203969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:10.205540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:10.214312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.215063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.216331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.217216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.217903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.218514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.234930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:10.244719 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a721aaeb-f023-4b30-a33b-1a36d6bdb918 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.254447 Sep 23 03:40:10.257426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 370/666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:09 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:10.416277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:10.427505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b6e28cd-18aa-4b62-aee5-518bc6409793 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.231271 Sep 23 03:40:10.438579 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 297/667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:10 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:10.476275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:10.476894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:10.488628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.489120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.489599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.490290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.490741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.491171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.771357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:10.772232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:10.780307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.786648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.787325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:10.788210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:10.788823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:10.789457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.064349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:11.073637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:11.087348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:11.088578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3393cfe-0a9f-4b8d-b17a-cc0f600a4663 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.616522 Sep 23 03:40:11.089144 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 371/668] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:10 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:11.132992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:11.142461 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7091dab-5ffe-44a5-ad04-2e5c83fb247b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.375260 Sep 23 03:40:11.143629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 298/669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:10 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:11.148514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:11.149601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:11.159859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.160363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.160813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.161573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.162041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.164416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.305266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b87f0d58-d6ea-4489-9600-0588f99050a2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b6235e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-314067561", "description": "tempest-description-85035443"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:11.394521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:11.411386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23d1c726-6bae-422a-979b-1a13b799b7f7 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1469 microversion: 2.1 time: 0.262723 Sep 23 03:40:11.412028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 299/670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:11 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:11.435450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:11.436822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:11.443922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.446305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.446971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.448091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.448707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.449299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.680566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b87f0d58-d6ea-4489-9600-0588f99050a2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.589776 Sep 23 03:40:11.682302 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 372/671] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:11 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:11.690651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:11.692017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:11.716782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.717797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.719335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.721292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.722218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.723485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.800147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b520e2fe-1f48-42f4-8a19-490f07c7be68 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1613 microversion: 2.1 time: 0.369267 Sep 23 03:40:11.801415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 300/672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:11 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1613 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:11.825678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:11.826806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:11.856280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.858691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.861490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.862474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:11.863276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:11.864176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:11.898731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:12.072121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:12.102774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b502432c-f8d8-4b26-a0ef-3447e4162ee2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.417123 Sep 23 03:40:12.104641 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 373/673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:11 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:12.119420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-14386ed6-8d30-4f13-ab5e-7103fc8da0d5 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b4d2820>, body: {"security_group_rule": {"parent_group_id": "e1942a17-b12a-4fd5-bc7e-8caa0e45d562", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:12.164123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:12.187086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10350b8e-2ccf-4a1b-b7be-66f8930eefad tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.381244 Sep 23 03:40:12.189726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 301/674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:11 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:12.205591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:12.208172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:12.221208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:12.222330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:12.223576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:12.225604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:12.226303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:12.227230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:12.354881 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3a0ef419-ab26-4571-b84d-3707a31ec362 while it is in vm_state suspended Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Request method failure captured: Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362/action HTTP/1.1 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 15 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpvoWHv0VfCqtc3bT0gQxJXajA9LhreAUV4qqhYVLiNyiEdchieLHWFcIdFYDuwBFnNjT6hSwI4m_iUqfcCmtPgjisp-ISKwhaBaVrbYtxQgisaPKDxY_MM3UmcKzl1W_v7HZm9yChBTvUQ75trHpE0lxOMY4WLhv_n5piJOT4oPsA Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:40:12.357780 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89ed5d80f8864d54bb6708e5fa758a9f Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: {"migrate": {}} Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:12.359135 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'migrate' instance 3a0ef419-ab26-4571-b84d-3707a31ec362 while it is in vm_state suspended Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3a0ef419-ab26-4571-b84d-3707a31ec362', 'body': {'migrate': {}}} Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 in vm_state suspended. Cannot resize while the instance is in this state. Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:12.359919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 3a0ef419-ab26-4571-b84d-3707a31ec362 while it is in vm_state suspended Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:12.361753 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:12.362880 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:12.362880 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:12.362880 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 3a0ef419-ab26-4571-b84d-3707a31ec362 while it is in vm_state suspended Sep 23 03:40:12.362880 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:12.364695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Returning 409 to user: Cannot 'migrate' instance 3a0ef419-ab26-4571-b84d-3707a31ec362 while it is in vm_state suspended {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:12.365975 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-871443aa-a26f-4f94-8610-9ff2f1c1d2a6 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362/action" status: 409 len: 148 microversion: 2.1 time: 0.173824 Sep 23 03:40:12.367832 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 302/675] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:12 2022] POST /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362/action => generated 148 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:40:12.372928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:12.373951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:12.382756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:12.383490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:12.384235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:12.385169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:12.386095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:12.387151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:12.953941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:12.983469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.003115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.008142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eae0a0ee-7abf-4cb9-879d-e9eefdb764e8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.638815 Sep 23 03:40:13.009344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 303/676] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:12 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:13.017866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:13.019025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:13.073994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.074508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.078029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.081115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.081823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.084527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.248543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-14386ed6-8d30-4f13-ab5e-7103fc8da0d5 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.140676 Sep 23 03:40:13.259924 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 374/677] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:13.282454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ec34b-5e32-4cb8-9bf6-415e69c91490", "name": "network-vif-unplugged", "status": "completed", "tag": "4e104d32-d7cc-479a-aa07-77c2ae6fba1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.306419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.307385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.308657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.326654 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] Creating event network-vif-unplugged:4e104d32-d7cc-479a-aa07-77c2ae6fba1d for instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 on n-h2-858495-2 Sep 23 03:40:13.343813 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4293b0af-2a18-45ff-b060-182f214c1dc0 req-e27ddc49-85ff-41d5-80b0-e3a675b1f644 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081941 Sep 23 03:40:13.347250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 375/678] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:13.355330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4", "name": "network-vif-unplugged", "status": "completed", "tag": "60142906-a522-49bf-aba3-a4aa63827558"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.371373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.372136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.372588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.392811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] Creating event network-vif-unplugged:60142906-a522-49bf-aba3-a4aa63827558 for instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 on n-h1-858495-2 Sep 23 03:40:13.396961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.406988 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d14759be-6146-41da-a84c-5bf416687d13 req-e5f2c349-0ee7-4c0a-9796-e9dea25618b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058049 Sep 23 03:40:13.408381 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 376/679] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:13.409745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-537a0c7b-d6b3-461c-839f-351a5ba5a517 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.398119 Sep 23 03:40:13.412004 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 304/680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:13 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:13.425177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:13.429736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dff30b31-a5a3-4262-95d9-df6ad1ee91f7 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.430177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dff30b31-a5a3-4262-95d9-df6ad1ee91f7 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Request method failure captured: Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action HTTP/1.1 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 39 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpvoWHv0VfCqtc3bT0gQxJXajA9LhreAUV4qqhYVLiNyiEdchieLHWFcIdFYDuwBFnNjT6hSwI4m_iUqfcCmtPgjisp-ISKwhaBaVrbYtxQgisaPKDxY_MM3UmcKzl1W_v7HZm9yChBTvUQ75trHpE0lxOMY4WLhv_n5piJOT4oPsA Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:40:13.440669 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 89ed5d80f8864d54bb6708e5fa758a9f Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: {"os-resetState": {"state": "invalid"}} Sep 23 03:40:13.442200 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9b2789bf-6e16-4bd6-8943-6128aef2e33d', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:13.442909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:40:13.444207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 03:40:13.445342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.445342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dff30b31-a5a3-4262-95d9-df6ad1ee91f7 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:13.445342 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dff30b31-a5a3-4262-95d9-df6ad1ee91f7 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action" status: 400 len: 144 microversion: 2.1 time: 0.032490 Sep 23 03:40:13.448432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.448432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.448432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.453071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.453419 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 377/681] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action => generated 144 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:40:13.453874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.455280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.486393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:13.487146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:13.507144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.507941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.509916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.510167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.510836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.511302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.511447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.511748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.512209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.512823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lazy-loading 'fault' on Instance uuid dc03571f-4581-473d-b3e5-a2791f080cfd {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:13.629947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49cf4988421d4b27b0b55fa08cbf4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c098c592d846492e80f8a2d4e6386028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.651005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-941ce60a-2647-42a4-9aa9-cfa3fca255e9 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 200 len: 1303 microversion: 2.1 time: 0.234646 Sep 23 03:40:13.652555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 305/682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:13 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:13.668733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:13.669528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:13.681374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.681873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.682521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.683401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:13.684019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:13.686103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:13.800521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.817286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9b03cc0-925b-41d8-b21a-703b9f48fe2e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.362684 Sep 23 03:40:13.819345 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 378/683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:13 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:13.842013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-125948fd-4d56-4501-80a8-d9bd543a77c6 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b6730d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1829997809", "description": "tempest-description-1947154188"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.917992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:13.933227 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0eabb135-3911-47ec-b1ad-c6d277e98532 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.278595 Sep 23 03:40:13.937851 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 306/684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:13 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:13.943952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4102f38-2a29-4fc7-84f1-74fa89c02d28 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4102f38-2a29-4fc7-84f1-74fa89c02d28 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Request method failure captured: Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action HTTP/1.1 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 31 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpvoWHv0VfCqtc3bT0gQxJXajA9LhreAUV4qqhYVLiNyiEdchieLHWFcIdFYDuwBFnNjT6hSwI4m_iUqfcCmtPgjisp-ISKwhaBaVrbYtxQgisaPKDxY_MM3UmcKzl1W_v7HZm9yChBTvUQ75trHpE0lxOMY4WLhv_n5piJOT4oPsA Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:40:13.956248 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89ed5d80f8864d54bb6708e5fa758a9f Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: {"os-resetState": {"state": 1}} Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:13.958221 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '9b2789bf-6e16-4bd6-8943-6128aef2e33d', 'body': {'os-resetState': {'state': 1}}} Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 1 Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:13.959097 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 03:40:13.962478 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.965271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4102f38-2a29-4fc7-84f1-74fa89c02d28 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:13.965271 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4102f38-2a29-4fc7-84f1-74fa89c02d28 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action" status: 400 len: 120 microversion: 2.1 time: 0.018533 Sep 23 03:40:13.965271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 307/685] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:40:13.978801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:13.984381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Failed to fetch instance by id 999 {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:40:13.985000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Request method failure captured: Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 37 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpvoWHv0VfCqtc3bT0gQxJXajA9LhreAUV4qqhYVLiNyiEdchieLHWFcIdFYDuwBFnNjT6hSwI4m_iUqfcCmtPgjisp-ISKwhaBaVrbYtxQgisaPKDxY_MM3UmcKzl1W_v7HZm9yChBTvUQ75trHpE0lxOMY4WLhv_n5piJOT4oPsA Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:40:13.996805 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a81d4aa43e384fe78e0e940fff974562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a81d4aa43e384fe78e0e940fff974562 Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940013920 Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89ed5d80f8864d54bb6708e5fa758a9f Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940013920-project-admin Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: {"os-resetState": {"state": "error"}} Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:13.998205 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 999 could not be found. Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:40:13.998979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:14.000543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab92a58c-a928-4b36-a1da-f9fb4eb97523 tempest-ServersAdminNegativeTestJSON-940013920 tempest-ServersAdminNegativeTestJSON-940013920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027483 Sep 23 03:40:14.003853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 308/686] 10.222.0.25 () {60 vars in 1179 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:40:14.015899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.018744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.040583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.043485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.045494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.047830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.050762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.051405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.122872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:40:14.191648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-125948fd-4d56-4501-80a8-d9bd543a77c6 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.356393 Sep 23 03:40:14.192537 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 379/687] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:14.200031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.200878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.219462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.220871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.224813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.226248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.226899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.228517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.302701 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4f04f577-2ff5-48d5-9927-ff821b9818b2 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 204 len: 0 microversion: 2.1 time: 0.297751 Sep 23 03:40:14.303737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 309/688] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:40:14 2022] DELETE /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:14.314265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd2eba4a-3005-4368-b98b-dfe65164b6ce tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b859040>, body: {"security_group_rule": {"parent_group_id": "e78cff3b-886d-4a2e-a6f4-509265aaf469", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:14.434278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:14.449709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:14.453251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:14.455141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2b099a3-543c-462f-a378-012806ae3755 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.260273 Sep 23 03:40:14.472795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 380/689] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:14 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:14.479308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.480022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.486768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.487360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.487898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.488660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.489128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.489649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.618677 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd2eba4a-3005-4368-b98b-dfe65164b6ce tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.311730 Sep 23 03:40:14.619969 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 310/690] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:14 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:14.628078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.629133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.636083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.637882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.638341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.639157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.639635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.640563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.716231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:14.724690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37436d95-e663-4856-a3c3-cf64218f776e tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1468 microversion: 2.1 time: 0.249783 Sep 23 03:40:14.725283 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 381/691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:14 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:14.729875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cbc77a80-88dc-4378-94e0-a1f8b9b5f477 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b648e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-633791996", "description": "tempest-description-139538811"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:14.823602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:14.847749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3cac4aa0-26b9-4c63-ad46-fd968aaf1e59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.226160 Sep 23 03:40:14.848717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 311/692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:14 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:14.853816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.854422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] [instance: dc03571f-4581-473d-b3e5-a2791f080cfd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.864215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.865054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.865650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.866460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.868053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.868651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.884471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] HTTP exception thrown: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Request method failure captured: Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd HTTP/1.1 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSp7GT2WP24vT1fy6QkkMs4vSGHd_pK8es6yafk6mzG2bEG9fzq1yC8xdhW52YqrTlHy4mSO_Nqlxpcs0XKi2ZluX2vqzhjt0rppaLsprjKYyGrpJp0OUkhu8_ZaCN_7Hg3Vsp5uknKNZkG9KXbholJyz-HM8BYUs_GRPCStfDlbhTM Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c098c592d846492e80f8a2d4e6386028 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TenantUsagesTestJSON-1076678524 Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:40:14.886410 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c098c592d846492e80f8a2d4e6386028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c098c592d846492e80f8a2d4e6386028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c098c592d846492e80f8a2d4e6386028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c098c592d846492e80f8a2d4e6386028"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TenantUsagesTestJSON-1076678524 Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c098c592d846492e80f8a2d4e6386028 Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1076678524 Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TenantUsagesTestJSON-1076678524-project Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 49cf4988421d4b27b0b55fa08cbf4360 Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TenantUsagesTestJSON-1076678524-project Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. Sep 23 03:40:14.887749 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'dc03571f-4581-473d-b3e5-a2791f080cfd'} Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:14.888487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. Sep 23 03:40:14.889662 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:14.892709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] Returning 404 to user: Instance dc03571f-4581-473d-b3e5-a2791f080cfd could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:14.893898 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdf88ec9-1b59-497a-ad6b-05d8f522cea2 tempest-TenantUsagesTestJSON-1076678524 tempest-TenantUsagesTestJSON-1076678524-project] 10.222.0.25 "GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd" status: 404 len: 111 microversion: 2.1 time: 0.043984 Sep 23 03:40:14.894986 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 312/693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:14 2022] GET /compute/v2.1/servers/dc03571f-4581-473d-b3e5-a2791f080cfd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:40:14.905060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:14.905837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:14.913828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.914381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.914813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.915979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:14.916795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:14.918054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:14.944308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cbc77a80-88dc-4378-94e0-a1f8b9b5f477 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.217896 Sep 23 03:40:14.955992 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 382/694] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:14.962072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da56fd8b-c7d6-4d1f-9a31-00e79f0d7296 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b6730d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-378734376", "description": "tempest-description-1062310316"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:15.125277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:15.140066 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a38b8ae3-f2e6-49ef-b8cf-28ed3571a830 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.243748 Sep 23 03:40:15.141011 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 313/695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:14 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:15.158701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:15.159943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:15.169599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=47 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:15.171940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.172780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.173380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.174311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.174894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.175402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.223227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:15.284370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da56fd8b-c7d6-4d1f-9a31-00e79f0d7296 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.325407 Sep 23 03:40:15.284999 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 383/696] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:15.303681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2da1758e-4ff3-42bd-97f0-b86e88979a42 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b5354c0>, body: {"security_group_rule": {"parent_group_id": "33ce4777-fcb5-40a4-8447-826e6ebd6f1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "71f4c821-7feb-4156-8b1d-aa89901e5fc8"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:15.417277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:15.432804 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1682bd6-caea-4040-a970-5f75902ac5ea tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.289718 Sep 23 03:40:15.433577 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 314/697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:15 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:15.438741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19e69bb-33e0-4255-9811-268f04c45fc7", "name": "network-vif-plugged", "status": "completed", "tag": "874566c3-73c9-4318-92e0-d851d74bb1fe"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:15.448555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.449388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.450259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.481079 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] Creating event network-vif-plugged:874566c3-73c9-4318-92e0-d851d74bb1fe for instance e19e69bb-33e0-4255-9811-268f04c45fc7 on n-h1-858495-2 Sep 23 03:40:15.493448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e26528da-4cf3-49cc-b4d0-29a2d86a8b60 req-385c9721-e271-42aa-819e-1a2a99495730 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058078 Sep 23 03:40:15.494073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 315/698] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:15.499443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc03571f-4581-473d-b3e5-a2791f080cfd", "name": "network-vif-deleted", "tag": "e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce"}, {"name": "network-changed", "server_uuid": "277ec34b-5e32-4cb8-9bf6-415e69c91490", "tag": "4e104d32-d7cc-479a-aa07-77c2ae6fba1d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:15.510616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.511107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.511547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.526128 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Creating event network-vif-deleted:e952ed5e-ac2f-4b49-8cf0-7bf39a0ec1ce for instance dc03571f-4581-473d-b3e5-a2791f080cfd on n-h2-858495-2 Sep 23 03:40:15.526644 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] Creating event network-changed:4e104d32-d7cc-479a-aa07-77c2ae6fba1d for instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 on n-h2-858495-2 Sep 23 03:40:15.534896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-56dead94-a6e4-4239-a1ef-d4a433495a10 req-0146665e-2a7d-4c9c-bcd9-666e8d6ef990 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039413 Sep 23 03:40:15.535864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 316/699] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:15.541078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4", "tag": "60142906-a522-49bf-aba3-a4aa63827558"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:15.550709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.551428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.552022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.565115 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] Creating event network-changed:60142906-a522-49bf-aba3-a4aa63827558 for instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 on n-h1-858495-2 Sep 23 03:40:15.571287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e503298a-aa69-4928-95c6-9d0b2d245ebe req-2b52bc41-0392-4995-8a05-2b77b38b5483 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Sep 23 03:40:15.572435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 317/700] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:15.578838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:15.580622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:15.591524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.592416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.593167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.594581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.595945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.596476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.899795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2da1758e-4ff3-42bd-97f0-b86e88979a42 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.604535 Sep 23 03:40:15.901293 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 384/701] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:15 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:15.906103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:15.907027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:15.914492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.915134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.915643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.916433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:15.916963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:15.917604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:15.929624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:15.945519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:15.947181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:15.948384 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9314a98d-c9fe-43f0-affe-beff95cd46a9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.374659 Sep 23 03:40:15.964278 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 318/702] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:15 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:16.217240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:16.227108 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d4704dd1-b756-4edd-9e65-5376c04acc04 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1468 microversion: 2.1 time: 0.324534 Sep 23 03:40:16.228591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 385/703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:15 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:16.241577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:16.242591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:16.251928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.252674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.253477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.254436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.255122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.255865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.362751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2070059131", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:16.445903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:16.452498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:16.475611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-800d7bb8-a42f-4bd8-a39f-f8cf9d6dc467 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.244812 Sep 23 03:40:16.476555 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 386/704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:16 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:16.482426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7986f18d-083e-4fcb-8fad-b58b16f3375d tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b455ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-681568152", "description": "tempest-description-649391230"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:16.813031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:16.813648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:16.814681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:16.816330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:16.817188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:16.834684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.835471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.836116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.837059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.837863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.838679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.857897 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7986f18d-083e-4fcb-8fad-b58b16f3375d tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.379945 Sep 23 03:40:16.858723 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 387/705] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:16.864049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:16.864873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:16.870383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Getting quotas for project af6e4f6b49cc48f28a3aa95057d1c9bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:16.878803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Getting quotas for user 501285a24b7a4bf39f0dea6763205885 and project af6e4f6b49cc48f28a3aa95057d1c9bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:16.880234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.880747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.881272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.882039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:16.883089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:16.884867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:16.910831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:16.915937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:16.990615 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8b76358-6e4a-4d67-9101-98213adad446 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040580 Sep 23 03:40:16.991641 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 319/706] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:16.999767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:17.000816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:17.010059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.011977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.012501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.014149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.015427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.015946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.071179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.082557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-daa29c63-784b-414e-be7e-2b67cdd52311 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.222413 Sep 23 03:40:17.083854 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 388/707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:16 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:17.089523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d63b43b1-db36-491d-831e-60e56b95b316 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b455f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1867612297", "description": "tempest-description-1305592602"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:17.315237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.352801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5b3b886-7eb9-42db-a99c-e45a66e9beff tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1391 microversion: 2.1 time: 0.356146 Sep 23 03:40:17.382681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 320/708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:16 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1391 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:17.395794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:17.408652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:17.429065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.430657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.432102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.433080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.437010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.450338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.527193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d63b43b1-db36-491d-831e-60e56b95b316 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.441970 Sep 23 03:40:17.528418 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 389/709] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:17 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:17.535236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-638b6592-cafe-492e-a61e-5365bcb7f942 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:17.537146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-638b6592-cafe-492e-a61e-5365bcb7f942 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:17.634538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-638b6592-cafe-492e-a61e-5365bcb7f942 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.650790 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-638b6592-cafe-492e-a61e-5365bcb7f942 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1219 microversion: 2.1 time: 0.116556 Sep 23 03:40:17.651669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 390/710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:17 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:17.659668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:17.662526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:17.679371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.680214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.681776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.682421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.683238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.684706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.686475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.695904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.700577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.704125 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1be3e81-abe5-4744-ae31-4a9759257177 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.319048 Sep 23 03:40:17.705891 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 321/711] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:17 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:17.714628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:17.718098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:17.732614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.733104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.733772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.734669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.735375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.736497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.759203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:17.788259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:17.788753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:17.790424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:17.790898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lazy-loading 'fault' on Instance uuid 3a0ef419-ab26-4571-b84d-3707a31ec362 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:17.920566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:17.929169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6811062-4302-4466-85d0-2eace7586918 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 200 len: 1311 microversion: 2.1 time: 0.274760 Sep 23 03:40:17.931215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 391/712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:17 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:17.936538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9e938c1-5139-483b-ad06-3a9f390f72ec tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b455dc0>, body: {"security_group_rule": {"parent_group_id": "5bf83feb-8e79-4d29-bb29-95ec63ebe38a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f050ad74-2c02-4963-b235-7b3ab3d7c02e"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:18.054998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:18.074322 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e946d37-979f-4a32-892b-8062d24de1d2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.366583 Sep 23 03:40:18.075561 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 322/713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:17 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:18.085621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0ef419-ab26-4571-b84d-3707a31ec362", "name": "network-vif-deleted", "tag": "5221c1db-4345-4ec0-9eec-2e885a85d2a3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:18.119798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.120784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.121554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.144736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] Creating event network-vif-deleted:5221c1db-4345-4ec0-9eec-2e885a85d2a3 for instance 3a0ef419-ab26-4571-b84d-3707a31ec362 on n-h1-858495-2 Sep 23 03:40:18.151266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b16839dc-9f24-40ba-a289-179afaad00c2 req-343d1d6d-e7d8-4ae5-b09e-80f1d177903d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074097 Sep 23 03:40:18.152674 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 323/714] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:18.161478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:18.163539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:18.182290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.183158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.184005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.188202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.190113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.190848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.538406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:18.547795 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7891e33e-44b1-480a-8c07-d367ecfd38ee tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.393510 Sep 23 03:40:18.548907 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 324/715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:18 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:18.555577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:18.556702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:18.564523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.565013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.565765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.566634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.567347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.567983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.684051 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9e938c1-5139-483b-ad06-3a9f390f72ec tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.751256 Sep 23 03:40:18.684657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 392/716] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:18.689779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:18.690649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:18.697754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.698561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.699208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.700145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.700818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.701380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.861420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:18.880488 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0011c6a7-c6a9-47ef-9c55-5cc8fd49f636 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1271 microversion: 2.1 time: 0.194569 Sep 23 03:40:18.883006 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 393/717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:18 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:18.891000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5eb89fb2-88eb-4bb5-951f-e42ba90fb7fc tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b673310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:18.909733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:18.921397 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0dde89a7-9b02-4bae-b7e7-09c5f6eccad2 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1590 microversion: 2.1 time: 0.371299 Sep 23 03:40:18.922726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 325/718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:18 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1590 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:18.929765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:18.930823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:18.939777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.940585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.941365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:18.942350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:18.942976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:18.943350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.509677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:19.520543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:19.522025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:19.523269 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fe4af6b-4f24-4f27-996f-55bb48cda054 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1567 microversion: 2.25 time: 0.598639 Sep 23 03:40:19.525054 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 326/719] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:18 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1567 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:19.534543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:19.535714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:19.543153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.545115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.546636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.547367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.547831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.548386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.683273 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90c3b880-e08e-4c25-aea6-9474ecfc81c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156711 Sep 23 03:40:19.684003 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 327/720] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:40:19 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:19.689724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:19.690410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 3a0ef419-ab26-4571-b84d-3707a31ec362] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:19.696706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.697704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.698311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.699020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.699480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.700012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.715832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] HTTP exception thrown: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Request method failure captured: Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 HTTP/1.1 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpuOC2EhacBws4P3ksR02f2VgrXeyNBRV2qNGcARcB4OI4Tqrt5a5MtMkruTOMHWc9ZgvkVTj8Z-BwvFo0xc5jnBYX3KvnEvC-u80hYG0GE2_pzYy7r3YBtBuEmHr0INk-xxwnSo9-y0Ts6mg26iAT9cTmkv7mQyiYBDDIKImRI-24 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 47018162001a4ff299b57c1a7ba58f39 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:40:19.718353 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 47018162001a4ff299b57c1a7ba58f39 Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-1817697042-project Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9f7b47ab46f84b01866c48e5bd9892f3 Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1817697042-project Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. Sep 23 03:40:19.719682 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3a0ef419-ab26-4571-b84d-3707a31ec362'} Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:19.720440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. Sep 23 03:40:19.721650 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:19.722787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Returning 404 to user: Instance 3a0ef419-ab26-4571-b84d-3707a31ec362 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:19.722787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ea7a967-dc2b-4543-af34-be35b35a17cd tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362" status: 404 len: 111 microversion: 2.1 time: 0.034598 Sep 23 03:40:19.724496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 328/721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:19 2022] GET /compute/v2.1/servers/3a0ef419-ab26-4571-b84d-3707a31ec362 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:40:19.729935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:19.731043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:19.737020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.737558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.737999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.738697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.739387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.740135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.914726 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5eb89fb2-88eb-4bb5-951f-e42ba90fb7fc tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f050ad74-2c02-4963-b235-7b3ab3d7c02e" status: 202 len: 0 microversion: 2.1 time: 1.030398 Sep 23 03:40:19.917269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 394/722] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:18 2022] DELETE /compute/v2.1/os-security-groups/f050ad74-2c02-4963-b235-7b3ab3d7c02e => generated 0 bytes in 1033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:19.928541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:19.931827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:19.957881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.958568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.959155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:19.960017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:19.960666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:19.961450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.154394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:20.163074 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6639fbea-1eee-41c8-8ada-a8ab2fccaecf tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.437337 Sep 23 03:40:20.177856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 329/723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:19 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:20.184222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:20.184955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:20.193203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.193950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.194671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.195583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.196207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.196817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.226078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:40:20.341596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd81ba41-0512-41f4-87a8-aaabfccfcb14 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 204 len: 0 microversion: 2.1 time: 0.161617 Sep 23 03:40:20.343540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 330/724] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:40:20 2022] DELETE /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:20.363753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:20.369030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:20.381882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:20.385331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.387912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.388527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.396624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.397293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.397862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.637015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:20.652033 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-619a6761-5398-44d4-ad5f-7eea2cea0255 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1277 microversion: 2.1 time: 0.298877 Sep 23 03:40:20.654645 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 331/725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:20 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:20.661958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb6c874a-5f64-4bc5-b1b8-665cf7590cf2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b9e6f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:20.788728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:20.799065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-08454326-ab82-4906-b2dd-a55dbadab732 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.880505 Sep 23 03:40:20.817129 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 395/726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:19 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:20.829419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:20.830079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:20.847415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.847913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.848348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.849055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.849549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.849980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.894554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:20.945429 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb6c874a-5f64-4bc5-b1b8-665cf7590cf2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5bf83feb-8e79-4d29-bb29-95ec63ebe38a" status: 200 len: 246 microversion: 2.1 time: 0.289160 Sep 23 03:40:20.964331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 332/727] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:40:20 2022] GET /compute/v2.1/os-security-groups/5bf83feb-8e79-4d29-bb29-95ec63ebe38a => generated 246 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:20.975951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:20.976839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:20.984068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.986621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.987248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:20.989651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:20.993976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:20.995484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:21.384612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:21.400570 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9dd78407-6e43-46df-8073-6587a7c31f60 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1478 microversion: 2.1 time: 0.580751 Sep 23 03:40:21.401642 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 396/728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:20 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1478 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:21.408311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc81771d-0101-49e3-bb7c-a979ebf59189 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b6e50d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-88425775", "description": "tempest-description-390368491"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:21.558682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:21.567048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:21.568780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:21.569977 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e9f45c27-6481-4adc-87fc-8164f6860edd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1542 microversion: 2.25 time: 0.604057 Sep 23 03:40:21.571190 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 333/729] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:20 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1542 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:21.575802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:21.576402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:21.583122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:21.583862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:21.584655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:21.585648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:21.586427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:21.587222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:22.312544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:22.326100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c883408-2957-42f2-bc58-989f461fcef8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.753678 Sep 23 03:40:22.326810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 334/730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:21 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:22.333618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17adf1b9-8ddc-4da2-b401-1270d301bd7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '.version_select at 0x7f0c8b7b89d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:22.346940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17adf1b9-8ddc-4da2-b401-1270d301bd7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:22.347449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17adf1b9-8ddc-4da2-b401-1270d301bd7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:22.348029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17adf1b9-8ddc-4da2-b401-1270d301bd7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:22.365414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17adf1b9-8ddc-4da2-b401-1270d301bd7e tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2609 microversion: 2.25 time: 0.037057 Sep 23 03:40:22.367564 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 335/731] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Sep 23 03:40:22 2022] GET /compute/v2.1/os-migrations => generated 2609 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:22.396337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:22.398539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:22.417343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:22.418347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:22.419798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:22.421769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:22.423266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:22.423898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:22.432117 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc81771d-0101-49e3-bb7c-a979ebf59189 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.029035 Sep 23 03:40:22.442688 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 397/732] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:40:21 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:22.448302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:22.449125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:22.456898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:22.457740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:22.458478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:22.459718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:22.460345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:22.460981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:23.192749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:23.205869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5f8f690-d7db-419f-b64c-929a21af3499 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.836154 Sep 23 03:40:23.207375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 336/733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:22 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:23.214347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:23.215212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:23.224866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:23.225915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:23.226607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:23.227546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:23.228402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:23.229033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:23.262092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:23.276531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1686f11e-e2db-495a-8bbe-e6c503f35a2b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.832417 Sep 23 03:40:23.277651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 398/734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:22 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:23.286169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:23.287136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:23.301407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:23.306155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:23.306795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:23.307665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:23.308236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:23.309491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:24.053281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid 277ec34b-5e32-4cb8-9bf6-415e69c91490 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:24.083585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c899d19d-1179-4d18-be1e-db7c7c68218b tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 2034 microversion: 2.25 time: 0.874684 Sep 23 03:40:24.093119 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 337/735] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:23 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 2034 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:24.106774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7b47ab46f84b01866c48e5bd9892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47018162001a4ff299b57c1a7ba58f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:24.111138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e31aa472-43a5-43ee-9384-80d2db1a7cc2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b9e6820>, body: {"security_group_rule": {"parent_group_id": "be2ea1c2-b30a-492b-ba9b-d34cff8cae58", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:24.121066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ff94e14-d00e-4f73-9e32-c29b37f9e812 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 200 len: 1478 microversion: 2.1 time: 0.841887 Sep 23 03:40:24.130251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 399/736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:23 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 1478 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:24.143828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:24.152427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:24.165594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:24.168748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:24.169876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:24.172055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:24.173126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:24.173605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:24.606357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:24.615394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55db7932-58b5-4d4a-b55d-d5767dea3899 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1590 microversion: 2.1 time: 0.483302 Sep 23 03:40:24.621674 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 400/737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:24 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1590 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:24.635564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19e69bb-33e0-4255-9811-268f04c45fc7", "tag": "874566c3-73c9-4318-92e0-d851d74bb1fe"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:24.689177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:24.705905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:24.707660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:24.742366 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] Creating event network-changed:874566c3-73c9-4318-92e0-d851d74bb1fe for instance e19e69bb-33e0-4255-9811-268f04c45fc7 on n-h1-858495-2 Sep 23 03:40:24.768787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-61eeb7e9-b3ba-427c-b51e-45eb41f1df1e req-b148be2d-aec6-41d0-a8a3-47b6c818113c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145302 Sep 23 03:40:24.780230 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 401/738] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:24.802101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:24.803707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:24.814207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:24.844774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:24.847723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:24.848593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:24.852430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:24.857602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:24.859616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.081206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e31aa472-43a5-43ee-9384-80d2db1a7cc2 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.985312 Sep 23 03:40:25.082537 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 338/739] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:25.087231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2789bf-6e16-4bd6-8943-6128aef2e33d", "name": "network-vif-deleted", "tag": "7232efb7-1806-4fa1-ade3-f3a8d499ebe3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:25.108213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.108950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.112053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.136909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] Creating event network-vif-deleted:7232efb7-1806-4fa1-ade3-f3a8d499ebe3 for instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d on n-h2-858495-2 Sep 23 03:40:25.146737 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c819ba28-8a7e-41d9-90cb-f8d13e8b1dfb req-f51defa0-ae18-4956-91d0-375fdbeb12a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062782 Sep 23 03:40:25.155112 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 339/740] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:25.166854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-abf4e88b-c25e-42cc-8fbb-2eedeb97fed4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: .version_select at 0x7f0c8b8874c0>, body: {"keypair": {"name": "tempest-keypair-402870577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0SzpHQG7kYipm/44VoDvSIgIe/TBaTcU0eFE4N04LDk1qJ0hRYIvkiIxKKvE5aEVLi5awlR8LPxxEB+gblX9A5c2L0Ajx5uKWpsCZYyFrJWX57pGUul6Tiace9w/Whtw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:25.207759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-abf4e88b-c25e-42cc-8fbb-2eedeb97fed4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for project 28c366e7ad9146d09218783c948d17db. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:25.213309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-abf4e88b-c25e-42cc-8fbb-2eedeb97fed4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for user 9855cf6129a34302a7e3e39d6a15a345 and project 28c366e7ad9146d09218783c948d17db. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:25.248651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-abf4e88b-c25e-42cc-8fbb-2eedeb97fed4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.091490 Sep 23 03:40:25.250511 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 340/741] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:40:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:40:25.258086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:25.259168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:25.266795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.267548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.268538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.269467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.270073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.270754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.504237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:25.520633 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9705e6a1-7b57-45a3-a73c-ba1134dc2c6b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1502 microversion: 2.1 time: 0.736634 Sep 23 03:40:25.521938 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 402/742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:24 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1502 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:25.528310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:25.528931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:25.535550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.536034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.536497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.537587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.538623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.542487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.689827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:25.709525 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8758ee4d-8573-4530-ad0c-de0b6b286f14 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.456144 Sep 23 03:40:25.722865 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 341/743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:25 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:25.726213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a280580b-badd-4586-bdcb-f0dc0104dd30 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Action: 'create', calling method: .version_select at 0x7f0c8b8873a0>, body: {"security_group_rule": {"parent_group_id": "be2ea1c2-b30a-492b-ba9b-d34cff8cae58", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:25.940021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:25.948584 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f89e0da3-4549-4093-b3b8-00257a34ee1c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.425407 Sep 23 03:40:25.949391 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 403/744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:25 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:25.957223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:25.959126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] [instance: 9b2789bf-6e16-4bd6-8943-6128aef2e33d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:25.966002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.967391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.968092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.969100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:25.971000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:25.972038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:25.990210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] HTTP exception thrown: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Request method failure captured: Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d HTTP/1.1 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpuOC2EhacBws4P3ksR02f2VgrXeyNBRV2qNGcARcB4OI4Tqrt5a5MtMkruTOMHWc9ZgvkVTj8Z-BwvFo0xc5jnBYX3KvnEvC-u80hYG0GE2_pzYy7r3YBtBuEmHr0INk-xxwnSo9-y0Ts6mg26iAT9cTmkv7mQyiYBDDIKImRI-24 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 47018162001a4ff299b57c1a7ba58f39 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:40:25.992973 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47018162001a4ff299b57c1a7ba58f39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 47018162001a4ff299b57c1a7ba58f39 Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1817697042 Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersAdminNegativeTestJSON-1817697042-project Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9f7b47ab46f84b01866c48e5bd9892f3 Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1817697042-project Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. Sep 23 03:40:25.994497 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9b2789bf-6e16-4bd6-8943-6128aef2e33d'} Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:25.995215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. Sep 23 03:40:25.996370 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:40:25.999863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] Returning 404 to user: Instance 9b2789bf-6e16-4bd6-8943-6128aef2e33d could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:26.001005 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8e6e65d-21c3-481d-9238-6b7426de3012 tempest-ServersAdminNegativeTestJSON-1817697042 tempest-ServersAdminNegativeTestJSON-1817697042-project] 10.222.0.25 "GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d" status: 404 len: 111 microversion: 2.1 time: 0.050876 Sep 23 03:40:26.002375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 404/745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:25 2022] GET /compute/v2.1/servers/9b2789bf-6e16-4bd6-8943-6128aef2e33d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:40:26.341845 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a280580b-badd-4586-bdcb-f0dc0104dd30 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.619290 Sep 23 03:40:26.343452 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 342/746] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:40:25 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:26.355915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2242e031-83fd-4931-b206-b493e1dd30f3 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b71c310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:26.544801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:26.546250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:26.552809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:26.553307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:26.553779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:26.560522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:26.561104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:26.561592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:26.732263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2242e031-83fd-4931-b206-b493e1dd30f3 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/be2ea1c2-b30a-492b-ba9b-d34cff8cae58" status: 200 len: 662 microversion: 2.1 time: 0.379246 Sep 23 03:40:26.733596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 405/747] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:40:26 2022] GET /compute/v2.1/os-security-groups/be2ea1c2-b30a-492b-ba9b-d34cff8cae58 => generated 662 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:26.739860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:26.740847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:26.748097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:26.748689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:26.749206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:26.750022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:26.750628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:26.751153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:26.847420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=7 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:27.025732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:27.033523 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdeb126c-6e6d-4590-8bef-fc9303ea359b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1492 microversion: 2.1 time: 0.493250 Sep 23 03:40:27.036227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 343/748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:26 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1492 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:27.045289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88a5d3f9-e5f5-44dd-a40d-a1467774f667 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b8645e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:27.119130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:27.165479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-248b8a2b-83b2-4b73-b5ff-d1626ecea2db tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.430199 Sep 23 03:40:27.172729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 406/749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:26 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:27.180196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d34833d-426f-43d5-b774-b3abeb973bc3", "tag": "9c805b36-734f-4ac0-a311-a069e387059c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:27.196261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.197271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.198362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.212404 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] Creating event network-changed:9c805b36-734f-4ac0-a311-a069e387059c for instance 7d34833d-426f-43d5-b774-b3abeb973bc3 on n-h2-858495-2 Sep 23 03:40:27.220192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5937d129-f163-447d-8e48-5c2a6af1174b req-a6e1ae7f-c3cf-4871-bbb5-2b9b0ee2ffda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044155 Sep 23 03:40:27.221701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 407/750] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:27.229191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:27.230215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:27.239893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.242502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.243064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.245705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.248443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.249506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.547983 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88a5d3f9-e5f5-44dd-a40d-a1467774f667 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/8ea7739e-552b-4fb7-9596-9f5e8a666bc7" status: 202 len: 0 microversion: 2.1 time: 0.509683 Sep 23 03:40:27.548573 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 344/751] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Sep 23 03:40:27 2022] DELETE /compute/v2.1/os-security-group-rules/8ea7739e-552b-4fb7-9596-9f5e8a666bc7 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:27.558568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e3af075-95f5-42f5-97e2-181011b4e23b tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '.version_select at 0x7f0c8b8a5af0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:27.562918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e3af075-95f5-42f5-97e2-181011b4e23b tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.563405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e3af075-95f5-42f5-97e2-181011b4e23b tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.563841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e3af075-95f5-42f5-97e2-181011b4e23b tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.563946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:27.573797 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3e63351-7f9e-4e35-8209-ab359163dd99 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1476 microversion: 2.1 time: 0.350038 Sep 23 03:40:27.574827 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 408/752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:27 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:27.580334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e7ef81d-d21d-4663-9b88-1ff94eaa7796 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b6481f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:27.599407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:27.605622 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e3af075-95f5-42f5-97e2-181011b4e23b tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.055286 Sep 23 03:40:27.616738 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 345/753] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:40:27 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:27.622301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:27.623431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:27.633585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.634406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.634996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.635869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:27.636890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:27.637503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:27.638512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:27.881882 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40bf88f0-8a58-412e-805d-996912d839ec tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1643 microversion: 2.1 time: 0.262848 Sep 23 03:40:27.882486 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 346/754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:27 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1643 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:28.008316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e7ef81d-d21d-4663-9b88-1ff94eaa7796 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/be2ea1c2-b30a-492b-ba9b-d34cff8cae58" status: 202 len: 0 microversion: 2.1 time: 0.432176 Sep 23 03:40:28.016529 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 409/755] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:27 2022] DELETE /compute/v2.1/os-security-groups/be2ea1c2-b30a-492b-ba9b-d34cff8cae58 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:28.025344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b887a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:28.079604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:40:28.081098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Neutron security group f050ad74-2c02-4963-b235-7b3ab3d7c02e not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:40:28.082540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] HTTP exception thrown: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.082540 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Request method failure captured: Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/f050ad74-2c02-4963-b235-7b3ab3d7c02e HTTP/1.1 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqals9m8lZaapJafQGyt8KjOXzPBs_i9l5UjDE8uW_N4dL2JTOiPsJKdeoqLW47RZNbXxHMDvHUZjngE0pu3Y4Bvz8c42dx3kg5YLNmyZiCRk28k1vNf76UCMUlqBFj7nvGCWQeaU-ZFvIYq2XL50g1lbdrjVmNtE_8w861cx7Jc2I Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c6890a6d00cb44cbb92954b61390db21 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-346645056 Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:40:28.102768 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6890a6d00cb44cbb92954b61390db21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6890a6d00cb44cbb92954b61390db21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6890a6d00cb44cbb92954b61390db21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6890a6d00cb44cbb92954b61390db21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupRulesTestJSON-346645056 Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c6890a6d00cb44cbb92954b61390db21 Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-346645056 Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupRulesTestJSON-346645056-project Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2bc30a9d47124433be16af773dfe0618 Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupRulesTestJSON-346645056-project Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.104175 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'f050ad74-2c02-4963-b235-7b3ab3d7c02e'} Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:40:28.105064 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:40:28.106310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.107437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] Sep 23 03:40:28.108816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:28.112346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Returning 404 to user: Security group f050ad74-2c02-4963-b235-7b3ab3d7c02e does not exist Sep 23 03:40:28.112346 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1f6f60d7-7272-4d01-9191-3f2a5063521d'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:28.114518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2482d238-31f4-4155-ab9d-da71e18dc4fa tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f050ad74-2c02-4963-b235-7b3ab3d7c02e" status: 404 len: 194 microversion: 2.1 time: 0.093538 Sep 23 03:40:28.115352 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 347/756] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:28 2022] DELETE /compute/v2.1/os-security-groups/f050ad74-2c02-4963-b235-7b3ab3d7c02e => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:40:28.123591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f9ba1e5-c9c0-4b5d-8fa3-d08002878342 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b535af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:28.146834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1924653933", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a1aece03-8cc5-4dd7-a1d8-55f60f30a37a"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:28.231706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] validate_networks() for [('a1aece03-8cc5-4dd7-a1d8-55f60f30a37a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:29.326939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f9ba1e5-c9c0-4b5d-8fa3-d08002878342 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5bf83feb-8e79-4d29-bb29-95ec63ebe38a" status: 202 len: 0 microversion: 2.1 time: 1.207223 Sep 23 03:40:29.327526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 410/757] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:28 2022] DELETE /compute/v2.1/os-security-groups/5bf83feb-8e79-4d29-bb29-95ec63ebe38a => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:40:29.334699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:29.339134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:29.354461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.354961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.355402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.356134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.356581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.357006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.371869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:29.372428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:29.372909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:29.373316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:29.373754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:29.390936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.391454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.392029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.395088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.396321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.396969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.446261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:29.458513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for user 27045855dd484c7fbcbb75721afdcc9a and project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:29.496061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:29.498694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:29.549560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:29.559951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1934048c-d17b-4dc7-8894-f2b6007fb4a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.230705 Sep 23 03:40:29.561065 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 411/758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:29 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:29.566559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:29.567907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:29.574707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.575420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.576044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.576922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:29.577674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:29.578262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea90941d-ea35-421e-9750-7d6f330a71bd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440875 Sep 23 03:40:29.578542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:29.588942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 348/759] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:29.595147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8dfcffbc-4bbf-4dce-895f-4fe0affcfa4d tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b864160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:30.111198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:30.128859 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad30d05c-abd6-42fc-be9e-e5edaa67258b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1475 microversion: 2.1 time: 0.566406 Sep 23 03:40:30.129716 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 412/760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:29 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1475 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:30.143812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-893df91f-46bf-4b2d-886d-ee40eb7db88f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:30.144413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-893df91f-46bf-4b2d-886d-ee40eb7db88f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:30.372889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-893df91f-46bf-4b2d-886d-ee40eb7db88f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:30.388556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-893df91f-46bf-4b2d-886d-ee40eb7db88f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1211 microversion: 2.1 time: 0.256926 Sep 23 03:40:30.389765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 413/761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:30 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1211 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:30.528448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8dfcffbc-4bbf-4dce-895f-4fe0affcfa4d tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/71f4c821-7feb-4156-8b1d-aa89901e5fc8" status: 202 len: 0 microversion: 2.1 time: 0.938061 Sep 23 03:40:30.532631 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 349/762] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:29 2022] DELETE /compute/v2.1/os-security-groups/71f4c821-7feb-4156-8b1d-aa89901e5fc8 => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:30.538218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0105155-38e4-4d01-893e-c9911ac13390 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b6fd430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:30.584227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:30.585267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:30.593965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:30.606576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:30.607055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:30.607821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:30.609667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:30.610119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:31.142347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:31.158501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4068b43b-16de-4e1b-a3ce-febcfe426452 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.577710 Sep 23 03:40:31.165493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 350/763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:30 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:31.190367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-386024690", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "6f121f7c-6b72-46a2-9bbd-ba5658c47c71"}], "security_groups": [{"name": "tempest-securitygroup--997179782"}], "key_name": "tempest-keypair-402870577", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:31.549938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] validate_networks() for [('6f121f7c-6b72-46a2-9bbd-ba5658c47c71', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:31.797192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0105155-38e4-4d01-893e-c9911ac13390 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/33ce4777-fcb5-40a4-8447-826e6ebd6f1a" status: 202 len: 0 microversion: 2.1 time: 1.263274 Sep 23 03:40:31.798409 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 414/764] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:30 2022] DELETE /compute/v2.1/os-security-groups/33ce4777-fcb5-40a4-8447-826e6ebd6f1a => generated 0 bytes in 1265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:31.803220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:31.804068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:31.822735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:31.823983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:31.824642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:31.825793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:31.829309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:31.830056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.192284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:32.210009 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1164e208-f2ff-4bbf-96f0-e840a3a8d496 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1473 microversion: 2.1 time: 0.405407 Sep 23 03:40:32.213965 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 415/765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:31 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:32.230582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:32.231787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:32.239411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:32.240149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:32.240740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.241902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:32.243275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:32.243862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.401214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:32.415106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f287290-2d4b-4246-8bf8-3021f8310943 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1269 microversion: 2.1 time: 0.191418 Sep 23 03:40:32.417251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 416/766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:32 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:32.426290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b838da6b-07d4-44a7-b203-bd6e9d374698 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b889b80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:32.564695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:32.565860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:32.566832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:32.567603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:32.577179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:32.594673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:32.596579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:32.597489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.598647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:32.599643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:32.600253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.632082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:32.639782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for user 9855cf6129a34302a7e3e39d6a15a345 and project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:32.670064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:32.673852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:32.761033 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc3ea45a-787f-4ffb-a2c1-7e5937492e8f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.593848 Sep 23 03:40:32.762556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 351/767] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:40:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:40:32.775205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d6cc8b-acac-49a5-a872-07e776dccc70", "name": "network-vif-unplugged", "status": "completed", "tag": "d4811bc1-dad1-45e7-b932-16ece79a1dd4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:32.794763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:32.813918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:32.814291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:32.836181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Creating event network-vif-unplugged:d4811bc1-dad1-45e7-b932-16ece79a1dd4 for instance 50d6cc8b-acac-49a5-a872-07e776dccc70 on n-h1-858495-2 Sep 23 03:40:32.846843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:40:32.862568 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-35ee2c0c-3b26-4a82-b530-f69dfa42454c req-87fbe09d-5fdf-477e-bada-857e3e52a4e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097504 Sep 23 03:40:32.863700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 352/768] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:33.120848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-829719669", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:33.214337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:33.270093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b838da6b-07d4-44a7-b203-bd6e9d374698 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e78cff3b-886d-4a2e-a6f4-509265aaf469" status: 202 len: 0 microversion: 2.1 time: 0.850899 Sep 23 03:40:33.271254 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 417/769] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:32 2022] DELETE /compute/v2.1/os-security-groups/e78cff3b-886d-4a2e-a6f4-509265aaf469 => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:33.278223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:33.282580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:33.305500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.306226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.308696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.309943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.310641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.318227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.787552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:33.796494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ec7e25f-9d80-4e9b-829f-4c0ca01c8e72 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.523312 Sep 23 03:40:33.801799 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 418/770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:33 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:33.806805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:33.808618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:33.830306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:33.830908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:33.831358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:33.832257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.832530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:33.832851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.833273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:33.833464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.835683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.836170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.838880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.859878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.868843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.869323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.871865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:33.872359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:33.872821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:33.945213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:33.954395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:33.983476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:34.002673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:34.003496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:34.020816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:34.022477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:34.030553 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6791dbe8-6cdb-47b4-8c65-2c86ab215de3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1280 microversion: 2.25 time: 0.225563 Sep 23 03:40:34.033074 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 419/771] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:33 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:34.062345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:34.064699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:34.081801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:34.082849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:34.083505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:34.084537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:34.085227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:34.086447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:34.182277 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65456fc3-2ee4-40be-a92d-7edc1db74de7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310767 Sep 23 03:40:34.184195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 353/772] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:34.194164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-306064f4-df55-4d81-95d6-02c3c9d921b5 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] Calling method '.version_select at 0x7f0c8b8873a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:34.509093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:34.526114 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-672bc2e8-044b-439a-97db-794a20fd002d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1470 microversion: 2.1 time: 0.483646 Sep 23 03:40:34.529197 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 420/773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:34 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:34.550334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:34.550964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:34.567925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:34.568426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:34.571692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:34.575764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:34.576823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:34.577554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.058021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:35.066946 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbe04749-33a5-47a8-9be5-bf78b2109df6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.536627 Sep 23 03:40:35.067548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 421/774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:34 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:35.087665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-77cd9330-73d8-4a1c-8ded-d39b17b785d5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:35.093949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-77cd9330-73d8-4a1c-8ded-d39b17b785d5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:35.229600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-77cd9330-73d8-4a1c-8ded-d39b17b785d5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:35.239629 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-306064f4-df55-4d81-95d6-02c3c9d921b5 tempest-SecurityGroupRulesTestJSON-346645056 tempest-SecurityGroupRulesTestJSON-346645056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e1942a17-b12a-4fd5-bc7e-8caa0e45d562" status: 202 len: 0 microversion: 2.1 time: 1.054327 Sep 23 03:40:35.240810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 354/775] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:40:34 2022] DELETE /compute/v2.1/os-security-groups/e1942a17-b12a-4fd5-bc7e-8caa0e45d562 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:35.241043 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-77cd9330-73d8-4a1c-8ded-d39b17b785d5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1216 microversion: 2.1 time: 0.163890 Sep 23 03:40:35.242813 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 422/776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:35 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:35.257419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:35.258489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:35.264324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:35.265242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:35.270937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.273007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.278581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.279609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.281787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.282491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.286092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.292504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.293319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.294320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.294962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.295574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.324688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:35.447081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2aba796-43fe-42eb-9d57-34e1bde515f1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70/action" status: 204 len: 0 microversion: 2.1 time: 0.203513 Sep 23 03:40:35.450935 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 355/777] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:35 2022] POST /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70/action => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:40:35.472401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:35.474853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:35.498536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.499319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.499997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.500875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.501531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.502113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.707475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:35.732340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:35.743311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:35.747935 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b72075f-1747-496c-92b3-5893988a303c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1342 microversion: 2.25 time: 0.298421 Sep 23 03:40:35.748448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 356/778] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:35 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:35.764556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:35.767236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:35.777230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.785321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.786057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:35.787679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:35.794554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:35.796201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.055230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.065953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2202563c-1f11-4405-a5e8-720db11d24a1 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.821817 Sep 23 03:40:36.070426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 423/779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:35 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:36.079449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34833d-426f-43d5-b774-b3abeb973bc3", "name": "network-vif-plugged", "status": "completed", "tag": "9c805b36-734f-4ac0-a311-a069e387059c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:36.109135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.110474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.111139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.134619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] Creating event network-vif-plugged:9c805b36-734f-4ac0-a311-a069e387059c for instance 7d34833d-426f-43d5-b774-b3abeb973bc3 on n-h2-858495-2 Sep 23 03:40:36.151396 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8d8cfda4-989f-4acf-a5de-35abdc208998 req-c4095473-5d92-4be1-a10c-81b7d98d26b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079194 Sep 23 03:40:36.153221 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 424/780] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:36.159396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:36.163791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:36.174374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.181993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.182704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.183666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.184333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.185003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.282793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.292475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af794869-61ae-4f6f-b591-81559b362cbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1470 microversion: 2.1 time: 0.531922 Sep 23 03:40:36.313747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 357/781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:35 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1470 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:36.318565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:36.319189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:36.339002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.339419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.339867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.340592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.341060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.341526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.548708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.568184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e1eb6384-99a5-4f50-9e85-366a43d2037c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1268 microversion: 2.1 time: 0.253259 Sep 23 03:40:36.574085 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 358/782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:36 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:36.583618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.594482 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-821001b1-cf94-45f9-bb4a-d5fd321eb85d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.437086 Sep 23 03:40:36.595139 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 425/783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:36 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:36.713462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3e1ea2-2cec-4495-ba93-f7e2439b352e", "tag": "b8c2dfd0-50c2-43db-8062-4da807f40628"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:36.734878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.737240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.737920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.752203 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] Creating event network-changed:b8c2dfd0-50c2-43db-8062-4da807f40628 for instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e on n-h2-858495-2 Sep 23 03:40:36.758963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5cf08a44-a178-47c5-8ace-40c95909ed1d req-ffa8052c-367d-4d8e-80a6-fc55427c51f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051533 Sep 23 03:40:36.762381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 359/784] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:36.777151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:36.778051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:36.795469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.799597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.801764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.810815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:36.811793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:36.813316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:36.919507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.934808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.936510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:36.938571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c0f9131-f078-4f82-bef3-4a270c174caa tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1342 microversion: 2.25 time: 0.165925 Sep 23 03:40:36.955972 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 426/785] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:36 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:37.097606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:37.098711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:37.109473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.110049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.110561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.111665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.112334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.112960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.316629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:37.321318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:37.322595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:37.324319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29a1498f-c02e-4b7f-a81c-4d79df3daaad tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1319 microversion: 2.1 time: 0.231523 Sep 23 03:40:37.332866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.333627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.334260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.335116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.336354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.336963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.338624 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 360/786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:37 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:37.490480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:37.499377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1081bb6a-e94a-4003-8e5e-3a7b4b8ddac7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1470 microversion: 2.1 time: 0.183024 Sep 23 03:40:37.500311 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 427/787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:37 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:37.604361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:37.604361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:37.610570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.611077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.611591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.619192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:37.619901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:37.625457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.626265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.626823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.629837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.630318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.630759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.633830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.634305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.634745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.818523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:37.832639 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6319d122-af90-49ef-9740-6ed1e102421a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1274 microversion: 2.1 time: 0.237369 Sep 23 03:40:37.836493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 361/788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:37 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:37.964205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:37.965213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:37.977497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.978278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.978727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.979449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:37.980141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:37.980920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:37.987113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:38.037503 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e4d2cf13-b9f0-441b-af01-62b549c3527f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.423748 Sep 23 03:40:38.041603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 428/789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:37 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:38.087602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:38.098428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:38.101461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:38.102894 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fae892b-b1f6-4549-9823-8c5857afded2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1342 microversion: 2.25 time: 0.142980 Sep 23 03:40:38.103584 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 362/790] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:37 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1342 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:38.333831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d6cc8b-acac-49a5-a872-07e776dccc70", "name": "network-vif-plugged", "status": "completed", "tag": "d4811bc1-dad1-45e7-b932-16ece79a1dd4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:38.349344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:38.350162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:38.350460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.353020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.353298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:38.353790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.362131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.362856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.363467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.364391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.365016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.365648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.376982 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Creating event network-vif-plugged:d4811bc1-dad1-45e7-b932-16ece79a1dd4 for instance 50d6cc8b-acac-49a5-a872-07e776dccc70 on n-h1-858495-2 Sep 23 03:40:38.394595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:40:38.406445 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d8a15143-6c05-47a9-9ed8-121a3650a00d req-aa0a3d13-6423-4466-a33c-56c3b14e6c9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076140 Sep 23 03:40:38.411409 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 429/791] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:38.524032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:38.529037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:38.539064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.539566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.540170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.540894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.541423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.541951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.559347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:38.576370 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c65e6c2-52bf-402e-9e94-ce3e5c269949 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1469 microversion: 2.1 time: 0.230527 Sep 23 03:40:38.593608 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 363/792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:38 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:38.789054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-457577280", "block_migration": true, "disk_over_commit": false}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:38.792004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:38.809877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.810376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.810817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.811572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.812038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.813038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.843847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lazy-loading 'flavor' on Instance uuid 7d34833d-426f-43d5-b774-b3abeb973bc3 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:38.858917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Going to try to live migrate instance to tempest-host-457577280 {{(pid=128723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:40:38.875816 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] HTTP exception thrown: Compute host tempest-host-457577280 could not be found. Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Request method failure captured: Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3/action HTTP/1.1 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 106 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqfzo-dLj1IqS35nO3tnJfKDO7BkV49_dcAmvuN-ufqSgYLQquLyykZ8gTjz6Uh2ueKJP7k-ZJOFB9gZS-B1rMk4OA6FnM9DSQ0bQB39JYkm-wmfynYbstNsMDGWZ68A2jj2sgc7dCXv-9hlNF1Zahh7gP40ZuoPu3BXnKNNfgA0ac Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2ef9f0a301d748e6a7eb54d841716044 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:40:38.885756 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2ef9f0a301d748e6a7eb54d841716044 Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveMigrationNegativeTest-792913092-project-admin Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4795c3322fe64128a80137a83f8c5c56 Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveMigrationNegativeTest-792913092-project-admin Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: {"os-migrateLive": {"host": "tempest-host-457577280", "block_migration": true, "disk_over_commit": false}} Sep 23 03:40:38.887395 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: exception: Compute host tempest-host-457577280 could not be found. Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7d34833d-426f-43d5-b774-b3abeb973bc3', 'body': {'os-migrateLive': {'host': 'tempest-host-457577280', 'block_migration': True, 'disk_over_commit': False}}} Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:40:38.888238 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-457577280 could not be found. Sep 23 03:40:38.889658 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-457577280 could not be found. Sep 23 03:40:38.891553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-457577280 could not be found. Sep 23 03:40:38.893992 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:40:38.897925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Returning 400 to user: Compute host tempest-host-457577280 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:40:38.897925 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3265926-596d-48b6-9d5c-461ecb01b2a5 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3/action" status: 400 len: 99 microversion: 2.1 time: 0.288765 Sep 23 03:40:38.898254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 364/793] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Sep 23 03:40:38 2022] POST /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3/action => generated 99 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 23 03:40:38.904966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:38.906330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:38.924696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.925068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.925848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:38.941722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:38.942442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:38.942911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.186370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.196649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f83871e3-5cbd-4d26-aa64-d8e60ba00632 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1274 microversion: 2.1 time: 0.296725 Sep 23 03:40:39.202752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 365/794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:38 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1274 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:39.209827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:39.217492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:39.236357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.236914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.237516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.239022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.240466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.242650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.243372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.245864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b560f59b-56b4-4675-bbfb-50b5654485d0 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1470 microversion: 2.1 time: 0.726398 Sep 23 03:40:39.261945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 430/795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:38 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1470 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:39.271207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:39.272154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:39.281382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.282032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.282558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.283365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.284075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.284588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.470178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.474256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:39.480054 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c37b7fe-9244-4543-b9ec-3ab4a88006e8 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1469 microversion: 2.1 time: 0.275855 Sep 23 03:40:39.481209 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 366/796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:39 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:39.482199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.486898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:39.487507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:39.494653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8ffd78c-6677-47d3-9b08-8f3f9c839c19 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.230482 Sep 23 03:40:39.496894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 431/797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:39 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:39.514651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.516049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.517396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.518550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:39.519182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:39.519780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:39.678929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1741029108", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:39.719563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.728767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.730315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:39.732075 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f47d71f3-d142-4247-befc-35b25ac99d2f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.249714 Sep 23 03:40:39.732957 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 367/798] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:39 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:39.776962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:40.012244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:40.012754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:40.013302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:40.013869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:40.014364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:40.024372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.024859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.025297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.026063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.026519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.026945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.044207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Getting quotas for project af6e4f6b49cc48f28a3aa95057d1c9bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:40.049099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Getting quotas for user 501285a24b7a4bf39f0dea6763205885 and project af6e4f6b49cc48f28a3aa95057d1c9bd. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:40.059733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:40.062109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:40.111965 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-591dcd1f-da20-49c8-9016-2ac5a40ce735 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437204 Sep 23 03:40:40.118782 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 432/799] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:40.130169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e788ebd-e48e-4a58-ba0d-585420da3d19 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:40.133799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e788ebd-e48e-4a58-ba0d-585420da3d19 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:40.219279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5e788ebd-e48e-4a58-ba0d-585420da3d19 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:40.232462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:40.233675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:40.238866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e788ebd-e48e-4a58-ba0d-585420da3d19 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1219 microversion: 2.1 time: 0.113203 Sep 23 03:40:40.239603 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 368/800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:40 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:40.245571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.246401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.247276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.248476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.249437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.250252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.280446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:40.281893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:40.290054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.291378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.292077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.293168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.293876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.294639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.365327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:40.374448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f696963e-de1a-425e-b6f7-761d54e587bf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1274 microversion: 2.1 time: 0.148976 Sep 23 03:40:40.375444 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 433/801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:40 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:40.519531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:40.525396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:40.526144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:40.533132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.533847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.534588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.535488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.536154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.536982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.562295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-376dca56-9f5f-40a8-9277-9c64b53f8fd6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1462 microversion: 2.1 time: 0.286942 Sep 23 03:40:40.564179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 369/802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:40 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1462 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:40.592736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:40.598179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:40.624571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.626121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.626715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.627590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:40.628500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:40.629082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:40.984844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:40.994000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a489284-36e4-41bd-bbf4-de2fd2a85e4b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.472746 Sep 23 03:40:41.002940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.013443 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 434/803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:40 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:41.021432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:41.022458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:41.027705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02662af7-aa25-42e0-a621-18b20f83e08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1462 microversion: 2.1 time: 0.439389 Sep 23 03:40:41.032567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.033333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.034332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.035221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.035813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.036573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.037393 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 370/804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:40 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1462 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:41.060570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39326f05-164c-424b-8b65-336ce58f572a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'create', calling method: .version_select at 0x7f0c8b67e5e0>, body: {"keypair": {"name": "tempest-keypair-759117793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIgi/4lJKxlqYNl+61ueMWLHAuH+mDdEizkSh+z5dbSdJtXQ4hfmweNmwF7WbvZCpvRmXuwmVTvn1iyxg0hguwq+uvg1+ts0h818eDTQpOxMKTPmds2w0p1X4XH4oMSNg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:41.096255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-39326f05-164c-424b-8b65-336ce58f572a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:41.100941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-39326f05-164c-424b-8b65-336ce58f572a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:41.137766 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39326f05-164c-424b-8b65-336ce58f572a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087061 Sep 23 03:40:41.161176 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 371/805] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:40:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:41.267783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:41.268432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:41.279873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.284470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.287496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.289217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.289884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.292806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.443918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.450226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.476062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.477689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.478944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2734fe8a-c07f-4c18-bd01-51d008549074 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.464235 Sep 23 03:40:41.490557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8b6171e-c97e-4997-a88b-ae6da865f140 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1271 microversion: 2.1 time: 0.227001 Sep 23 03:40:41.490715 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 435/806] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:41 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:41.497464 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 372/807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:41 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:41.520279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:41.521150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:41.527966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.529131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.529760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.530659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:41.531817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:41.532421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:41.926309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:41.936676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-08196d25-a4e6-4a54-8333-dc77ab495215 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.443598 Sep 23 03:40:41.938920 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 436/808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:41 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:42.022232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:42.022833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:42.030293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.030807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.031787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.032689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.033219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.033849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.260036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:42.275991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1be00313-f892-4f55-a28c-e08069e4475d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.256344 Sep 23 03:40:42.289521 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 373/809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:42 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:42.525706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:42.526316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:42.530156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:42.530795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:42.541717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.543508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.544567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.545004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.545901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.547031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.547739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.548298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.548907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.549537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.553104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.553607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.689768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:42.701158 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09e6a563-a4b9-46c4-a44c-f846e652374d tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1277 microversion: 2.1 time: 0.178954 Sep 23 03:40:42.701809 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 437/810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:42 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:42.845335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:42.897175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:42.902566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:42.912885 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d27de3a-301c-4e12-90a3-795790d3ba26 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.392461 Sep 23 03:40:42.913548 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 374/811] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:42 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:42.962311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:42.962940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:42.977710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.978706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.979852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:42.980763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:42.981411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:42.983627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.302649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:43.303301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:43.322630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:43.325728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:43.326619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.330463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:43.331879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:43.335671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.410809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:43.460590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f2b501b-b732-4e80-a81e-fd68557a0411 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.502754 Sep 23 03:40:43.468842 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 438/812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:42 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:43.693709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93bebe0e-8292-404c-a865-2998107abce6 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '.version_select at 0x7f0c8b5f44c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:43.699197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93bebe0e-8292-404c-a865-2998107abce6 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:43.701690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93bebe0e-8292-404c-a865-2998107abce6 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:43.703423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93bebe0e-8292-404c-a865-2998107abce6 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.735677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93bebe0e-8292-404c-a865-2998107abce6 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.044562 Sep 23 03:40:43.749435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 439/813] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:43.761077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:43.766864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:43.781961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:43.782889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:43.783602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.786191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:43.787244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:43.790278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:43.817613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:43.836232 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-abdd162b-ecc1-43a7-8f0c-7c62b2977964 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.535022 Sep 23 03:40:43.837503 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 375/814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:43.842781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0f87d23-e453-48c4-9235-055c7e381286 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:43.864828 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0f87d23-e453-48c4-9235-055c7e381286 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025940 Sep 23 03:40:43.873953 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 376/815] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:43.884868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-709ae70e-62f1-4464-8fa0-538d58625e2f tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-85594482", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:43.917790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:43.942505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-709ae70e-62f1-4464-8fa0-538d58625e2f tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.065966 Sep 23 03:40:43.943377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 377/816] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Sep 23 03:40:43 2022] POST /compute/v2.1/flavors => generated 497 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:43.957196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:43.966797 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d96330c8-3f04-4369-90ed-2403c4bd4cfb tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1277 microversion: 2.1 time: 0.215361 Sep 23 03:40:43.983091 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 440/817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:43.985049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:43.992488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:44.006988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-796445a7-9adc-412d-86f8-6dbd6adcb880 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:44.033270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:44.034789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:44.035407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:44.036344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:44.038079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:44.041404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:44.052040 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-796445a7-9adc-412d-86f8-6dbd6adcb880 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.067482 Sep 23 03:40:44.058524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 441/818] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:40:44.301295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2135845270", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "775de369-2ed1-4678-8edd-6538a62520ee"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:44.402274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:40:44.491022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:44.518420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:44.528885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:44.533098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-242327e8-125c-4659-90b7-bd7115db745d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.587324 Sep 23 03:40:44.544244 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 378/819] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:43 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:44.559221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:44.582956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:44.584066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:44.586690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:44.618496 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] Creating event network-changed:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h1-858495-2 Sep 23 03:40:44.631527 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fbf48aae-4696-47f5-87a6-5ea14e28d5fb req-1229d462-8612-43bb-81c8-21fd5a96b332 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081619 Sep 23 03:40:44.632736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 379/820] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:44.647407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:44.656553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:44.674059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:44.674573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:44.675021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:44.677647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:44.681125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:44.681738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.004861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:40:45.005385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:40:45.005802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:40:45.006469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:40:45.007170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:40:45.031311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.031825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.032266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.033003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.033493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.033927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.101754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:45.114644 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b810d39b-1e57-4cf8-bab9-bd36af87033f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.480298 Sep 23 03:40:45.117722 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 380/821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:44 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:45.132910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:40:45.134825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:45.141952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:45.156383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:40:45.167180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.170076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.170770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.172404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.173456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.178612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.190007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:40:45.193274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:40:45.292090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:45.370693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cffbe7b7-ac65-4a5c-9b95-537ab8dbb08c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070944 Sep 23 03:40:45.381129 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 442/822] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:40:45.393890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:45.394515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:45.413909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.414419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.414868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.415592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.416054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.416485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.747334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:45.760965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff648fa9-4c33-4a81-8f32-dae0f344adec tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.642039 Sep 23 03:40:45.769955 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 381/823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:45 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:45.799455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-762c7b23-d122-4973-81da-ac6b31b80d68 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:45.803549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-762c7b23-d122-4973-81da-ac6b31b80d68 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:45.898267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:45.906388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:45.914848 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dad12ded-346c-4b5b-9773-eb34ff395407 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.530580 Sep 23 03:40:45.919410 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 443/824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:45 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:45.932958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:45.937833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:45.956053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.956569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.957010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:45.957965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:45.971375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:45.974527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.016378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-762c7b23-d122-4973-81da-ac6b31b80d68 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:46.020994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=35 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:46.032533 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-762c7b23-d122-4973-81da-ac6b31b80d68 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1279 microversion: 2.1 time: 0.255497 Sep 23 03:40:46.035492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 382/825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:45 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:46.114790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3e1ea2-2cec-4495-ba93-f7e2439b352e", "name": "network-vif-plugged", "status": "completed", "tag": "b8c2dfd0-50c2-43db-8062-4da807f40628"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:46.136545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.141653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.145044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.173505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] Creating event network-vif-plugged:b8c2dfd0-50c2-43db-8062-4da807f40628 for instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e on n-h2-858495-2 Sep 23 03:40:46.180114 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9de5e41d-749f-4411-8834-05cb5afc2682 req-a9ccbca5-da8e-4e1e-b4dc-c6bceccddcb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070208 Sep 23 03:40:46.181301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 383/826] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:46.188134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:46.189144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:46.217805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.219879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.243898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.247518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.250790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.261665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.343412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:46.419137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:46.424013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:46.430333 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b2d87f9-3c25-44ed-969f-f9adaf780814 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.507011 Sep 23 03:40:46.452791 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 444/827] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:45 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:46.800003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:46.800877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:46.802228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:46.812339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.812686 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-450bee0f-dbbd-4319-b9a0-ec907bf83906 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.628745 Sep 23 03:40:46.813649 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 384/828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:46 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:46.816176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.817835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.818772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.823106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.826117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.948100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:46.949118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:46.971782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.977826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.978431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:46.986923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:46.989576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:46.990138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.313238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.327001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b1c9681-a43b-4a75-9f84-5577ae13b583 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.534586 Sep 23 03:40:47.363625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 445/829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:46 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:47.386017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:47.386642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:47.403252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.403748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.409103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.411251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.416015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.417596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.630518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.641225 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0b36801-fa29-4b72-9046-1661d6b62999 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.698121 Sep 23 03:40:47.647207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.658956 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 385/830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:46 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:47.664185 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e1b9ccf-c3ae-477f-ab7d-0ae9ee244b6c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1275 microversion: 2.1 time: 0.288593 Sep 23 03:40:47.680150 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 446/831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:47 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1275 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:47.686466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:47.689178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:47.697184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.698037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.698652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.699541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.700220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.701396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.836371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:47.838054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:47.850067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.853448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.854954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.858569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:47.859271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:47.860906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:47.941825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.951295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.958723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:47.959897 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99c16a19-e460-4f58-ab98-3dcdf7a8e3ff tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.296617 Sep 23 03:40:47.970738 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 386/832] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:47 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:48.134790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:48.146583 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1e95e61-d91f-4b8b-aec3-5a18ed4bd635 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.314170 Sep 23 03:40:48.147881 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 447/833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:47 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:48.252293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af7665c-7c20-4487-814f-72a67ee18bd8", "tag": "85b6322e-6c5b-4652-9d6e-ba756d914a6e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:48.286702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.287581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.288277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.305642 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] Creating event network-changed:85b6322e-6c5b-4652-9d6e-ba756d914a6e for instance 1af7665c-7c20-4487-814f-72a67ee18bd8 on n-h2-858495-2 Sep 23 03:40:48.311292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8952cbf2-36e9-4cf2-9e6c-45a481716bb6 req-3abaceb3-c9f6-46fa-81da-e36d1e1348ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073138 Sep 23 03:40:48.313244 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 387/834] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:48.360508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:48.361326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:48.370289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.371750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.372565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.373965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.380248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.382701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.590124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:48.604130 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a8895e1-153f-4347-baf4-125654aa7ced tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1311 microversion: 2.1 time: 0.247755 Sep 23 03:40:48.622420 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 448/835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:48 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:48.666541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:48.667657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:48.684633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.686467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.687615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.688519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.689540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.690198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.694428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:48.695195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:48.703091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.703999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.705154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.706300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:48.707501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:48.708167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:48.812485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:48.828463 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2998f794-5f74-4cf1-a249-09b5b4ef803d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1331 microversion: 2.1 time: 0.137492 Sep 23 03:40:48.829497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 449/836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:48 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:48.904771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:48.928129 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b8e4fc78-d172-4c77-ac02-95cec1add563 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.265814 Sep 23 03:40:48.930636 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 388/837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:48 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:48.997886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:48.998889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:49.013101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.017312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.020638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.021902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.023086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.031057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.178776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:49.180616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:49.189855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.190738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.191885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.192858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.193650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.194308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.629962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:49.646647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:49.648784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:49.657795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1820b1d1-4117-4f32-851e-d76f7a175c5f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.663673 Sep 23 03:40:49.666319 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 450/838] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:48 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:49.681386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:49.689833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:49.696376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.697978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.698740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.700419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.703038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.703582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.732124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:49.741375 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5523418-fcf2-49ab-a6f7-518266c28e96 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.567210 Sep 23 03:40:49.749703 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 389/839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:49 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:49.855870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:49.856939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:49.871023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.874062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.876262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.880411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:49.881505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:49.882903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:49.943380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:50.045849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:50.077501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-abb2a063-a411-4037-988d-3661b6636289 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1337 microversion: 2.1 time: 0.225428 Sep 23 03:40:50.080048 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 390/840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:49 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1337 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:50.088690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:50.089704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:50.106660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.107492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.108105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.109605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.110864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.111455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.286950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:50.296944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d021f6e-7c7a-4a7a-9e23-499c3983d327 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1494 microversion: 2.1 time: 0.629176 Sep 23 03:40:50.304605 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 451/841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:49 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1494 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:50.327844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:50.329468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:50.336155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.336963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.337861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.339627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.340322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.340968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.516947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:50.527782 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76b6d311-b30e-4886-a1ec-304c45fc83c5 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.445131 Sep 23 03:40:50.528730 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 391/842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:50 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:50.538419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a4bf4d-cbeb-4135-97c0-5e5eb9750002", "tag": "c3472564-201c-4414-93eb-6999cbb51ddf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:50.552704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.554150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.555015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.590488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] Creating event network-changed:c3472564-201c-4414-93eb-6999cbb51ddf for instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 on n-h1-858495-2 Sep 23 03:40:50.603856 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d6d4586d-3d60-448e-85fa-c175d40b3cd8 req-f60ae4ef-4cad-4a6c-9ebc-35b38ab72cf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069038 Sep 23 03:40:50.607212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 392/843] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:50.622416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5af9c3f-4b5b-4f9b-9068-badf3c9e791e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1645 microversion: 2.1 time: 0.299118 Sep 23 03:40:50.625266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 452/844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:50 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1645 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:50.670070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:50.672193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:50.681615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.682490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.683139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.684438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.685221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.686170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.702684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:50.703401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:50.713938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.719091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.719876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:50.721241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:50.721954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:50.723020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:51.689603 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5932e21-d7e1-4d91-aa58-b30f01525974 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1645 microversion: 2.1 time: 1.041551 Sep 23 03:40:51.703373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 393/845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:50 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1645 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:51.740251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:51.741664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:51.744188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:51.752025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:51.752683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:51.753233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:51.754093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:51.754665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:51.755204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:51.759131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:51.763229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:51.764682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef6fbf8c-bb71-4f9b-a8b2-98951eed071e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 1.070503 Sep 23 03:40:51.765669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 453/846] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:50 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:40:51.800135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:51.801194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:51.811167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:51.813586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:51.814689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:51.816023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:51.818697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:51.820297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.075477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:52.087781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5cf4d9a5-4de8-4a84-adb1-5c621d739bd2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.378176 Sep 23 03:40:52.089156 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 394/847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:51 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:52.099436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:52.102751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:52.117182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.122281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.122952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.123978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.124787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.131365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:52.141469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.151124 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2adf111-eab7-4493-ae3a-7125b432de5e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.359377 Sep 23 03:40:52.152215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 454/848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:51 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:52.167548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:52.174056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.177414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.178379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.179579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.181507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.182835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.236191 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22dd0216-5350-44fa-b6dd-8483eae25957 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082518 Sep 23 03:40:52.241661 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 455/849] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:40:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:52.253906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:52.254458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:52.262174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.262678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.263292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.265308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.265884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.266325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.434449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d9e9b3a-fc5d-4d28-9406-83b1e473c78d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e/action" status: 202 len: 0 microversion: 2.1 time: 0.188758 Sep 23 03:40:52.438645 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 456/850] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:52 2022] POST /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:52.474979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:52.479003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:52.518006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.523099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.526719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.527152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.532332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.537389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.558065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:52.569748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-895def1f-3e9f-4378-9429-3676651c5f0b tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.478616 Sep 23 03:40:52.573565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 395/851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:52 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:52.750442 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90a6e731-cc34-4ca8-9216-d31e3a31e4fc tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1650 microversion: 2.1 time: 0.309968 Sep 23 03:40:52.775384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 457/852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:52 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1650 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:52.793303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:52.794143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:52.803780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.806037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.809763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:52.811286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:52.812867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:52.813766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.046546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:53.057394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:53.059017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:53.060153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a7e4ab9-2a2c-466d-8ee2-2a9c74471683 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.271553 Sep 23 03:40:53.065996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 396/853] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:52 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:53.125683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:53.126708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:53.133857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.135157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.135806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.136751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.137536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.138199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.182383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:53.183198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:53.191851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.192710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.193512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.194607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.195557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.196034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.415029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:53.430614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5953376b-2949-4cae-9b9f-78166bf31c44 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.309995 Sep 23 03:40:53.431218 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 458/854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:53 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:53.486072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:53.495979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f419428-06ae-4221-8715-6f8a4f49cbe2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.317653 Sep 23 03:40:53.501905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 397/855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:53 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:53.600872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:53.601909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:53.614344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.625732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.626485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.627414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.628039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.628652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.776894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:53.778557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:53.801623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.802938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.803701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:53.804671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:53.805933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:53.806561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.302092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:54.322226 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6da407a0-496e-4ffb-9088-7be1fcd116f4 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.725900 Sep 23 03:40:54.322929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 459/856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:53 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:54.342931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "name": "network-vif-plugged", "status": "completed", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:54.359814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-946fe8c8-3e60-40e0-943a-51132796a0e3 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1630 microversion: 2.1 time: 0.588298 Sep 23 03:40:54.371373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 398/857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:53 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1630 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:54.403045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:54.403538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:54.403985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.407941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:54.408593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:54.421293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:54.440436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:54.441094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:54.441584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.442302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:54.442846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:54.443375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.444178 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] Creating event network-vif-plugged:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h1-858495-2 Sep 23 03:40:54.463948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-df5dfaa8-5957-4649-9f17-8a2ab4e27493 req-75b1c8af-39d2-48ab-b5b7-642c80db32c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129598 Sep 23 03:40:54.468184 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 460/858] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:54.484312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858495-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:54.505697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:54.524787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:54.525585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:54.526408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.527423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:54.529041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:54.530314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:54.597788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lazy-loading 'flavor' on Instance uuid cf3e1ea2-2cec-4495-ba93-f7e2439b352e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:40:54.629033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Going to try to live migrate instance to n-h1-858495-2 {{(pid=128724) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:40:54.912513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:54.941992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:54.953312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:54.962890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aefcc74f-687f-41e7-a61e-7271e0e25290 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.587377 Sep 23 03:40:54.974560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 399/859] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:54 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:54.981390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:54.987013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:55.038408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:55.039297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:55.039964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:55.043920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:55.044845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:55.045618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:55.185603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=16 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:55.583141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:55.601809 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-328783e8-ad6b-4b30-966d-9d9ecab6ed3f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.626374 Sep 23 03:40:55.647666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 400/860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:54 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:55.679338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:55.679981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:55.692262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:55.692770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:55.693212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:55.694152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:55.694887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:55.695473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:56.026677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:56.138008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:56.158906 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22fa026e-8f31-4a02-a107-bddd069be272 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.499599 Sep 23 03:40:56.182140 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 401/861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:55 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:56.201126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:56.205006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:56.228475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:56.243418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:56.243888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:56.244641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:56.245100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:56.245561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:56.641542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:56.664742 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9889b8d8-caca-4732-9ee9-e7e4821d872c tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.472345 Sep 23 03:40:56.664742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 402/862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:56 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:56.669818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:56.670752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:56.686229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:56.686987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:56.687272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:56.688026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:56.688570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:56.689044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.055696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:57.080590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:57.083349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:57.094595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce8bf848-ec3c-49b2-9c88-b2819c946863 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1409 microversion: 2.25 time: 0.435052 Sep 23 03:40:57.095996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 403/863] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:56 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:57.103685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:57.125522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.126948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.128371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.176921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] Creating event network-changed:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:40:57.187186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-280ac619-c0db-429c-8bf1-4e26fd615b43 req-780250e9-3448-4894-b7fe-fecc6e4b9bbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088792 Sep 23 03:40:57.188418 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 404/864] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:40:57.203364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:57.206690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:57.218149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:57.223422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.225387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.226334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.227956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.228942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.229908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.498561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf3a962f-1312-4ba9-9fe1-0722124d44ab tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e/action" status: 202 len: 0 microversion: 2.1 time: 3.028379 Sep 23 03:40:57.500001 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 461/865] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:40:54 2022] POST /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e/action => generated 0 bytes in 3031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:40:57.509990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:57.511397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:57.525321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:57.535153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.540791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.541635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.547062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.547799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.548517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.552043 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5abb771-8039-4169-9e77-80fa9b2c0cfc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.361394 Sep 23 03:40:57.556993 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 405/866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:57 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:57.577382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:57.586504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:57.596370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.596880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.597332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.598094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:57.598567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:57.599079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:57.970518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:57.982299 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2727df72-fb35-41f2-91dc-53d316a5fcde tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.479844 Sep 23 03:40:57.991121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.002750 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 462/867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:57 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:58.010414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11209d0b-79b7-4676-80c8-0117bf407e6f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.450692 Sep 23 03:40:58.013949 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 406/868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:57 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:58.015284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:58.016081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:58.030934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.031869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.032530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.034008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.035236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.036201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.057428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a4bf4d-cbeb-4135-97c0-5e5eb9750002", "name": "network-vif-plugged", "status": "completed", "tag": "c3472564-201c-4414-93eb-6999cbb51ddf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:40:58.073897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.074383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.098410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.112880 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] Creating event network-vif-plugged:c3472564-201c-4414-93eb-6999cbb51ddf for instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 on n-h1-858495-2 Sep 23 03:40:58.143765 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8801bbad-4380-4102-88c8-fed18e706208 req-c28d0b4d-01cb-444a-948e-da0957d1e02b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089311 Sep 23 03:40:58.145322 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 407/869] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:40:58.160561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:58.167401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:58.176116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.176607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.177035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.177795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.179706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.181795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.427697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.435538 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-589d6095-33e9-4cbf-b730-a28121c620ca tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 0.430915 Sep 23 03:40:58.445729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 463/870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:58 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:40:58.491354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.506302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.508175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.516492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-171a2a0b-8144-43cf-8eb5-7267fb9f2747 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1605 microversion: 2.25 time: 0.369943 Sep 23 03:40:58.517295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 408/871] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:40:58 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1605 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:40:58.546674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:58.547932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:58.555201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.556209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.556831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.557849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.558796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.559647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.580894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:58.582235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:58.592064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.593006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.593686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.594752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:58.595461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:58.596178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:58.602924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:40:58.791915 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbabe22d-d67e-4ed1-8922-1affda6ce545 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.250587 Sep 23 03:40:58.793340 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 464/872] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 03:40:58 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:40:58.874251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:58.886935 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-995539a0-3cca-49fe-9a24-ade7912f294c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.309679 Sep 23 03:40:58.889611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 409/873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:58 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:59.028781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:59.029578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:59.037882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:59.038881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:59.054660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.055749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.056555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.057251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.058121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.059026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.059963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.060844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.062844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.063438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.064588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.065230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.579187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:59.596224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:40:59.616553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d828e14a-40ab-48c9-8040-b03efe9986b6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.571453 Sep 23 03:40:59.622897 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 410/874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:59 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:59.627820 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-649702f3-0f8f-47ee-80fd-e0cff80b6d3e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.603086 Sep 23 03:40:59.630430 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 465/875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:59 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:40:59.632750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:59.633564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:59.642673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.643426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.644021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.645115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.645772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.646806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.914267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:40:59.915160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:40:59.932287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.940433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.941038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:40:59.944762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:40:59.951083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:40:59.952021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:00.849664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:00.860047 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fa5c705-8f3a-46b4-8ca2-a9e9439f5e54 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1319 microversion: 2.1 time: 1.235740 Sep 23 03:41:00.870175 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 411/876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:59 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1319 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:00.885439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af7665c-7c20-4487-814f-72a67ee18bd8", "name": "network-vif-plugged", "status": "completed", "tag": "85b6322e-6c5b-4652-9d6e-ba756d914a6e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:00.912344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:00.916796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:00.918183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:00.975126 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] Creating event network-vif-plugged:85b6322e-6c5b-4652-9d6e-ba756d914a6e for instance 1af7665c-7c20-4487-814f-72a67ee18bd8 on n-h2-858495-2 Sep 23 03:41:00.992705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f496ed81-d1bc-4d29-9c04-6f31701afa4d req-04c01bba-5740-4636-8c21-f80829fcf502 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119162 Sep 23 03:41:00.997026 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 412/877] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:01.016061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:01.017003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:01.028825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.029571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.030327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.031228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.031851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.032677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.070936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:41:01.212364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1545bc3f-954b-4843-bc66-59609beb9d02 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 204 len: 0 microversion: 2.1 time: 0.206469 Sep 23 03:41:01.213574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 413/878] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:01 2022] DELETE /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:41:01.220459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:01.221425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:01.228118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.231097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.231888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.232894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.234134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.234727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.449846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:01.468928 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-839411cb-5d30-4e37-b1c5-7919c8373e06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 1.560348 Sep 23 03:41:01.469865 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 466/879] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:40:59 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:01.474891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:01.490332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:01.515768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.516580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.517180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.518118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.518880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.519499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.770782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:01.780547 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08e5a3d2-4dbc-4437-892e-097cf70e9aa5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.564914 Sep 23 03:41:01.790529 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 414/880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:01 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:01.795686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:01.796492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:01.810996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.812271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.812909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.813850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.826160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.827472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.944770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:01.953171 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16c3e79f-b8ef-4fb5-8682-147b2ae26579 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.481808 Sep 23 03:41:01.955733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 467/881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:01 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:01.965095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:01.970293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:01.985626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.986419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.987024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:01.987914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:01.988530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:01.989114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.197557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:02.414190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:02.422899 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c5364aa-141b-448e-af3c-94787248add7 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1469 microversion: 2.1 time: 0.464983 Sep 23 03:41:02.423496 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 468/882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:01 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:02.453886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:02.459293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:02.485971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99312393-4c77-4310-a565-a5c18c2cb333 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1715 microversion: 2.1 time: 0.693738 Sep 23 03:41:02.502068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 415/883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:01 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1715 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:02.508161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:02.520343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:02.527418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.537754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.538730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.551116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.551631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.552083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.566346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.566921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.567379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.585792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] Creating event network-changed:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h1-858495-2 Sep 23 03:41:02.610007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5da9e5ae-3fa8-4d52-8738-81a06c11e582 req-882b526c-20f6-4eb4-9144-5c547ac3e0be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169534 Sep 23 03:41:02.615068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 469/884] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:02.618469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lazy-loading 'flavor' on Instance uuid c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:02.637309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:02.641886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:02.662443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.669030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.672739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.676790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.680319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.681098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.753317 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a977bbc4-e75d-4e73-b8c1-bf68b3adef59 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002/action" status: 202 len: 0 microversion: 2.1 time: 0.246421 Sep 23 03:41:02.755287 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 416/885] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:41:02 2022] POST /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:41:02.769536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:02.770267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:02.792615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.793124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.793807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:02.794539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:02.795032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:02.795989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.238171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:03.249981 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf09fff9-1997-4cb4-9fbd-d1b8d782be49 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1316 microversion: 2.1 time: 0.633013 Sep 23 03:41:03.250888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 470/886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:02 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:03.255478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:03.260188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:03.277258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.277803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.278254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.278991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.282115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.284350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.309906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:03.327696 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c896c962-c6c1-4a88-a9a1-fa649660e573 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1477 microversion: 2.1 time: 0.568489 Sep 23 03:41:03.338629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 417/887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:02 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:03.355109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:03.356265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:03.375165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.387622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.389799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.392285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.393164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.395017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.663232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:03.692224 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ac560229-4b53-46c6-aeb8-5d2627a790af tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.438596 Sep 23 03:41:03.710125 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 471/888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:03 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:03.719166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:03.722214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:03.750410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.751062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.751513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.752275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:03.752745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:03.753181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:03.980574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:03.992777 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11fcf1dd-12f0-4789-b82f-6b551fcac8e3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.652921 Sep 23 03:41:03.996754 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 418/889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:03 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:04.030356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:04.041858 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e0091dd-0799-43b5-9740-d8b57f4e767c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1715 microversion: 2.1 time: 0.341177 Sep 23 03:41:04.042982 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 472/890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:03 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1715 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:04.277119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:04.278061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:04.302632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.303137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.303603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.304307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.304778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.305215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.364696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:04.367727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:04.383700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.389237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.390011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.390936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.391557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.392350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.747461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:04.755865 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1dd295d6-7555-44d8-bf76-9eb2ed9d6f14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1465 microversion: 2.1 time: 0.483102 Sep 23 03:41:04.777445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 419/891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:04 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1465 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:04.777445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-plugged", "status": "completed", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:04.789260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.792181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.793236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.926626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:04.940599 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f0d4929-b87b-4c73-a626-f28212118886 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1460 microversion: 2.1 time: 0.582783 Sep 23 03:41:04.945872 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 473/892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:04 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1460 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:04.958631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:04.959439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:04.969933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.971290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.988604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:04.991526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:04.992032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:04.992486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:05.236064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] Creating event network-vif-plugged:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:41:05.244848 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-abb37a58-4031-4c44-ab2b-f610797091ec req-ce757796-6917-4930-b7ca-7ca756b2b70f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474490 Sep 23 03:41:05.252485 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 420/893] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:05.396551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:05.406843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-32065cc1-2f72-4ad1-820b-990f252372a1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.459333 Sep 23 03:41:05.410029 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 474/894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:04 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:05.414666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:05.415284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:05.445485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:05.445999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:05.446452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:05.447169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:05.447632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:05.448072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:05.612793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:05.613777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:05.623383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:05.623888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:05.624331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:05.625320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:05.625818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:05.626253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.197182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4f8a51aa-2ea4-433d-98d3-5b93b36fa542 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1616 microversion: 2.1 time: 0.942629 Sep 23 03:41:06.199898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 421/895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:05 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1616 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:06.207966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:06.225540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:06.237918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.240194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.241339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.242302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.242934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.243546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.320940 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1270370e-bc95-48b2-8473-5d120897e7b8 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1611 microversion: 2.1 time: 0.906605 Sep 23 03:41:06.324105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 475/896] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:05 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1611 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:06.344582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:06.349774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:06.370651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.376880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.377456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.379405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.379970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.382353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.400428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:06.617396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:06.630139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c22ff44-fdd3-4e92-810e-96bfa4fec0eb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1379 microversion: 2.1 time: 0.425698 Sep 23 03:41:06.635523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 422/897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:06 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1379 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:06.644452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: .version_select at 0x7f0c8b744c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-489519964", "policies": ["affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:06.740124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:06.754872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:06.766975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:06.777293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87aca6a3-c5ee-4abc-b84e-666f5ea91667 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1715 microversion: 2.1 time: 0.449117 Sep 23 03:41:06.783963 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 476/898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:06 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1715 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:06.798069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:06.806515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.809470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.811699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.816835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.817762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.818586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.856896 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a2ef91d-7c0c-4b5d-ad0a-1356895e4a7b tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071740 Sep 23 03:41:06.858677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 477/899] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:41:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:06.863899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:06.864841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:06.872961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.873831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.874438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.875459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:06.876236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:06.876832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:06.970026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:06.990973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:07.033227 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-461c6dfc-56fa-4d31-913a-0a7830b33502 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.395862 Sep 23 03:41:07.037670 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 423/900] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Sep 23 03:41:06 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:07.058521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858495-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:07.063871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:07.072401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.074128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.074849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.075871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.076637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.077295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.116297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Lazy-loading 'flavor' on Instance uuid c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:07.123778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:07.142379 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 while it is in vm_state suspended Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Request method failure captured: Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002/action HTTP/1.1 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 97 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqfzo-dLj1IqS35nO3tnJfKDO7BkV49_dcAmvuN-ufqSgYLQquLyykZ8gTjz6Uh2ueKJP7k-ZJOFB9gZS-B1rMk4OA6FnM9DSQ0bQB39JYkm-wmfynYbstNsMDGWZ68A2jj2sgc7dCXv-9hlNF1Zahh7gP40ZuoPu3BXnKNNfgA0ac Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2ef9f0a301d748e6a7eb54d841716044 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:41:07.152462 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef9f0a301d748e6a7eb54d841716044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2ef9f0a301d748e6a7eb54d841716044 Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-792913092 Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveMigrationNegativeTest-792913092-project-admin Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4795c3322fe64128a80137a83f8c5c56 Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveMigrationNegativeTest-792913092-project-admin Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: {"os-migrateLive": {"host": "n-h2-858495-2", "block_migration": true, "disk_over_commit": false}} Sep 23 03:41:07.153857 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'os-migrateLive' instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 while it is in vm_state suspended Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c2a4bf4d-cbeb-4135-97c0-5e5eb9750002', 'body': {'os-migrateLive': {'host': 'n-h2-858495-2', 'block_migration': True, 'disk_over_commit': False}}} Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 03:41:07.155433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:41:07.156515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 while it is in vm_state suspended Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 while it is in vm_state suspended Sep 23 03:41:07.161302 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:07.166808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:07.166808 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ffa87853-65ae-4f3d-96a3-393b57a2b516 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.305588 Sep 23 03:41:07.169690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 while it is in vm_state suspended {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:07.181498 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9028a3a1-33cb-444a-b49e-2331e0cabcc9 tempest-LiveMigrationNegativeTest-792913092 tempest-LiveMigrationNegativeTest-792913092-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002/action" status: 409 len: 155 microversion: 2.1 time: 0.141221 Sep 23 03:41:07.182576 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 424/901] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:41:07 2022] POST /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002/action => generated 155 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:41:07.186863 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 478/902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:06 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:07.211299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3e1ea2-2cec-4495-ba93-f7e2439b352e", "name": "network-vif-unplugged", "status": "completed", "tag": "b8c2dfd0-50c2-43db-8062-4da807f40628"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:07.213922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:07.216346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:07.239921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.241518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.242013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.242643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.243341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.243459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.244267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.247086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.255120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.272185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] Creating event network-vif-unplugged:b8c2dfd0-50c2-43db-8062-4da807f40628 for instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e on n-h2-858495-2 Sep 23 03:41:07.289652 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8f8c20ec-9621-4ec7-a9d9-961712ca8f5f req-8242f2c6-40d6-48b5-a40e-dbc0c3dbab5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094282 Sep 23 03:41:07.291168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 425/903] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:07.300738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-603197511", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d5d0352b-eecb-44df-a77f-39cfa53c40e5"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:07.327381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:41:07.371720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:41:07.537852 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7e4aae5-fb3f-4c66-b733-8282c3539819 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 204 len: 0 microversion: 2.1 time: 0.343654 Sep 23 03:41:07.539518 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 479/904] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:07 2022] DELETE /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:41:07.560712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:07.566060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:07.583943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.585968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.588057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.590780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.591582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.594407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.950268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:07.950896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:07.951564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:07.952816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:07.953385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:07.966910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:07.976917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ce2c701-ebb1-4210-82b0-5cad03fb94de tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1466 microversion: 2.1 time: 0.431412 Sep 23 03:41:07.993625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 480/905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:07 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1466 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:07.995025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.995928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.996667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:07.997710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:07.998952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:07.999396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:07.999878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.000017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:08.007279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.008200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.008841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.010339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.011269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.012289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.020589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:08.025668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:08.038037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 2 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:41:08.040710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:08.087949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128723) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 23 03:41:08.124544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:08.129491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:08.132660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:08.188621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:08.197802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-784195bd-3f31-4ee4-8ef2-eee1e9a02d4f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1529 microversion: 2.1 time: 0.202725 Sep 23 03:41:08.198972 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 481/906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:07 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1529 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:08.204613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.205608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:08.212122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.212842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.213716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.214630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.215433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.216019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.224156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:08.229079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:08.246157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=4154353c-3b6b-4b0f-bc5f-04338e267e74,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:08.309314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:08.321221 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dad91b3-2e5d-422a-b41f-1521906b4b56 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1647 microversion: 2.1 time: 0.120655 Sep 23 03:41:08.343958 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 482/907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:08 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:08.347397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:08.350065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.351019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:08.352618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:08.357287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.358535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.359771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.360518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.360974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.361510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.422176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:08.430179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:08.494470 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7cd1208-59ff-487d-9b0e-f16be9627f32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.199758 Sep 23 03:41:08.496614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 426/908] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:41:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1203 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:41:08.501816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.505015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:08.514687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.515341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.516037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.516927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.517505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.518018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.548371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:08.558984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4ca1412-8285-4d0a-84df-4651b47c7371 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.211962 Sep 23 03:41:08.559601 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 483/909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:08 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:08.574374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.581552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:08.583042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Searching by: {'deleted': False, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:41:08.605438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.606709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.607317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.608282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.608753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.609188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.707050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:08.716028 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b1adb4b-fa9d-4d2e-8f9a-5bea3bf9f058 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1529 microversion: 2.1 time: 0.218048 Sep 23 03:41:08.733376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 427/910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:08 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1529 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:08.743069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8efbf036-d594-4e23-b767-41aff301b262 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.771383 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8efbf036-d594-4e23-b767-41aff301b262 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/775de369-2ed1-4678-8edd-6538a62520ee" status: 202 len: 0 microversion: 2.1 time: 0.032106 Sep 23 03:41:08.774149 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 428/911] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:08 2022] DELETE /compute/v2.1/flavors/775de369-2ed1-4678-8edd-6538a62520ee => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:41:08.786591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cefd49c9-ef18-4fda-98c2-9b5773447350 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:08.793820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:41:08.837206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cefd49c9-ef18-4fda-98c2-9b5773447350 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.056596 Sep 23 03:41:08.838512 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 429/912] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:41:08 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:08.858506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:08.861530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:08.876558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.877975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.879649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:08.880874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:08.882651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:08.884519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.041387 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5132b3a-31aa-4f40-b855-85161443034e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.480663 Sep 23 03:41:09.046432 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 484/913] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:41:08 2022] GET /compute/v2.1/servers => generated 1001 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:09.063779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:09.064756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:09.081157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.082478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.083392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.085777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.087583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.088099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.103953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:09.121732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Old instance type tempest-test_resize_flavor_-85594482, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 03:41:09.163771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:09.165244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:09.169461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:09.170511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:09.172420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:09.452103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:09.473890 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5debf193-deb9-4b4f-a026-a72e1e2773e3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1466 microversion: 2.1 time: 0.418738 Sep 23 03:41:09.477333 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 485/914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:09 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1466 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:09.494129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4164af66-65ba-4549-b3b2-f201475aa973 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:09.494959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4164af66-65ba-4549-b3b2-f201475aa973 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:09.506312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:09.527180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d85f1bb-36e3-4fde-80d8-a418fb11303f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.673080 Sep 23 03:41:09.528698 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 430/915] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:41:08 2022] POST /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:41:09.541001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:09.545566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:09.577923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.578866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.579820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.580835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.581585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.582389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.650213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.658031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.658580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.659160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lazy-loading 'fault' on Instance uuid e19e69bb-33e0-4255-9811-268f04c45fc7 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:09.741619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4164af66-65ba-4549-b3b2-f201475aa973 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:09.752595 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4164af66-65ba-4549-b3b2-f201475aa973 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1218 microversion: 2.1 time: 0.273677 Sep 23 03:41:09.759563 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 486/916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:09 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:09.779269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:09.780238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:09.794112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3b2ab940804d72aac837e7d6264aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14ba31b92a6476e83d865495e9320f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:09.807288 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fcc3f06-f62a-4598-a642-6343d990de81 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 200 len: 1355 microversion: 2.1 time: 0.274329 Sep 23 03:41:09.812357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.812969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.813181 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 431/917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:09 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 1355 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:09.813290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.814069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.814534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.814967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.830873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:09.831860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:09.845618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.847127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.847793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:09.848738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:09.849479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:09.850111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:10.370363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:10.380093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7fa6c07-c383-4cfd-b54f-093e111992ad tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.565501 Sep 23 03:41:10.387525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 432/918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:09 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:10.395380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19e69bb-33e0-4255-9811-268f04c45fc7", "name": "network-vif-deleted", "tag": "874566c3-73c9-4318-92e0-d851d74bb1fe"}, {"name": "network-changed", "server_uuid": "cf3e1ea2-2cec-4495-ba93-f7e2439b352e", "tag": "b8c2dfd0-50c2-43db-8062-4da807f40628"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:10.421980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:10.422852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:10.423570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:10.447427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:10.449139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Creating event network-vif-deleted:874566c3-73c9-4318-92e0-d851d74bb1fe for instance e19e69bb-33e0-4255-9811-268f04c45fc7 on n-h1-858495-2 Sep 23 03:41:10.449976 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] Creating event network-changed:b8c2dfd0-50c2-43db-8062-4da807f40628 for instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e on n-h2-858495-2 Sep 23 03:41:10.459682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3a7d9ad-ab8a-4159-b5ce-95a3a138324e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1538 microversion: 2.1 time: 0.698984 Sep 23 03:41:10.478014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 487/919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:09 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1538 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:10.483716 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3ce3d789-81ff-4200-8a37-d80b7cc881fa req-0c3da17a-bfe7-48c3-9395-6370f2c5d3a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094507 Sep 23 03:41:10.484343 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 433/920] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:10.499831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:10.500806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:10.510687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:10.511678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:10.512455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:10.513405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:10.514166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:10.515800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:10.787661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:10.788378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:10.803830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:10.804302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:10.807492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:10.810491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:10.810983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:10.811434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.192168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:11.206641 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b850dd65-74e1-404f-ab78-f8958b3bc864 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1214 microversion: 2.1 time: 0.422330 Sep 23 03:41:11.223400 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 434/921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:10 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:11.240348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.241033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:11.255744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.257772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.258187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.259004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.259483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.259976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.289611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 HTTP/1.1 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:11.295696 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:11.297315 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e19e69bb-33e0-4255-9811-268f04c45fc7'} Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:11.298243 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:11.299733 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.304565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:11.306260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a9e44ff-938c-4707-b0af-4ca8821e30f5 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 404 len: 111 microversion: 2.1 time: 0.080413 Sep 23 03:41:11.307346 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 435/922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:11 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:11.324293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.325174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:11.337490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.339278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.340408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.341263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.341795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.343017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.362729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec HTTP/1.1 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:11.367944 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.370222 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8c6035db-8278-4bf6-89e6-04dbb50f9bec'} Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:11.371934 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.374340 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.377553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:11.379386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0ec32089-68f7-4ec4-8774-c0a8314445d8 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 404 len: 111 microversion: 2.1 time: 0.058879 Sep 23 03:41:11.380671 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 436/923] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:11 2022] DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:11.396105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.398774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:11.416388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.416968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.417595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.418603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.419147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.419721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.451087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec HTTP/1.1 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:11.455069 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.456344 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8c6035db-8278-4bf6-89e6-04dbb50f9bec'} Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:11.457110 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:11.458294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:11.459372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:11.459372 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6581d820-9ed2-4df7-b7aa-be50ec2b330c tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 404 len: 111 microversion: 2.1 time: 0.069237 Sep 23 03:41:11.459372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 437/924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:11 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:11.462976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.463600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:11.471364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.472082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.473084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.474064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:11.474750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:11.475452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:11.869293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:11.888567 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-240a344a-ec39-4d75-90e0-04fe8f07d365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1466 microversion: 2.1 time: 1.394676 Sep 23 03:41:11.889235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 488/925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:10 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1466 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:11.914525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39ebd463-6fd0-4713-be7c-6e1787bad1f9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '.version_select at 0x7f0c8b5da0d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.957700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39ebd463-6fd0-4713-be7c-6e1787bad1f9 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958524183" status: 202 len: 0 microversion: 2.1 time: 0.049935 Sep 23 03:41:11.960171 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 489/926] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:41:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958524183 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:41:11.974580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:11.975662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:12.000338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.001515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.003496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.004557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.006657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.009415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.237520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:12.253195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68ae20b3-4444-454d-aaa4-108574f7e417 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.794346 Sep 23 03:41:12.273391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 438/927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:11 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:12.280586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:12.280586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:12.309272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.309738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.310185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.310948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.311412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.311848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.629126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:12.650233 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4259b670-3e63-4f4b-9705-766cd4ff742b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1270 microversion: 2.1 time: 0.385751 Sep 23 03:41:12.651815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 439/928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:12 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1270 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:12.670894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a4bf4d-cbeb-4135-97c0-5e5eb9750002", "name": "network-vif-deleted", "tag": "c3472564-201c-4414-93eb-6999cbb51ddf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:12.692637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.693530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.694175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.725267 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] Creating event network-vif-deleted:c3472564-201c-4414-93eb-6999cbb51ddf for instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 on n-h1-858495-2 Sep 23 03:41:12.748764 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6662e9ae-b57b-4841-85c5-37915f1cd3a6 req-0a6350cf-8ca3-4e98-907c-8c3226b19fa9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094050 Sep 23 03:41:12.750892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 440/929] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:12.932429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:12.933828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:12.981556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.982415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.983092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:12.984355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:12.985027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:12.985747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.100267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:13.100681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:13.101128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.101904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lazy-loading 'fault' on Instance uuid c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:13.433841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:13.448862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51c84161-dc9a-4081-b84a-bb6644602b4e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 200 len: 1309 microversion: 2.1 time: 0.540723 Sep 23 03:41:13.451506 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 441/930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:12 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:13.465589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:13.466219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:13.484560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:13.489261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:13.489880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.490644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:13.491339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:13.493161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.576771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:13.603814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7e4f93e-c21d-4750-bc14-cccbe25efd27 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1538 microversion: 2.1 time: 1.641597 Sep 23 03:41:13.604436 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 490/931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:11 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1538 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:13.676957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:13.677610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:13.690570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:13.691142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:13.691608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.692338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:13.692804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:13.701831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:13.990928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:14.015973 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7aca5ed4-e3ae-46cc-b9a3-b3dd7e6c3eb7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1288 microversion: 2.1 time: 0.343513 Sep 23 03:41:14.026666 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 491/932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:13 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1288 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:14.052529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:14.067251 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b63d072a-aec4-486f-bdca-0891ae6ff7ca tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.610441 Sep 23 03:41:14.069324 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 442/933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:13 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:14.476435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:14.477236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: c2a4bf4d-cbeb-4135-97c0-5e5eb9750002] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:14.491039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.493427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.499024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.503431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.504065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.504617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.543381 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] HTTP exception thrown: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Request method failure captured: Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 HTTP/1.1 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqegq-8y4nLoc6BT42Wdp-4P1DjT3fC8UNafI0ThHn4wUNDd1earZCqkP0itOWc4XUJtI4eya8ZS63habu-H357MtbY249tMMeEOBf9ok6BsfNkMkcZri6NKCB00LwLa2UFVD0HdS4102f0cAJQXtn2LKQt5U-qbGryso6JOnMHGd4 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: af6e4f6b49cc48f28a3aa95057d1c9bd Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:41:14.545508 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: af6e4f6b49cc48f28a3aa95057d1c9bd Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveMigrationNegativeTest-698273048-project Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 501285a24b7a4bf39f0dea6763205885 Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveMigrationNegativeTest-698273048-project Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. Sep 23 03:41:14.546789 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'c2a4bf4d-cbeb-4135-97c0-5e5eb9750002'} Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:14.547534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. Sep 23 03:41:14.548691 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:14.554666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Returning 404 to user: Instance c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:14.555866 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73818f21-f46d-444c-a421-e19ccacf757e tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002" status: 404 len: 111 microversion: 2.1 time: 0.083381 Sep 23 03:41:14.556698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 492/934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:14 2022] GET /compute/v2.1/servers/c2a4bf4d-cbeb-4135-97c0-5e5eb9750002 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:14.565793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:14.566361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:14.575235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.580204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.583339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.585754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.587740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.591045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.632107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:14.634085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:14.646731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.647638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.649279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.650907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.651616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.652286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.680350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:41:14.830850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71ead3d4-5290-49c3-a0a5-efb703ba1365 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 204 len: 0 microversion: 2.1 time: 0.268099 Sep 23 03:41:14.832162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 443/935] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:14 2022] DELETE /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:41:14.848302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:14.866506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:14.898858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.900671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.907657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.908519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:14.916229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:14.922057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:14.974405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:15.555334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:15.566886 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2378a22b-9304-422f-81aa-082c63c6e5db tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1538 microversion: 2.1 time: 0.938566 Sep 23 03:41:15.567473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 493/936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:14 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1538 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:15.587896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:15.588711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:15.599423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:15.602355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:15.603154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:15.604078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:15.605860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:15.606854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:15.639946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:15.656879 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-69b4468f-e530-4d4b-a5a0-7eaddf2234d3 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1475 microversion: 2.1 time: 0.819432 Sep 23 03:41:15.657853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 444/937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:14 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1475 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:15.678037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:15.678672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:15.682363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:15.709746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:15.713553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:15.715208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:15.722110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:15.723880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:15.727620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:15.732853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:15.817202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:15.834913 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fc20260-6587-44fd-a8e3-8d5b30a845d9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1276 microversion: 2.1 time: 0.265008 Sep 23 03:41:15.836076 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 494/938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:15 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:16.252515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:16.261910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e6401d9-b4c4-4d3c-913c-8edc5b503577 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.602953 Sep 23 03:41:16.264291 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 445/939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:15 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:16.599077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:16.599703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:16.619251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:16.619958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:16.620426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:16.621189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:16.621756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:16.630039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:16.683288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:16.684064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:16.696738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:16.706208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:16.707980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:16.708990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:16.710173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:16.711112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:17.269250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:17.307436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ca885f5-d689-4fe3-8835-e0e47f430445 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1475 microversion: 2.1 time: 0.627198 Sep 23 03:41:17.309639 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 446/940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:16 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:17.328095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-699abed8-9dd6-4edb-957e-1b8a3a6a9355 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:17.360882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:17.371725 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71855190-ef92-4351-8fcd-37c324dc7223 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1538 microversion: 2.1 time: 0.781367 Sep 23 03:41:17.379001 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 495/941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:16 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1538 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:17.398559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:17.407574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:17.418814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-699abed8-9dd6-4edb-957e-1b8a3a6a9355 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1225018123" status: 202 len: 0 microversion: 2.1 time: 0.106643 Sep 23 03:41:17.422173 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 447/942] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:41:17 2022] DELETE /compute/v2.1/flavors/1225018123 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:41:17.435062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:17.442446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:17.445814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:17.462023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:17.462778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:17.464701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:17.465827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:17.466080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:17.493528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:17.495414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:17.509738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:17.514869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:17.522387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:17.529831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:18.010570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:18.187374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:18.196275 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7e157ab-1bcf-4e90-9fba-094834972876 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.814974 Sep 23 03:41:18.204889 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 496/943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:17 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:18.221559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0a5df7c-0519-4c0c-bbbb-10c867edaf70 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:18.300556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0a5df7c-0519-4c0c-bbbb-10c867edaf70 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.094114 Sep 23 03:41:18.302493 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 497/944] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:41:18 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:18.321131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a490d7c-05cc-4bfc-b7e8-e0a65b316dd4 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:18.358487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:18.367405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a490d7c-05cc-4bfc-b7e8-e0a65b316dd4 tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1923747897" status: 202 len: 0 microversion: 2.1 time: 0.049993 Sep 23 03:41:18.368540 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 498/945] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:41:18 2022] DELETE /compute/v2.1/flavors/1923747897 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:41:18.377618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:18.378469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:18.384428 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6865fe0f-e8f5-414c-9c28-eb515d4993d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.954732 Sep 23 03:41:18.390544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:18.391212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:18.392364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 448/946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:17 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:18.401643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:18.402502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:18.402995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:18.403444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:18.414119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-33e77c56-155b-40e2-a592-2a880e01161f tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:18.460496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=30 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:18.477336 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-33e77c56-155b-40e2-a592-2a880e01161f tempest-ServersWithSpecificFlavorTestJSON-1851116793 tempest-ServersWithSpecificFlavorTestJSON-1851116793-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080254 Sep 23 03:41:18.495034 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 449/947] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:41:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:18.506703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:18.507591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:18.515933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:18.516669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:18.517335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:18.518379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:18.519026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:18.519620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:18.698976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:19.314025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:19.334649 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9356667c-11d8-48da-a946-484a9d9e5e83 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1475 microversion: 2.1 time: 0.963262 Sep 23 03:41:19.345384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 499/948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:18 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1475 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:19.345892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:19.346404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:19.364629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.365132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.365607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.366332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.366819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.367206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.398097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:19.404077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 HTTP/1.1 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:41:19.411303 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:19.414579 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e19e69bb-33e0-4255-9811-268f04c45fc7'} Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:19.415289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:19.416876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:19.419220 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9dc7b518-0170-4389-b2fd-5e2c0ad00567 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.915122 Sep 23 03:41:19.419385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:19.419385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21db4d1c-1753-41ed-9649-a218af20f8c7 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 404 len: 111 microversion: 2.1 time: 0.076230 Sep 23 03:41:19.420227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 450/949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:18 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:19.437682 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 500/950] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:19 2022] DELETE /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:19.442604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:19.442810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:19.443279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:19.443404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:19.477887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.478417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.483187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.486517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.488856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.489390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.489829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.490536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:19.493049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.493306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:19.494089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.496236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:19.748549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:20.283178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:20.300357 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-036c8a0e-4dad-4ce2-9df4-3e607237dd28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.877577 Sep 23 03:41:20.301660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 451/951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:19 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:20.311539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:20.318301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: e19e69bb-33e0-4255-9811-268f04c45fc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:20.333258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.334106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.334755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.335669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.340398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.341155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.378270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 HTTP/1.1 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:20.381197 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:20.382745 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e19e69bb-33e0-4255-9811-268f04c45fc7'} Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:20.383613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. Sep 23 03:41:20.385112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.387354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance e19e69bb-33e0-4255-9811-268f04c45fc7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:20.388946 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3febc26-d779-45b5-a0e2-a0a73199ed10 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7" status: 404 len: 111 microversion: 2.1 time: 0.085463 Sep 23 03:41:20.390916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 452/952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:20 2022] GET /compute/v2.1/servers/e19e69bb-33e0-4255-9811-268f04c45fc7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:20.399149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34833d-426f-43d5-b774-b3abeb973bc3", "name": "network-vif-deleted", "tag": "9c805b36-734f-4ac0-a311-a069e387059c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:20.413033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:20.423532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.425846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.428849 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90b7c6f3-5f16-43ac-bec5-3d4f26580d5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1504 microversion: 2.1 time: 0.989947 Sep 23 03:41:20.429618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.433252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 501/953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:19 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1504 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:20.454411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4154353c-3b6b-4b0f-bc5f-04338e267e74", "tag": "499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:20.459096 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] Creating event network-vif-deleted:9c805b36-734f-4ac0-a311-a069e387059c for instance 7d34833d-426f-43d5-b774-b3abeb973bc3 on n-h2-858495-2 Sep 23 03:41:20.474205 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7e3f3faf-0e35-40d7-86df-ffb651cd5dce req-494f8c5e-45f3-4c1f-ac15-a37bd71c8e13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081788 Sep 23 03:41:20.478448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 453/954] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:20.480161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.481308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.482610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.489794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:20.490511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:20.503977 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] Creating event network-changed:499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7 for instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 on n-h1-858495-2 Sep 23 03:41:20.510004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.510522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.514263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-eb9a6ecc-61c3-4f7c-9ae5-b37cbe7d10af req-59708845-b8ca-423c-ae2c-da3f823801db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074983 Sep 23 03:41:20.514428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.515177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.515984 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 502/955] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:20.519973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.520658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.523445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:20.524375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:20.554978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.556249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.556875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.557894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.558569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.559206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.595718 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec HTTP/1.1 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:41:20.597994 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.599440 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '8c6035db-8278-4bf6-89e6-04dbb50f9bec'} Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:20.600322 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.601764 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.605592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:20.606668 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21282419-dd55-4ebb-8406-937219b82e47 tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 404 len: 111 microversion: 2.1 time: 0.089369 Sep 23 03:41:20.608024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 503/956] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:41:20 2022] DELETE /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:20.613632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:20.614418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:20.621051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.621579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.622030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.622519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lazy-loading 'fault' on Instance uuid 7d34833d-426f-43d5-b774-b3abeb973bc3 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:20.624134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.624792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.625573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.626465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.627081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.627904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.773430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '501285a24b7a4bf39f0dea6763205885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6e4f6b49cc48f28a3aa95057d1c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:20.787966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f5a5321d-21ef-4eb8-a505-0910ee73a8e9 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 200 len: 1309 microversion: 2.1 time: 0.306856 Sep 23 03:41:20.788815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 454/957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:20 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:20.799841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:20.801327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] [instance: 8c6035db-8278-4bf6-89e6-04dbb50f9bec] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:20.832022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.832382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.832811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.833881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:20.834707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:20.835497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:20.859587 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] HTTP exception thrown: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Request method failure captured: Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec HTTP/1.1 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSoT3eBBdvgtL6PJ-KnMYr0WOY4gh9gp-BaraKIDvTw-YqSFdUOPuQ3EprmSnVO9uXwLjd2vVW96SRjNHVuTMKeCi555v3bFi5hOb9eifldhzK5YQhe2-1mq7PYnER4wuDNE63w7NMN5EstirmFiWsTb4lG-CpijFYJ769rxItDT_yc Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:20.882863 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f14ba31b92a6476e83d865495e9320f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f14ba31b92a6476e83d865495e9320f6 Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571 Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0d3b2ab940804d72aac837e7d6264aed Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2068283571-project Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.884579 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8c6035db-8278-4bf6-89e6-04dbb50f9bec'} Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:20.885392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. Sep 23 03:41:20.887590 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:20.895408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] Returning 404 to user: Instance 8c6035db-8278-4bf6-89e6-04dbb50f9bec could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:20.898623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1bcafb18-1651-4a57-82cd-94907fd4827d tempest-ServersWithSpecificFlavorTestJSON-2068283571 tempest-ServersWithSpecificFlavorTestJSON-2068283571-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec" status: 404 len: 111 microversion: 2.1 time: 0.107740 Sep 23 03:41:20.899932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 455/958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:20 2022] GET /compute/v2.1/servers/8c6035db-8278-4bf6-89e6-04dbb50f9bec => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:21.072790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:21.089812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9cdfdbeb-6fa6-4077-b54b-2e5700228dc9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.476225 Sep 23 03:41:21.090898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 504/959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:20 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:21.323809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:21.324466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:21.348688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.349202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.349683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.350414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.350884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.351322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.467990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:21.470405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:21.506084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.513025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.514096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.515503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.515971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.516403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.762648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:21.780216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3638b9bf-2a08-4a2f-86e6-483204277c0b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.460340 Sep 23 03:41:21.795917 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 456/960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:21 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:21.822129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:21.823183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] [instance: 7d34833d-426f-43d5-b774-b3abeb973bc3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:21.856333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:21.859611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.860973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.861735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.862695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.863319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.864058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.881021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d627521-520e-4ae7-b407-49512013ecf0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1479 microversion: 2.1 time: 0.418612 Sep 23 03:41:21.894254 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 505/961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:21 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1479 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:21.906670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] HTTP exception thrown: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Request method failure captured: Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 HTTP/1.1 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqegq-8y4nLoc6BT42Wdp-4P1DjT3fC8UNafI0ThHn4wUNDd1earZCqkP0itOWc4XUJtI4eya8ZS63habu-H357MtbY249tMMeEOBf9ok6BsfNkMkcZri6NKCB00LwLa2UFVD0HdS4102f0cAJQXtn2LKQt5U-qbGryso6JOnMHGd4 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: af6e4f6b49cc48f28a3aa95057d1c9bd Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:41:21.909403 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6e4f6b49cc48f28a3aa95057d1c9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: af6e4f6b49cc48f28a3aa95057d1c9bd Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-698273048 Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveMigrationNegativeTest-698273048-project Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 501285a24b7a4bf39f0dea6763205885 Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveMigrationNegativeTest-698273048-project Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. Sep 23 03:41:21.910994 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7d34833d-426f-43d5-b774-b3abeb973bc3'} Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:41:21.915098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. Sep 23 03:41:21.916493 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:41:21.917922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] Returning 404 to user: Instance 7d34833d-426f-43d5-b774-b3abeb973bc3 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:41:21.917922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5ee9f45-8861-4528-acd6-f31b06076b80 tempest-LiveMigrationNegativeTest-698273048 tempest-LiveMigrationNegativeTest-698273048-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3" status: 404 len: 111 microversion: 2.1 time: 0.098929 Sep 23 03:41:21.918078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-841527a4-ca80-4213-9fc5-8d624da18914 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '.version_select at 0x7f0c8bae64c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:21.918172 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 457/962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:21 2022] GET /compute/v2.1/servers/7d34833d-426f-43d5-b774-b3abeb973bc3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:41:21.931435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-841527a4-ca80-4213-9fc5-8d624da18914 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:21.932010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-841527a4-ca80-4213-9fc5-8d624da18914 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:21.934276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-841527a4-ca80-4213-9fc5-8d624da18914 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:21.952949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-841527a4-ca80-4213-9fc5-8d624da18914 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.050056 Sep 23 03:41:21.954018 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 506/963] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:41:21 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:21.976290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:21.976962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:21.999346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.002784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.004919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.007518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.010282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.010993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.116150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:22.116778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:22.124152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.124642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.125263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.126163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.126782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.128265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.471672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:22.481229 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c796d851-2e0e-4a9b-89fa-98e12b0d6ee4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.369018 Sep 23 03:41:22.490309 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 507/964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:22 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:22.521644 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96fd72dd-ebe3-4e17-9f8f-1f55ab5aee77 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1630 microversion: 2.1 time: 0.553822 Sep 23 03:41:22.524262 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 458/965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:21 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1630 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:22.559273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b44593ea-3394-4552-ad32-acc96cfda2c1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: .version_select at 0x7f0c8b5da790>, body: {"keypair": {"name": "tempest-keypair-2128046119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0Oi3m7X5IjH84+unDo97a5yE87swf+obRIYcKAgJVjF5G1OhtpmeENRWWQipGvwU4IjTHr9z17JfpxMvh7rUn8c/FjdKpzD0foPIU6ZSmw5vzb7ILNj/AZwfHKgEkHlA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:22.593157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b05ad1-e4ec-4a08-b205-70d52a26651b", "tag": "6781568a-8955-4a7c-8fb7-a865ce9e9d98"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:22.603410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b44593ea-3394-4552-ad32-acc96cfda2c1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:22.609851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.610334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.610766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.619947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b44593ea-3394-4552-ad32-acc96cfda2c1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for user 27045855dd484c7fbcbb75721afdcc9a and project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:22.640635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] Creating event network-changed:6781568a-8955-4a7c-8fb7-a865ce9e9d98 for instance 58b05ad1-e4ec-4a08-b205-70d52a26651b on n-h1-858495-2 Sep 23 03:41:22.646650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2238c3e0-bab3-4d59-aeb2-ad00af551eee req-e7ece766-b532-4dfa-ba9a-793f2aa0f47a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057190 Sep 23 03:41:22.648200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 459/966] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:41:22.688348 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b44593ea-3394-4552-ad32-acc96cfda2c1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133590 Sep 23 03:41:22.690551 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 508/967] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:41:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:22.811721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:22.812661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:22.831767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.834997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.835742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:22.836871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:22.838407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:22.839274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:23.195180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:23.203892 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce086d78-8247-4732-aef9-bf220c9c998f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.399965 Sep 23 03:41:23.220056 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 460/968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:22 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:23.516953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:23.517605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:23.529103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:23.529628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:23.530069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:23.534130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:23.535062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:23.537426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:23.713097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97461224-f949-4e76-a9cd-b8d530a7d01b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Action: 'create', calling method: .version_select at 0x7f0c8bd5a700>, body: {"keypair": {"name": "tempest-keypair-1188317189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHs3HUeWU1GTn56NOdewPqHKaURtR/lwrc/Kf8Hv8wkreCCjRoUy1kCtxmFKsl2CEfQzdKxCpkzPYLVqJIOEpBSYNMtJXxfLqrb5WiVNNdkaRBn8wS4BrmNQJUinZ9g7+w=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:23.735564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-97461224-f949-4e76-a9cd-b8d530a7d01b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Getting quotas for project fa156d13dd41499d8ce020df00d215db. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:23.743240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-97461224-f949-4e76-a9cd-b8d530a7d01b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Getting quotas for user 2b8b1d78e76e41c8976073fb052f2e43 and project fa156d13dd41499d8ce020df00d215db. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:23.779082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97461224-f949-4e76-a9cd-b8d530a7d01b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318981 Sep 23 03:41:23.780997 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 509/969] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:41:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:23.969563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:24.013691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71318259-ff92-4844-a228-9bc8933e5726 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.496306 Sep 23 03:41:24.019946 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 461/970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:23 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:24.229600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:24.230619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:24.249725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:24.250966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:24.252403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:24.256387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:24.259280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:24.263864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:24.838019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:24.851870 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0bd80ead-fe9b-493f-b453-29a44cf6a902 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.627084 Sep 23 03:41:24.854763 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 510/971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:24 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:25.044544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:25.046108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:25.056764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:25.057995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:25.059094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:25.061925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:25.063109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:25.064547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:25.512015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:25.529514 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56ee0f67-a957-4128-bce7-8306b55debb1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.488932 Sep 23 03:41:25.546575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 462/972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:25 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:25.884550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:25.885328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:25.899177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:25.904730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:25.918355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:25.921671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:25.924089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:25.924743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:26.260490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:26.276792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3731aa5d-583d-426a-b667-5637fe11ba63 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.400484 Sep 23 03:41:26.279294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 511/973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:25 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:26.560049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:26.560986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:26.569130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:26.575271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:26.576194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:26.577212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:26.581073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:26.581705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:26.804721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4154353c-3b6b-4b0f-bc5f-04338e267e74", "name": "network-vif-plugged", "status": "completed", "tag": "499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:26.820893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:26.822881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:26.827961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:26.852016 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] Creating event network-vif-plugged:499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7 for instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 on n-h1-858495-2 Sep 23 03:41:26.868349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3a4d2b06-837a-4b26-a934-2ff1a1ba42ce req-e269c20c-6eb7-43c7-801c-71046dd33197 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065661 Sep 23 03:41:26.870924 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 512/974] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:41:27.308795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:27.310607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:27.325248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:27.326522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:27.327141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:27.328072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:27.328693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:27.330664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:27.417337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:27.436497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-03ee3a4c-355a-49cc-81cb-0f7234d831bd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.880789 Sep 23 03:41:27.438331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 463/975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:26 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:27.445712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-69984792", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a1aece03-8cc5-4dd7-a1d8-55f60f30a37a"}], "security_groups": [{"name": "tempest-securitygroup--1181269622"}], "key_name": "tempest-keypair-2128046119", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:27.822196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] validate_networks() for [('a1aece03-8cc5-4dd7-a1d8-55f60f30a37a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:41:27.935934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:27.944175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22d36df2-7fca-4665-b11a-532c4624373d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.640352 Sep 23 03:41:27.946104 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 513/976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:27 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:28.465083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:28.469540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:28.482775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:28.483627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:28.484397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:28.485888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:28.487786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:28.488577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.063882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:29.081518 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fe7b11b-0dee-4a02-b7f6-dba9984e705e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.621721 Sep 23 03:41:29.098208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 514/977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:28 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:29.104684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b05ad1-e4ec-4a08-b205-70d52a26651b", "name": "network-vif-plugged", "status": "completed", "tag": "6781568a-8955-4a7c-8fb7-a865ce9e9d98"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:29.120885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:29.121706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:29.122278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.134041 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] Creating event network-vif-plugged:6781568a-8955-4a7c-8fb7-a865ce9e9d98 for instance 58b05ad1-e4ec-4a08-b205-70d52a26651b on n-h1-858495-2 Sep 23 03:41:29.140086 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-aaf7c0eb-5c7d-4e96-89b6-ec3455cd4073 req-631c47e5-1fba-4b74-81c3-fc2a9a062c86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040374 Sep 23 03:41:29.140961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 515/978] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:29.145882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:29.146601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:29.163291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:29.163894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:29.164349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.165705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:29.166231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:29.166810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.728988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:29.730705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:29.732067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:29.734788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:29.742802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:29.758085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:29.758867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:29.759670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.762187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:29.764057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:29.764683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:29.806886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:29.817276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for user 27045855dd484c7fbcbb75721afdcc9a and project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:29.853080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:41:29.860663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:29.878935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:29.893404 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99e59298-55fa-4e03-a855-aebd4106be34 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1318 microversion: 2.1 time: 0.751244 Sep 23 03:41:29.894002 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 516/979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:29 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:29.913791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-799682192", "imageRef": "fe245542-0b6f-43d1-a618-858159fce9cf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3f32e013-0303-448e-a18a-ba8607949e8a"}], "security_groups": [{"name": "tempest-securitygroup--506030130"}], "key_name": "tempest-keypair-1188317189", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:30.090712 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e271a79-1d8e-4d23-8398-c4062b5cad6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.648519 Sep 23 03:41:30.092235 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 464/980] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:41:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:41:30.119671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01ff0afb-9002-4b0b-ab20-82ad2375dd5f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:30.127226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01ff0afb-9002-4b0b-ab20-82ad2375dd5f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:30.510094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01ff0afb-9002-4b0b-ab20-82ad2375dd5f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:30.529718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01ff0afb-9002-4b0b-ab20-82ad2375dd5f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1233 microversion: 2.1 time: 0.416046 Sep 23 03:41:30.533492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 465/981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:30 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1233 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:30.561677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:30.562509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:30.592728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:30.601555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:30.602138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:30.607948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:30.608664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:30.609835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:30.860693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] validate_networks() for [('3f32e013-0303-448e-a18a-ba8607949e8a', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:41:31.641336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:31.655217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2777f741-b063-44e5-92a3-6d71fb3896d6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 1.114111 Sep 23 03:41:31.672679 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 466/982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:30 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:31.686177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:31.687092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:31.707405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:31.708202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:31.708826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:31.709739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:31.710354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:31.710944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.018689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:32.019239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:32.019704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:32.020347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:32.020814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:32.058695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.059193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.059677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.060415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.060868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.070094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.162606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Getting quotas for project fa156d13dd41499d8ce020df00d215db. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:32.190960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Getting quotas for user 2b8b1d78e76e41c8976073fb052f2e43 and project fa156d13dd41499d8ce020df00d215db. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:32.217415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:32.272503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:41:32.281601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe245542-0b6f-43d1-a618-858159fce9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:32.424058 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e19f3e04-62d2-441a-855c-e8e6b444d6f8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.528643 Sep 23 03:41:32.430282 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 517/983] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:41:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:41:32.435779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:32.446971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:32.469735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.484270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.490114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.491539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.494584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.498156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.520148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:32.528654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:32.550804 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09eb406d-2c41-44c8-99ad-8f8618a40c19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1467 microversion: 2.1 time: 0.876379 Sep 23 03:41:32.552318 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 467/984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:31 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1467 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:32.574631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89312736-a4d6-4045-a089-f1b98afe28fb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:32.578930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89312736-a4d6-4045-a089-f1b98afe28fb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:32.695391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:32.704562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d3677e7-4dee-4f42-95a0-f2985b5d56d8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1291 microversion: 2.1 time: 0.272716 Sep 23 03:41:32.714773 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 518/985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:32 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1291 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:32.725919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:32.735302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:32.750929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.752096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.753633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.754960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.755804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.756590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.824703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89312736-a4d6-4045-a089-f1b98afe28fb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:32.838260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89312736-a4d6-4045-a089-f1b98afe28fb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1245 microversion: 2.1 time: 0.283959 Sep 23 03:41:32.839174 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 468/986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:32 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1245 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:32.850964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:32.856942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:32.873677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.874631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.877080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:32.880293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:32.882218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:32.884172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:33.454657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:33.458629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:33.498119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd59eac5-c28f-484f-936e-25579642c954 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1467 microversion: 2.1 time: 0.781962 Sep 23 03:41:33.504055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 519/987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:32 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1467 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:33.543652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:33.556300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:33.558430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Searching by: {'reservation_id': 'r-s9zrk10t', 'deleted': False, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:41:33.578750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:33.587627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:33.589831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:33.591730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:33.594180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:33.595737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:33.864270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:33.882355 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ac23d960-5a4f-498b-8ef0-c5014cbe39ff tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 1.041194 Sep 23 03:41:33.898641 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 469/988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:32 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:33.966229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:33.968255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:33.971664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:41:33.983469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:33.986659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:33.991978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:33.994164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:33.995810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:33.997154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:34.194545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:34.210295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ddf2d698-83b0-4000-bba0-d1539e7a0d66 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1291 microversion: 2.1 time: 0.288368 Sep 23 03:41:34.211730 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 470/989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:33 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1291 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:34.225872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:34.227039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:34.258273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:34.262048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:34.274518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:34.277130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:34.278759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:34.279691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:34.305811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:34.364729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:34.365978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:34.376504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:34.986816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:35.006850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6fa739e7-8103-4b31-a8b9-03be53602b23 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1241 microversion: 2.1 time: 0.791446 Sep 23 03:41:35.008097 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 471/990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:34 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1241 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:35.015523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:35.022430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:35.050043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:35.051628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:35.052590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:35.055004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:35.057830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:35.063346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:35.507764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3bc4c29f-8c45-4ff0-97bd-ff1dfdbaaad0 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-s9zrk10t" status: 200 len: 2927 microversion: 2.1 time: 1.967756 Sep 23 03:41:35.508847 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 520/991] 10.222.0.25 () {58 vars in 1197 bytes} [Fri Sep 23 03:41:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s9zrk10t => generated 2927 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:35.529311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:35.534785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:35.558868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:35.560211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:35.560839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:35.562373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:35.565453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:35.566109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.209969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:36.227587 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74bfce6a-af6a-426d-925b-377596bbb84c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 1.217781 Sep 23 03:41:36.233862 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 472/992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:35 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:36.244603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:36.291024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_groups [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Querying cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) for 2 instances {{(pid=128723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 03:41:36.292612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:36.293945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:36.294872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.393759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:36.397806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36bafc40-ee57-4c8f-9f97-e99c4d0ad275 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/d5d0352b-eecb-44df-a77f-39cfa53c40e5" status: 200 len: 265 microversion: 2.1 time: 0.162130 Sep 23 03:41:36.406005 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 473/993] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:41:36 2022] GET /compute/v2.1/os-server-groups/d5d0352b-eecb-44df-a77f-39cfa53c40e5 => generated 265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:36.409647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53361587-30e9-4534-b65f-1fd89055a4e6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.889349 Sep 23 03:41:36.410252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 521/994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:35 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:36.412160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:36.413337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:36.424630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:36.425827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:36.426680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.427902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:36.428641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:36.429287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.432986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:36.443712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:36.460734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:36.461231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:36.477486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.478368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:36.479021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:36.479469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:36.617218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:36.627158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2db8aaf7-0b3d-49e1-a928-6ebe8f7ff853 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1303 microversion: 2.1 time: 0.219589 Sep 23 03:41:36.642194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 474/995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:36 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:37.268255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:37.269206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:37.282564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:37.294269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:37.297231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:37.303414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:37.305919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:37.306564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:37.552723 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6fb6a79f-e1ce-409f-a55b-b082f5b80c2b tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1618 microversion: 2.1 time: 1.141386 Sep 23 03:41:37.562913 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 522/996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:36 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1618 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:37.569479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:37.580221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:37.608891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:37.609700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:37.610299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:37.611181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:37.612421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:37.616199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.312870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:38.331240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b2575ab-f4f0-4fb4-b9e0-7d0e672d27f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 1.066925 Sep 23 03:41:38.334102 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 475/997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:37 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:38.339800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:38.345847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:38.371052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.374942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.375446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.376217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.379244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.379894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.381218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:38.393129 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-efef5be7-3285-4e53-96c5-d4ac6e3f3e6d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.828366 Sep 23 03:41:38.419804 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 523/998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:37 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:38.436208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:38.440525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:38.456572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.457399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.458002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.462162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.463127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.463743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.670226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:38.678094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd032c6f-06cf-4afa-8134-c504ef2a9a85 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1303 microversion: 2.1 time: 0.253453 Sep 23 03:41:38.680668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 524/999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:38 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1303 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:38.693116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:38.696484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:38.713900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.716638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.717317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:38.718489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:38.727259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:38.728116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.356237 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f5408a1e-5c75-46a3-9819-a3128150bd89 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 200 len: 1618 microversion: 2.1 time: 1.020340 Sep 23 03:41:39.364364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 476/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:38 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 1618 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:39.373834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:39.376237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:39.395336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.396253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.397030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.398274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.399083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.400193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.601647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:41:39.631424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb2a5f6a-f595-48f3-9f99-d5df0dbd0221 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 2342 microversion: 2.25 time: 0.938708 Sep 23 03:41:39.632154 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 525/1001] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:41:38 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 2342 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:41:39.643337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: .version_select at 0x7f0c8b37cb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1965622903", "policies": ["anti-affinity"]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:39.713470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:39.732331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:39.761054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:39.770608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6e632bc-79ea-40a1-becf-89e95b309876 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1543 microversion: 2.1 time: 0.404779 Sep 23 03:41:39.783547 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 477/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:39 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1543 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:39.795910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:39.796600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:39.798612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:39.812555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.814177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.816639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.817775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.818819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.819600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.868081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:39.875698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:39.902486 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8866a95f-1824-4ea7-8358-221b15740f39 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.263054 Sep 23 03:41:39.905871 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 526/1003] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Sep 23 03:41:39 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:39.928037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:39.941502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.947204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.948180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:39.951166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:39.955111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:39.956126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:40.014770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fdf7933b-92b8-4a97-b582-8988ea137551 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084874 Sep 23 03:41:40.024198 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 527/1004] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Sep 23 03:41:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:41:40.034745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:40.039068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:40.055839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:40.057921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:40.058664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:40.060257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:40.062309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:40.063325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:42.442323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:42.460139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c036d93-599a-4e06-b689-78d5e4f4f92f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 2.675061 Sep 23 03:41:42.488910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 478/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:39 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:42.501371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:42.520521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:42.521429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:42.521902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:42.538302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] Creating event network-changed:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h2-858495-2 Sep 23 03:41:42.554198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-40a202b5-bcd1-4dde-8cf0-60ba743efeec req-cf07ab4e-58ff-4427-9219-0992be6acd06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063520 Sep 23 03:41:42.555578 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 479/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:42.571183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1270209163", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ab4d4248-9f4e-447d-bbe5-e55d312db5c5"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:42.657024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:42.673673 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01a0e781-a921-4bee-91c2-0dd7ee868a93 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 2.648093 Sep 23 03:41:42.690824 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 528/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:40 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:42.721316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:42.725785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:42.756227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:42.758740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:42.762440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:42.766198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:42.769948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:42.771925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:42.831261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:43.720054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:43.743183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e97bb2eb-3f10-4e0f-be99-ae245acf3e08 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1542 microversion: 2.1 time: 1.036081 Sep 23 03:41:43.751267 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 529/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:42 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1542 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:43.764967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:43.765892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:43.812983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:43.815672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:43.832039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:43.833087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:43.842509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:43.843483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:44.411365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:44.425804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-178e44ad-f367-4694-a3ad-e6717b7ab4ab tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.672780 Sep 23 03:41:44.429797 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 530/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:43 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:44.442647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:44.443626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:44.459034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:44.460893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:44.463267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:44.464328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:44.466502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:44.467117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:44.883223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:44.898988 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f423f5c5-2e5a-4f80-8bdd-f9f5f6469732 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.464353 Sep 23 03:41:44.902230 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 531/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:44 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:44.939363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:44.945432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:44.982307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:44.983067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:44.985119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:44.985925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:44.986407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:44.988872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:45.469586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:45.498251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97de1028-4ff3-409d-985a-90f42afac8b5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1542 microversion: 2.1 time: 0.570091 Sep 23 03:41:45.498940 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 532/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:44 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1542 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:45.510136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:45.556051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:45.557648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:45.558424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:45.591316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Creating event network-vif-unplugged:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:41:45.603037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:41:45.625430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b205832b-c774-4eee-825b-936e1cfbe911 req-8c7fd850-9a50-4009-984a-73f2de2a450b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123557 Sep 23 03:41:45.628096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 533/1012] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:45.642231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:45.643219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:45.650809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:45.651598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:45.652211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:45.653502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:45.656420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:45.658209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:45.958421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:45.972068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa6773c9-9669-4f1d-8609-a04167d904f2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.336869 Sep 23 03:41:45.974486 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 534/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:45 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:45.982453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "122ad226-8edc-4de9-b4e0-cae8410444ee", "device": "/dev/xvdb"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:45.986017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:45.993211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:45.994078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:45.994726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:45.995791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:45.996448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:45.997049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:46.565084 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-198f49f0-b6a4-4343-a8fd-a868d407a241 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.588882 Sep 23 03:41:46.566357 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 535/1014] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Sep 23 03:41:45 2022] POST /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:41:46.573778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:46.575474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:46.584187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:46.585207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:46.586121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:46.587287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:46.587917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:46.588843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:46.594427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:46.774102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:46.790402 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc05cb7d-64dd-4459-add9-eb8fa97cd160 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.221856 Sep 23 03:41:46.791614 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 536/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:46 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:46.804146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94bb775-83ab-4924-89f9-8319ba8ef5a0", "tag": "988e16a3-eb4d-49c5-897e-9ce9dba640c8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:46.818897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:46.819901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:46.820638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:46.844327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] Creating event network-changed:988e16a3-eb4d-49c5-897e-9ce9dba640c8 for instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 on n-h2-858495-2 Sep 23 03:41:46.856248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-bac8cb87-be50-4888-a23a-f885fc09a0d6 req-6da59e40-3197-4e9a-a9f2-4a8406cf1c39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061374 Sep 23 03:41:46.857590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 537/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:46.864107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:46.864928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:46.877333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:46.878231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:46.878432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:46.879159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:46.879742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:46.880047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:47.224564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:47.237916 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-35cd4d99-f8e9-4fb4-8c1c-90d3ffaa71ef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1542 microversion: 2.1 time: 0.378934 Sep 23 03:41:47.239056 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 538/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:46 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:47.248608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:47.248608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:47.258574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:47.259125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:47.259791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:47.260643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:47.261512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:47.263662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:47.563592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:47.576130 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-527b03c9-42c7-4895-8e86-84b830cc4b88 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.335611 Sep 23 03:41:47.579177 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 539/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:47 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:47.820295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:47.821047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:47.831023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:47.831023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:47.831527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:47.832547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:47.833336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:47.833911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:48.740312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:48.756112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2778d7aa-59c1-40cd-8f1f-164186e571b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.939537 Sep 23 03:41:48.787265 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 540/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:47 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:48.808139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:48.810436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:48.821649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:48.822567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:48.825367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:48.829239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:48.831686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:48.840470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:49.472623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:49.486704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-95e5e794-c640-43ed-845d-2746884d98dc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1542 microversion: 2.1 time: 0.697216 Sep 23 03:41:49.490070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 541/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:48 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1542 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:49.518512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:49.526614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:49.541685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:49.542485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:49.543143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:49.544087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:49.544733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:49.545324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:49.887054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=24 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:49.973924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:50.343192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:50.375138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d922a3c-1914-4e92-8990-5be0590abcfe tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.883737 Sep 23 03:41:50.389506 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 542/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:49 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:50.406494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:50.407216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:50.455226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:50.457437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:50.457899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:50.468430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:50.469725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:50.470190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:51.111556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:51.135545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbf45fcd-5676-4bde-a9e5-8cf60aa2b741 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.753356 Sep 23 03:41:51.145108 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 543/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:50 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:51.153222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:51.169152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:51.201176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:51.202321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:51.205297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:51.206998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:51.211436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:51.212420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:51.576181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:51.594070 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f15a0bd6-4c10-4609-a142-c3d34831b82d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1474 microversion: 2.1 time: 0.446793 Sep 23 03:41:51.595243 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 544/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:51 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1474 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:51.602976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:51.604200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:51.614790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:51.615936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:51.616919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:51.618346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:51.619339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:51.620277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:51.984017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:51.993328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-014ed1ed-63a3-40ca-acd8-683deeb131d6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.395353 Sep 23 03:41:51.994716 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 545/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:51 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:52.174458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:52.175372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:52.191020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:52.191799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:52.192469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:52.194724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:52.199535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:52.200269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:52.528683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=60 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:52.563264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:52.578922 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6574303b-3273-4eee-9b87-30ae693e8bd3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.404695 Sep 23 03:41:52.580215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 546/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:52 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:52.630662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:52.631554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:52.645278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:52.646393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:52.648226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:52.648368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:52.649332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:52.650229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:52.650945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:53.178277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:53.203033 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1be6e11a-a794-4f81-9ff7-15327d03191e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1474 microversion: 2.1 time: 0.578310 Sep 23 03:41:53.204820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 547/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:52 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1474 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:53.210025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:53.210645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:53.227244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:53.228609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:53.233615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:53.236140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:53.237272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:53.239045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:53.715890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:53.730005 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5cd3b916-795d-40f9-aa7c-cd835c292a18 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.523758 Sep 23 03:41:53.730680 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 548/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:53 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:53.753875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:53.754926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:53.775700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:53.776212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:53.789534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:53.790690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:53.791387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:53.792032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:54.165984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:54.177450 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99e16ca0-7791-473e-99c4-d409a84288d9 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.445393 Sep 23 03:41:54.186855 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 549/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:53 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:54.233520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:54.234149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:54.244203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:54.247893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:54.250306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:54.250964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:54.253220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:54.253874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:54.254456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:55.595811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:55.606326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e458a086-dbcf-4ea5-b643-d0c6020a8af5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1474 microversion: 2.1 time: 1.381663 Sep 23 03:41:55.606931 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 550/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:54 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1474 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:55.632497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:55.633119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:55.660346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:55.660913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:55.661393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:55.665964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:55.666414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:55.669793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:56.137963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:56.179281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed50d4e8-2ab2-4695-94a0-b027d39b4650 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.570781 Sep 23 03:41:56.182775 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 551/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:55 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:56.201090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:56.202104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:56.210115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:56.210966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:56.211740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:56.212771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:56.213903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:56.214658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:56.741728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:56.777817 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d6faa02d-3972-40eb-86a5-f1ef19268c0e tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.583691 Sep 23 03:41:56.779834 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 552/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:56 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:56.786174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "name": "network-vif-plugged", "status": "completed", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:56.810616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:56.811419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:56.812771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:56.852203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] Creating event network-vif-plugged:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h2-858495-2 Sep 23 03:41:56.863965 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-83bc4b23-8337-499e-b5ef-02c3fa30ff8c req-c7695c2c-8764-471f-b50b-5838a4722ab3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081818 Sep 23 03:41:56.866088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 553/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:56.924981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:56.937644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:56.983313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:56.984231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:56.986348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:56.988209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:56.989574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:56.991235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:57.008069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:41:57.500945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:57.519641 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d7374a8-2b66-4624-a886-43b1b4aef4bf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1471 microversion: 2.1 time: 0.643212 Sep 23 03:41:57.543900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 554/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:56 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:57.577956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:57.578780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:57.606184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:57.607563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:57.609119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:57.612877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:57.613569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:57.618268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.035517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:58.061561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e8b7ae0-5ff5-4238-b2b6-34f0b5247c5a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.514016 Sep 23 03:41:58.076302 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 555/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:57 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:58.087874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:58.088672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:58.097118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.098110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.098922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.100057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.100773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.101399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.190844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.191345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.191788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.196889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.198712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.199181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.340709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:58.368548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:58.411405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:41:58.686541 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a04c172-11a7-4176-aaa6-6d6950bdab71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.606377 Sep 23 03:41:58.690407 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 556/1035] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:41:58 2022] POST /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:41:58.701259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:58.706422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:58.721421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.721936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.725841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:58.727288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:58.727859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:58.728332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.183817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:59.184382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:59.184980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:59.185791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:59.186506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:59.229263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.232667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.233717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.235230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.238516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.240375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.252214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:59.261335 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-425bad7d-6e06-48ac-8e4b-e529324ab7c2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.569350 Sep 23 03:41:59.263773 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 557/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:58 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:59.269046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:59.272493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:59.288083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.297554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.298497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.299901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.300802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.301642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.321802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:59.328348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:59.346757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 2 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:41:59.351386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:59.464117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:59.486198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:59.545643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:59.558367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52ef9b6e-2f8b-4320-81cd-9c4e49836c05 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 0.292685 Sep 23 03:41:59.560249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 558/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:59 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:59.566583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:59.567548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:41:59.576914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.577850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.578541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.580034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:41:59.580907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:41:59.581669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:41:59.582225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:59.594087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:59.630631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=f3bae1ff-f3a4-4ef5-b645-7923be9d2270,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:41:59.758448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:59.766085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:59.849403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:41:59.868742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:59.876034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:41:59.883126 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dcfc8fd2-beba-4060-9d42-57fccfa6e58a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1359 microversion: 2.1 time: 0.318847 Sep 23 03:41:59.905017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 559/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:41:59 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:59.999103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38f77485-bc3d-483e-b052-430bdee049d2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 17.441697 Sep 23 03:42:00.000902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 480/1039] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:41:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 17445 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:42:00.013971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:00.032199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:00.042479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Searching by: {'deleted': False, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:42:00.101630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.102567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.104624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.109509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.110361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.113017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.177886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:42:00.243330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ebefb65-efe0-44e2-8020-50ebcf2f4e27 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.237727 Sep 23 03:42:00.247858 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 560/1040] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:42:00 2022] GET /compute/v2.1/servers => generated 1663 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:00.258990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ffe17cb-bfb6-4d0c-adcf-b22b2bd02f68 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:00.260802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ffe17cb-bfb6-4d0c-adcf-b22b2bd02f68 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:00.297507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:00.298140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:00.323056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.323056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.323056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.323056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.324137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.324457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.399329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ffe17cb-bfb6-4d0c-adcf-b22b2bd02f68 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:00.415519 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ffe17cb-bfb6-4d0c-adcf-b22b2bd02f68 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1219 microversion: 2.1 time: 0.161975 Sep 23 03:42:00.418270 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 481/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:00 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:00.589131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:00.590707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:00.635751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:00.642631 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7cc397be-d64d-430b-a0c0-c1ae86a0e748 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.351704 Sep 23 03:42:00.644747 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 561/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:00 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:00.654678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.655309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.655779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.665938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.668518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.670234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.911986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:00.913080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:00.933420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.934306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.939543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.940564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:00.941197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:00.943439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:00.998631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:01.011680 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c55e8836-71fa-4c5b-969f-d980e002eafe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 0.427985 Sep 23 03:42:01.012489 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 482/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:00 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:01.368015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-04219449-e9b0-463e-85a5-657e63eacf3b tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1586144453", "id": 815392250, "os-flavor-access:is_public": "False"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:01.414078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-04219449-e9b0-463e-85a5-657e63eacf3b tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.400058 Sep 23 03:42:01.428917 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 483/1044] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:01 2022] POST /compute/v2.1/flavors => generated 428 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:01.441991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:01.444315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5f05aa7-fda6-4581-95f5-6d227a7f2f23 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8544fad7aac54d49a10148b2e5da9edc"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:01.483053 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93792a71-9c8f-4f66-8460-baa85c7dec8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1542 microversion: 2.1 time: 0.576232 Sep 23 03:42:01.505785 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 562/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:00 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:01.535112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb0eb37f-0d1c-42dc-9816-711346470d6a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:01.539567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb0eb37f-0d1c-42dc-9816-711346470d6a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:01.671119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb0eb37f-0d1c-42dc-9816-711346470d6a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:01.680183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb0eb37f-0d1c-42dc-9816-711346470d6a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1219 microversion: 2.1 time: 0.172712 Sep 23 03:42:01.682013 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 563/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:01 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:01.719948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:01.723448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5f05aa7-fda6-4581-95f5-6d227a7f2f23 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/815392250/action" status: 200 len: 96 microversion: 2.1 time: 0.288127 Sep 23 03:42:01.724136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 484/1047] 10.222.0.25 () {60 vars in 1197 bytes} [Fri Sep 23 03:42:01 2022] POST /compute/v2.1/flavors/815392250/action => generated 96 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:42:01.724669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:01.745444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:01.748038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:01.751167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:01.752670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:01.753309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:01.754195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:01.757865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:01.758349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:01.773252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:01.773961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:01.774777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:01.779588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:01.780206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:01.780747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:01.975455 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-defb1f31-f83f-46af-a038-e3cc886526a2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271428 Sep 23 03:42:01.984415 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 564/1048] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:42:01 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-interface => generated 285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:02.319076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5792bf8c-803a-4b0c-bc36-c12c25ea9d94 tempest-FlavorsAccessTestJSON-54281890 tempest-FlavorsAccessTestJSON-54281890-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:02.436281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5792bf8c-803a-4b0c-bc36-c12c25ea9d94 tempest-FlavorsAccessTestJSON-54281890 tempest-FlavorsAccessTestJSON-54281890-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.455237 Sep 23 03:42:02.439762 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 565/1049] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:42:01 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:02.461589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-plugged", "status": "completed", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:02.524588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:02.525658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:02.526248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:02.590161 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Creating event network-vif-plugged:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:42:02.609065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:42:02.635516 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f35886d8-a573-4e92-9d41-968cecac469e req-afffce02-35b8-48da-bb0f-bfbbb3bb7684 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192596 Sep 23 03:42:02.647296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 566/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:02.667104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:02.668738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:02.691553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:02.694229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:02.698344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:02.699359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:02.700024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:02.703206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:03.265057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:03.311381 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2182910f-1222-4aec-b100-59edfabd309b tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 1.582220 Sep 23 03:42:03.313281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 485/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:01 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:03.321619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37378e92-6844-4802-a95c-09604a2771eb tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8544fad7aac54d49a10148b2e5da9edc"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:03.482739 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37378e92-6844-4802-a95c-09604a2771eb tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/815392250/action" status: 200 len: 21 microversion: 2.1 time: 0.167847 Sep 23 03:42:03.484082 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 486/1052] 10.222.0.25 () {60 vars in 1197 bytes} [Fri Sep 23 03:42:03 2022] POST /compute/v2.1/flavors/815392250/action => generated 21 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:42:03.496538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.497619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:03.500218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:03.523910 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1fafa0b-c6b2-4ba6-831e-f5d73ffbc33e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 0.868500 Sep 23 03:42:03.546412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 567/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:02 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:03.546854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:03.546854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:03.546854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:03.546854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:03.548460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c39ea959-a830-4a8e-af43-86521e384df4 tempest-FlavorsAccessTestJSON-54281890 tempest-FlavorsAccessTestJSON-54281890-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.549673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:03.550169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:03.577077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c39ea959-a830-4a8e-af43-86521e384df4 tempest-FlavorsAccessTestJSON-54281890 tempest-FlavorsAccessTestJSON-54281890-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036667 Sep 23 03:42:03.578721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 568/1054] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:03.607137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05dfb6b6-db83-47cc-8428-c66b9e6a7d2e tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.644527 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05dfb6b6-db83-47cc-8428-c66b9e6a7d2e tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/815392250" status: 202 len: 0 microversion: 2.1 time: 0.036753 Sep 23 03:42:03.650692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 569/1055] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:42:03 2022] DELETE /compute/v2.1/flavors/815392250 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:42:03.662726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-788ce584-ffd9-4312-8c1f-d8e7b45ec683 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.714984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-788ce584-ffd9-4312-8c1f-d8e7b45ec683 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056500 Sep 23 03:42:03.720564 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 570/1056] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:03.745014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28746100-ffb7-4768-993a-3c499467c945 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-254917742", "id": 2039688152, "os-flavor-access:is_public": "False"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:03.783875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28746100-ffb7-4768-993a-3c499467c945 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.043406 Sep 23 03:42:03.792226 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 571/1057] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:03 2022] POST /compute/v2.1/flavors => generated 430 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:03.822127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bd4d25e-7705-4891-aeea-ec7921071d2d tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.852231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:03.871929 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7dba875b-4b94-4717-a7f1-1666bd52211b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1223 microversion: 2.1 time: 0.378769 Sep 23 03:42:03.878274 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3bd4d25e-7705-4891-aeea-ec7921071d2d tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2039688152/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.071523 Sep 23 03:42:03.879705 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 572/1058] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Sep 23 03:42:03 2022] GET /compute/v2.1/flavors/2039688152/os-flavor-access => generated 21 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:42:03.890924 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 487/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:03 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1223 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:03.897170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81df609c-b81c-4642-a168-f24eca46c5f2 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.922531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:03.927191 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81df609c-b81c-4642-a168-f24eca46c5f2 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2039688152" status: 202 len: 0 microversion: 2.1 time: 0.034595 Sep 23 03:42:03.941424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd8cb38f-bc3f-49c2-a95a-bc2187cf81a1 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:03.948957 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 488/1060] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 03:42:03 2022] DELETE /compute/v2.1/flavors/2039688152 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:03.982529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd8cb38f-bc3f-49c2-a95a-bc2187cf81a1 tempest-FlavorsAccessTestJSON-2104595348 tempest-FlavorsAccessTestJSON-2104595348-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048078 Sep 23 03:42:03.996790 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 573/1061] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:04.347422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:04.348170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:04.368679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:04.369189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:04.369677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:04.387303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:04.387821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:04.388276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:04.558301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:04.558706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:04.571761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:04.575900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:04.578481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:04.581119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:04.581769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:04.584286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:05.377627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:05.388907 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae8657bd-b78a-417b-9d5b-b358f740fe8c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 0.839407 Sep 23 03:42:05.401385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 574/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:04 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:05.407300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:05.409410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:05.428719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:05.440591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:05.441593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:05.442637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:05.443345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:05.444003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:05.683418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:05.702373 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ccaef2e-2f2c-48d0-81bb-03d544b1a57e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1271 microversion: 2.1 time: 0.311179 Sep 23 03:42:05.703796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 575/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:05 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:06.213256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:06.230373 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4eb814c9-0891-43eb-86e3-c38dd513f7dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 1.883357 Sep 23 03:42:06.241013 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 489/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:04 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:06.294456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-77d409e5-d6fa-4ccd-8c35-cda62833bfdf tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Action: 'create', calling method: .version_select at 0x7f0c8b19d0d0>, body: {"keypair": {"name": "tempest-keypair-1033776381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh+FGMCLPNJ7uzfCgDljb0s0puvb20SAzK0QJ6jBLKfnKkJTFVE4Zi6zDwFrUvVZtooIe8F2SDLzn3JNenyOqd5fnHh7UfwIuXGkB8RByrIUkQ5cZRXiEqbr7FalyE9zw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:06.324379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-77d409e5-d6fa-4ccd-8c35-cda62833bfdf tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:06.329308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-77d409e5-d6fa-4ccd-8c35-cda62833bfdf tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for user 0fc453bb00e54809ba847f3006c8aba2 and project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:06.377280 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-77d409e5-d6fa-4ccd-8c35-cda62833bfdf tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.670624 Sep 23 03:42:06.378457 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 576/1065] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:42:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:06.427256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:06.432212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:06.451387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:06.453466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:06.454699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:06.457164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:06.459023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:06.459629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:06.735476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:06.737657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:06.768752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:06.770121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:06.770783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:06.772169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:06.773066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:06.773721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:06.827957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:07.146617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:07.155862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:07.188955 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50cca466-6a9f-4617-a62f-b483e9c8d598 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1277 microversion: 2.1 time: 0.462511 Sep 23 03:42:07.190464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00fd155d-c24a-4dd5-85bf-1da5b41dc156 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 0.774007 Sep 23 03:42:07.194403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 490/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:06 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:07.196757 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 577/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:06 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1277 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:07.262451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:07.263226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:07.275695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:07.276473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:07.277036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:07.278274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:07.286078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:07.287004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:07.584212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:07.599132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:07.606851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:07.607502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:07.634628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] Creating event network-changed:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h2-858495-2 Sep 23 03:42:07.656301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0756df21-4f62-4d89-878f-0b5a1f551458 req-8418ac45-988f-49bc-9ca2-c55b64986bda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076574 Sep 23 03:42:07.656930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 578/1068] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:07.941426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:07.952867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-044efa3d-3274-4961-93be-5b2bf902e13c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.694428 Sep 23 03:42:07.958885 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 491/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:07 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:08.238097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:08.242118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:08.242829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:08.247664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:08.273287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.279439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.279944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.280392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:08.283151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.283607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:08.288613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.289422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.290162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.293459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:08.297209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.299411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:08.616263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:08.644288 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-529cd06b-702d-4a6d-83f3-181105d5ff8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1277 microversion: 2.1 time: 0.425696 Sep 23 03:42:08.657148 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 492/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:08 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1277 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:08.982546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:08.983418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:08.993703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.994206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.994644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:08.995408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:08.995862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:08.996291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:09.278311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:09.290195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:09.290779 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6de198e9-a637-410e-ad2f-e9c1e9b83038 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1470 microversion: 2.1 time: 1.072778 Sep 23 03:42:09.297957 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 579/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:08 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1470 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:09.680995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:09.681857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:09.688976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:09.692448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:09.693076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:09.698927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:09.699960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:09.700705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:09.781315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:09.796786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eba0fcc4-6f15-4387-9597-09b71e4b0875 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.818766 Sep 23 03:42:09.816673 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 493/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:08 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:09.908968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:09.920038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f94fc0f-5856-4920-91ca-fa7fbb6908d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1277 microversion: 2.1 time: 0.243684 Sep 23 03:42:09.923558 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 580/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:09 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:10.331585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:10.334932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:10.348650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:10.349551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:10.351866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:10.354050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:10.356293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:10.357295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:10.411119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=24 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:10.713176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:10.714601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:10.718144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:10.736122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:10.736544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:10.736993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:10.748590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:10.753004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:10.753959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:11.503922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:11.519268 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9bb27cea-0aff-44f4-9e2b-59279bdbec6d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1536 microversion: 2.1 time: 1.194920 Sep 23 03:42:11.520005 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 494/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:10 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1536 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:11.543250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:11.547033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:11.562443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:11.574941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:11.577707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:11.578815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:11.584790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:11.585536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:11.752522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:42:11.789468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-45c57052-3e6e-43aa-b589-3c0c6d00c05d tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 2420 microversion: 2.25 time: 1.080050 Sep 23 03:42:11.790585 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 581/1075] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:10 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 2420 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:42:11.849584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94bb775-83ab-4924-89f9-8319ba8ef5a0", "name": "network-vif-plugged", "status": "completed", "tag": "988e16a3-eb4d-49c5-897e-9ce9dba640c8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:11.863840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:11.900863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:11.908492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:11.908785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:11.941123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] Creating event network-vif-plugged:988e16a3-eb4d-49c5-897e-9ce9dba640c8 for instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 on n-h2-858495-2 Sep 23 03:42:11.965284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3d7e0b07-8867-4ee3-b6bb-d19345ddf783 req-4382d6c7-9cfe-47ad-b485-e7fd20bd02a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135475 Sep 23 03:42:11.971816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 582/1076] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:11.994511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:11.995300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:12.011184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:12.012283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:12.012753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:12.013540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:12.018192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:12.018663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:12.525528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:12.550302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e26c1483-b177-4cf5-bdcf-35346c647241 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 1.011767 Sep 23 03:42:12.553649 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 495/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:11 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:12.585733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bae1ff-f3a4-4ef5-b645-7923be9d2270", "tag": "d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:12.609832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:12.612169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:12.617334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:12.681501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] Creating event network-changed:d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42 for instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 on n-h1-858495-2 Sep 23 03:42:12.701156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-263a8077-dafc-441b-a256-da69beb5566c req-6f608e28-a445-4638-a9ab-410da9ed917b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144978 Sep 23 03:42:12.714342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 496/1078] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:12.737455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858495-2", "block_migration": "auto"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:12.749256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:12.804256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:12.806212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:12.809279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:12.816155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:12.817111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:12.819660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:12.878211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:12.902666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7129cbe5-bb52-42e5-973b-c593bf076408 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.928572 Sep 23 03:42:12.903700 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 583/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:11 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:12.930024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'flavor' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:42:12.965978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Going to try to live migrate instance to n-h2-858495-2 {{(pid=128723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:42:13.223047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5955958-908b-4f59-a756-f2e652a0c0f3 tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-800726329", "id": 1671215386, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:13.249973 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5955958-908b-4f59-a756-f2e652a0c0f3 tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.338692 Sep 23 03:42:13.260512 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 584/1080] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:42:12 2022] POST /compute/v2.1/flavors => generated 467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:42:13.266016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:13.267082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:13.281757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:13.282524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:13.283155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:13.284062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:13.284697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:13.285315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:13.812639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:13.830107 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4874ba07-344d-4ff1-bc43-b18b043d8a80 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1536 microversion: 2.1 time: 0.568107 Sep 23 03:42:13.830913 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 585/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:13 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1536 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:14.117113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0ec808b-6ce5-4542-974a-220b3bd1e34f tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:14.160037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0ec808b-6ce5-4542-974a-220b3bd1e34f tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] 10.222.0.25 "GET /compute/v2.1/flavors/1671215386" status: 200 len: 467 microversion: 2.61 time: 0.298092 Sep 23 03:42:14.170295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 586/1082] 10.222.0.25 () {60 vars in 1199 bytes} [Fri Sep 23 03:42:13 2022] GET /compute/v2.1/flavors/1671215386 => generated 467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:42:14.190182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:14.191069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:14.199796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:14.201048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:14.201929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:14.203359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:14.204343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:14.205485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:14.580989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:14.591142 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ad175e3-2067-4928-967b-10d3958eea9a tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.419157 Sep 23 03:42:14.605566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 587/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:14 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:14.605566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:14.606060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:14.616940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:14.617783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:14.618541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:14.620078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:14.621106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:14.621882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:14.980656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:15.001623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79d78489-bca4-4b79-badd-ca80195092ca tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.405668 Sep 23 03:42:15.004895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 588/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:14 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:15.020236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:15.034048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.034827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.035609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.049155 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Creating event network-vif-unplugged:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:42:15.058738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:42:15.066430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0e8d3b64-1dc3-4524-b048-350427354bfd req-2eec34c1-11df-4c04-9602-7463b7e1666e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058988 Sep 23 03:42:15.067244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 589/1085] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:15.073911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62701c21-ac5a-4585-adc5-6237cf7ff347 tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] Action: 'update', calling method: .version_select at 0x7f0c9103ab80>, body: {"flavor": {"description": "new"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:15.127791 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62701c21-ac5a-4585-adc5-6237cf7ff347 tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1671215386" status: 200 len: 468 microversion: 2.61 time: 0.059057 Sep 23 03:42:15.128430 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 590/1086] 10.222.0.25 () {62 vars in 1219 bytes} [Fri Sep 23 03:42:15 2022] PUT /compute/v2.1/flavors/1671215386 => generated 468 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:42:15.133186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:15.133957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:15.145179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.145714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.146151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.147129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.147586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.148013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.287993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:15.297745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-596ae206-e5f5-4b8a-a0d5-c60f54ef9c06 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1536 microversion: 2.1 time: 0.168259 Sep 23 03:42:15.298348 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 591/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:15 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1536 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:15.303298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1496940699", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "756a5d72-5a39-4d3e-a912-e848e0dd3121"}], "security_groups": [{"name": "tempest-securitygroup--2009083329"}], "key_name": "tempest-keypair-1033776381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:15.412868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] validate_networks() for [('756a5d72-5a39-4d3e-a912-e848e0dd3121', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:42:15.833720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:42:15.834140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:42:15.834610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:42:15.835014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:42:15.835422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:42:15.845122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.845644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.846086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.846814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.847296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.847723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.866572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:15.871082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for user 0fc453bb00e54809ba847f3006c8aba2 and project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:15.882889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:42:15.885247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:42:15.935269 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-086b7c79-dba3-4974-800a-1515fd08d309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.635851 Sep 23 03:42:15.942942 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 592/1088] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:42:15.942942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10449dce-42c4-40b7-bb28-45b120b17bad", "tag": "49d450de-5b78-493b-bc7e-f52f9679410e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:15.951530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:15.952024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:15.952466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:15.964834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] Creating event network-changed:49d450de-5b78-493b-bc7e-f52f9679410e for instance 10449dce-42c4-40b7-bb28-45b120b17bad on n-h2-858495-2 Sep 23 03:42:15.969809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6acbef3a-f48d-4957-a0e9-ab2d67af7a0a req-5c7b6f3a-3519-4505-b5cd-d848c5f5710b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 Sep 23 03:42:15.970495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 593/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:15.977544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-931f3049-2e14-4d3b-a04d-9746ccc3518e tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.003898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-931f3049-2e14-4d3b-a04d-9746ccc3518e tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.031751 Sep 23 03:42:16.005729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 594/1090] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:42:15 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:16.009220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.010134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:16.018970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.019474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.020089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.021183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.021952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.022383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.198087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:16.207525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fcf7ca8-12f2-49c9-bb78-2932c2a7dcd4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1370 microversion: 2.1 time: 0.201889 Sep 23 03:42:16.208196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 595/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:16.214724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1cde091e-7a1e-4dcb-b620-930332cb608a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.215697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1cde091e-7a1e-4dcb-b620-930332cb608a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:16.282413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1cde091e-7a1e-4dcb-b620-930332cb608a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:16.297926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1cde091e-7a1e-4dcb-b620-930332cb608a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1242 microversion: 2.1 time: 0.088289 Sep 23 03:42:16.298781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 596/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:16.303732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4f3e955-819e-4cc2-9aa7-b7e3f26d6436 tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.327926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4f3e955-819e-4cc2-9aa7-b7e3f26d6436 tempest-FlavorsV261TestJSON-1177304329 tempest-FlavorsV261TestJSON-1177304329-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.027739 Sep 23 03:42:16.328535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 597/1093] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:16.333418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.334077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:16.340778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.341575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.342298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.342874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.343329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.343960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.531314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:16.562159 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e336ffcf-47eb-4428-ba98-14cffcbaca8f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.232225 Sep 23 03:42:16.577377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 598/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:16.577377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.577377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:16.577377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.577377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.577947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.577947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:16.577947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:16.577947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:16.746214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:16.755951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0357b6b1-7941-4419-8fd7-47ea7a9c04d1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1536 microversion: 2.1 time: 0.192074 Sep 23 03:42:16.756564 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 599/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1536 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:16.762132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34c62b61-9977-48dc-ad2f-5dbc9f3c3e3d tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.786154 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-34c62b61-9977-48dc-ad2f-5dbc9f3c3e3d tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1671215386" status: 202 len: 0 microversion: 2.61 time: 0.026630 Sep 23 03:42:16.790007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 600/1096] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Sep 23 03:42:16 2022] DELETE /compute/v2.1/flavors/1671215386 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:42:16.796186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e9808a3-212e-4154-9d8f-f388def47add tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:16.823772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e9808a3-212e-4154-9d8f-f388def47add tempest-FlavorsV261TestJSON-527149529 tempest-FlavorsV261TestJSON-527149529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.031819 Sep 23 03:42:16.837399 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 601/1097] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 03:42:16 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:17.110677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bae1ff-f3a4-4ef5-b645-7923be9d2270", "name": "network-vif-plugged", "status": "completed", "tag": "d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:17.159909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.161118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.161808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.199860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] Creating event network-vif-plugged:d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42 for instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 on n-h1-858495-2 Sep 23 03:42:17.206818 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f02a95ad-9898-490b-a314-32a9b3fadc91 req-b3153d3a-e472-4949-a035-6c50ecab94af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104994 Sep 23 03:42:17.207914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 602/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:17.233085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:17.233982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:17.269796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.284216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.288625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.290294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.293103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.295722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.687207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:17.730883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dee89736-1fa8-4f0e-b002-7adc51bff3bb tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1556 microversion: 2.1 time: 0.502114 Sep 23 03:42:17.742247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 603/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:17 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1556 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:17.758926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:17.759374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:17.767153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.767297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.767698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.769115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.769115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.769528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.903837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:17.937255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca199f20-491a-4805-99b6-0ed62a76148f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1294 microversion: 2.1 time: 0.198887 Sep 23 03:42:17.938742 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 604/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:17 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1294 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:17.955328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:17.957123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:17.969503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.970260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.970571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.971286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:17.971738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:17.972329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:17.976134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:18.237047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:18.247526 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a0307b5-2886-4756-9269-c37cbff93940 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.307017 Sep 23 03:42:18.251423 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 605/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:17 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:18.270605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:18.275350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:18.297974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.298877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.299739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:18.301256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.302153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.302831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:18.722377 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f8719e06-57da-4095-b148-a5a95f996079 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/action" status: 202 len: 0 microversion: 2.25 time: 6.002277 Sep 23 03:42:18.723341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 497/1102] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:42:12 2022] POST /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/action => generated 0 bytes in 6008 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:42:18.731309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:18.733929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:18.744527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.745706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.766138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:18.771265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.775440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.779519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:18.794745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-84f84104-e591-46cd-a2a6-43a7f7ede99d tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.541866 Sep 23 03:42:18.795628 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 606/1103] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:42:18 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-interface => generated 285 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:18.801404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:18.802353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:18.814628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.816762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.821220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:18.822178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:18.822962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:18.823584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.422207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:19.438297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b39c0fe-7f7e-46b2-bae5-fd85ac95316b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1529 microversion: 2.1 time: 0.713559 Sep 23 03:42:19.453809 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 498/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:18 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1529 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:19.463000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:19.463913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:19.481387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.482145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.482770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.483645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.484261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.484842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.753860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:19.769820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:19.778623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:19.781425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:19.784294 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6d08d0d-b774-473b-a646-001cb7fc4ddd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.986318 Sep 23 03:42:19.786117 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 607/1105] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:18 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:19.795906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:19.797174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:19.801803 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2012cb34-2125-4bef-b5ab-de1ad6aac247 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1300 microversion: 2.1 time: 0.346482 Sep 23 03:42:19.807908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 499/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:19 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1300 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:19.811360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.812028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.815211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.816600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.818913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.820190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.821175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:19.822983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:19.843168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.846777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.854697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:19.857699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:19.858606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:19.859321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:20.348409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:20.359297 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22c185ff-8723-456c-9af8-1ab9485e8c1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.569835 Sep 23 03:42:20.359759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:20.360206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 608/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:19 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:20.365142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-plugged", "status": "completed", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:20.369854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:20.373650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a57f9647-7fae-44e1-a235-afee2d2a9bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1529 microversion: 2.1 time: 0.563945 Sep 23 03:42:20.374360 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 500/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:19 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1529 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:20.377490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:20.379642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:20.380357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:20.404975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f49f5f2-fd27-40a1-b883-0711beb16ae1 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:20.411914 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6f49f5f2-fd27-40a1-b883-0711beb16ae1 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] HTTP exception thrown: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. Sep 23 03:42:20.414411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] Creating event network-vif-plugged:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f49f5f2-fd27-40a1-b883-0711beb16ae1 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Request method failure captured: Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/flavors/775de369-2ed1-4678-8edd-6538a62520ee HTTP/1.1 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSouSf3fhE-cST8SVSIl7Emy2nW5BqBzEaWasLLMtrbjFkW0yVUGRLO1MZouTIn_pFAf0JdjZq9BSpgrZtWnqc9FwXj2zJ0bgQO7x-gnxVvOiw1S0tBKONKUNSYImjwddak5tWKFlD11A6JdXiGEK3I5ZVUNAsRF0a-gewDy-HPYupY Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b61ad557826942c5b4fff9004fa4c908 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MigrationsAdminTest-391605065 Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:42:20.421674 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b61ad557826942c5b4fff9004fa4c908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b61ad557826942c5b4fff9004fa4c908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b61ad557826942c5b4fff9004fa4c908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b61ad557826942c5b4fff9004fa4c908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MigrationsAdminTest-391605065 Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b61ad557826942c5b4fff9004fa4c908 Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MigrationsAdminTest-391605065 Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MigrationsAdminTest-391605065-project-admin Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b7e40d7565384402aec88733ef3b39c5 Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MigrationsAdminTest-391605065-project-admin Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: exception: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. Sep 23 03:42:20.428398 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '775de369-2ed1-4678-8edd-6538a62520ee'} Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:42:20.429918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. Sep 23 03:42:20.431208 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:42:20.432593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f49f5f2-fd27-40a1-b883-0711beb16ae1 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Returning 404 to user: Flavor 775de369-2ed1-4678-8edd-6538a62520ee could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:42:20.432676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-00cfc5ef-f01b-40c6-9ba6-5b04fd97d6ad req-018a9b32-0b69-490f-9c67-14df7875ab4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060633 Sep 23 03:42:20.432769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f49f5f2-fd27-40a1-b883-0711beb16ae1 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/775de369-2ed1-4678-8edd-6538a62520ee" status: 404 len: 109 microversion: 2.1 time: 0.023059 Sep 23 03:42:20.432769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 501/1109] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:42:20 2022] DELETE /compute/v2.1/flavors/775de369-2ed1-4678-8edd-6538a62520ee => generated 109 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:42:20.432926 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 609/1110] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:20.571654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-999277732", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:20.641343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:42:20.844887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:20.846368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:20.867244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:20.867767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:20.868217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:20.868964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:20.870114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:20.873684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.122794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:42:21.123616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:42:21.124117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:42:21.124523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:42:21.124944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:42:21.147134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.147675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.148122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.148933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.149528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.150017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.184928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:21.190099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Getting quotas for user 281de6c3e01748f5a0fa1f0c75bd477f and project f9dda867554c4c3fb49a7cbf68fd13df. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:21.204479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:42:21.207679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:42:21.248100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:21.264601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30018e0c-51f5-41c6-8dca-87c9df0d73b9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.435706 Sep 23 03:42:21.265203 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 610/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:20 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:21.289722 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4796e0b5-7eae-4369-97d6-a389ef25160b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723924 Sep 23 03:42:21.290993 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 502/1112] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:42:21.299901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:21.300765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:21.312830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.314213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.315410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.316876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.317637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6777916b-e6ea-421e-bdd1-31d95442257b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:21.318184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.318349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6777916b-e6ea-421e-bdd1-31d95442257b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:21.319198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.710870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6777916b-e6ea-421e-bdd1-31d95442257b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:21.742559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6777916b-e6ea-421e-bdd1-31d95442257b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1212 microversion: 2.1 time: 0.432261 Sep 23 03:42:21.748456 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 503/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:21 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1212 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:21.776432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:21.778507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:21.804153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.805823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.806581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.808580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.809180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.809755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:21.910526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:21.931214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:21.938994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:21.948499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-331967c6-44d2-48f8-9189-94fb292d552c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.660686 Sep 23 03:42:21.951699 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 611/1114] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:21 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:21.959005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94bb775-83ab-4924-89f9-8319ba8ef5a0", "tag": "988e16a3-eb4d-49c5-897e-9ce9dba640c8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:21.981479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:21.984484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:21.986496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.025172 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] Creating event network-changed:988e16a3-eb4d-49c5-897e-9ce9dba640c8 for instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 on n-h2-858495-2 Sep 23 03:42:22.040013 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-858a583a-ce09-43d1-a79a-2338654a7f73 req-cd363962-f47f-48b0-a5d6-fcef1db1133d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086603 Sep 23 03:42:22.040955 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 612/1115] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:22.097424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:22.111725 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b96b69dd-5730-49c8-b0c5-f46b2618a797 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.360164 Sep 23 03:42:22.113913 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 504/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:21 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:22.295825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:22.297633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:22.316383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.317250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.320264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.321283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.322321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.325481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.569883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:22.584290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-802937a7-ca75-4a89-9b00-e37eb8a1c7ae tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.295336 Sep 23 03:42:22.584907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 613/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:22 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:22.771818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:22.776415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:22.794784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67627c3d-d16c-4926-a278-5d28cbaa59d8", "tag": "d2956182-e36b-4f33-b9d8-bc6ef45bd0d0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:22.798118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.799177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.800213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.801268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.802992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.803612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.811212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.816956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.817758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:22.848398 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] Creating event network-changed:d2956182-e36b-4f33-b9d8-bc6ef45bd0d0 for instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 on n-h1-858495-2 Sep 23 03:42:22.859386 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0f3002df-5c15-4caa-a70e-9e0ed3c0a8d2 req-c7a30c46-7ed7-49ad-a897-df1fcd703dc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067833 Sep 23 03:42:22.861690 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 614/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:22.979573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:22.981154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:22.997429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:22.998186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:22.999577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:23.013002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:23.018109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:23.018566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:23.192915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:23.210641 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9ff2f81-b904-4908-bcac-4c320838a172 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1216 microversion: 2.1 time: 0.446054 Sep 23 03:42:23.211479 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 505/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:22 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1216 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:23.247415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:23.248038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:23.277263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:23.279215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:23.279908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:23.283328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:23.287375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:23.288100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:24.212764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:24.237274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:24.241843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:24.252331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 1.274593 Sep 23 03:42:24.254147 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 615/1120] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:22 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:24.277952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:24.279115 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c53342a-10e9-4890-8f1a-c8cd06b3ff3e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.011675 Sep 23 03:42:24.279501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 616/1121] 10.222.0.25 () {56 vars in 886 bytes} [Fri Sep 23 03:42:24 2022] GET /compute/ => generated 377 bytes in 25 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 03:42:24.297072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:24.300341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:24.313547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:24.314041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:24.316391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:24.319936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:24.320725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:24.321344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:24.535564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:24.544457 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8db6dd1e-02f5-45ec-b47e-1c99fd09c284 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 1.316591 Sep 23 03:42:24.563332 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 506/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:23 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:24.576287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:24.577031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:24.599579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:24.601661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:24.602137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:24.606308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:24.606866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:24.607373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:24.836330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:24.850604 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45653044-552a-425d-81eb-9104b04a0529 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1270 microversion: 2.1 time: 0.286012 Sep 23 03:42:24.851377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 507/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:24 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:25.016005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:25.034068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04a77edf-8ddf-45d5-81b9-eba822046eea tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.747832 Sep 23 03:42:25.036435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 617/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:24 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:25.284135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:25.285229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:25.297111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:25.299226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:25.299898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:25.300799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:25.303075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:25.303573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:25.577785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:25.582623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:25.585108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:25.607992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:25.608615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:25.611690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:25.613225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:25.614957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:25.615428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:25.856559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:26.247764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.263573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.269678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.271045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f461cb2d-2ac8-4f93-814a-7dd2fadae442 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.991647 Sep 23 03:42:26.271945 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 508/1125] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:25 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:26.285637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:26.286596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:26.287482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:26.302578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:26.303079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:26.303522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:26.304248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:26.304711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:26.305146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:26.465189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.481198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fbbedf3-f09b-4d2e-b5bd-d7d4ca4d94f9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1270 microversion: 2.1 time: 0.208028 Sep 23 03:42:26.482043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 509/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:26 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:26.499351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:26.500252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:26.507795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.518155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:26.521772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:26.526557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:26.527233 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-747295e9-48b3-4ae2-8f92-1fb4631a10cb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.954065 Sep 23 03:42:26.528074 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 618/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:25 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:26.542152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:26.546289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:26.547081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:26.866483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:26.882433 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e8e6e95-2ace-44d4-91a3-f1b288799f28 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.394701 Sep 23 03:42:26.904997 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 510/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:26 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:27.317136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:27.320163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:27.345423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.347545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.349384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:27.351514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.352285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.352945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:27.441208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f1ff4f7-3da3-4d95-81e0-5fc3eca5b774 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Action: 'create', calling method: .version_select at 0x7f0c8b887700>, body: {"keypair": {"name": "tempest-keypair-712446299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2riHuDUhYa68EuWuSRGVZdz7quxHL7qLPssgDMZFEWVqT/vYn2qGpZuo7W73HUC5CcjyJxkoWBH2zkUEBBMnxaZgSwAFlAxA/cnRPmnz4iTGWaLOhZRJEHo95hSpPQ3A=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:27.505422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6f1ff4f7-3da3-4d95-81e0-5fc3eca5b774 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Getting quotas for project f60be92080c34eff88c4c4cee896897a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:27.511692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6f1ff4f7-3da3-4d95-81e0-5fc3eca5b774 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Getting quotas for user a32a76472d734439a0e262e0b6d104ee and project f60be92080c34eff88c4c4cee896897a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:27.581098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f1ff4f7-3da3-4d95-81e0-5fc3eca5b774 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.146435 Sep 23 03:42:27.590482 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 511/1129] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:42:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:42:27.604697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:27.605389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:27.621686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.622346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.622807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:27.623549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.624025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.624523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:27.789185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:27.808995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:27.811853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:27.813474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd6d10e5-37bb-485e-a493-91e7788d972f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.509782 Sep 23 03:42:27.814535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 619/1130] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:27 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:27.830593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:27.831377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:27.851168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.854850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.855318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:27.856062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:27.856535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:27.857173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:28.014356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:28.024551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6da13de2-c3ba-42c4-99c8-9e94842d642d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.432655 Sep 23 03:42:28.039379 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 512/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:27 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:28.049953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:28.050862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:28.064738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:28.065502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:28.066103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:28.066978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:28.067599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:28.068412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:28.401404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:28.446307 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05afa964-8efb-4174-a7fc-558f89eebf5c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.628697 Sep 23 03:42:28.447004 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 620/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:27 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:28.461730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10449dce-42c4-40b7-bb28-45b120b17bad", "name": "network-vif-plugged", "status": "completed", "tag": "49d450de-5b78-493b-bc7e-f52f9679410e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:28.509726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:28.512777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:28.514245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:28.570760 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] Creating event network-vif-plugged:49d450de-5b78-493b-bc7e-f52f9679410e for instance 10449dce-42c4-40b7-bb28-45b120b17bad on n-h2-858495-2 Sep 23 03:42:28.588912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fdc393e7-a8e9-4ff7-affb-448bff5b8998 req-8646bb74-01de-467a-bd27-2b4f992d0ca7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132329 Sep 23 03:42:28.592252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 621/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:28.783585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:28.794520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b70be96-d30e-482a-8138-802b0eb2df21 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.753569 Sep 23 03:42:28.800612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 513/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:28 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:28.843751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:28.849678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:28.871793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:28.879324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:28.880809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:28.883907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:28.885253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:28.887353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.055047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:29.055677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:29.068576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.069088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.071555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.077285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.078739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.079207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.412260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:29.441285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:29.454489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:29.456563 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43b11238-af30-4c69-b708-3dd9b757ee97 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.407292 Sep 23 03:42:29.470704 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 514/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:29 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:29.479785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:29.486662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbd4a798-0146-4fcf-916e-44f0c6e9e286 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.649874 Sep 23 03:42:29.488739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:29.489251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 622/1136] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:28 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:29.501107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:29.503968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:29.520828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.522010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.522674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.523057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.523367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.523878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.526395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.526927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.527552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.557211 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] Creating event network-changed:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h2-858495-2 Sep 23 03:42:29.572875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-13f6d441-0059-4360-bd34-5247de7aecb2 req-ca7c6386-5f01-4ba6-91f4-695dab73d713 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099305 Sep 23 03:42:29.573864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 515/1137] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:29.773871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:29.786972 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b139ebb6-cab4-48f1-a194-e1ae289127d4 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1319 microversion: 2.1 time: 0.294858 Sep 23 03:42:29.789911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 623/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:29 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:29.832625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:29.833459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:29.846355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.847941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.848613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:29.849982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:29.851732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:29.852398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:30.044284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:30.053515 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c69bbd23-15f0-4710-8e5b-6d1f404f5256 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.226668 Sep 23 03:42:30.063869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 516/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:29 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:30.483402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1155503298", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "287d113c-d67d-4c07-a4ab-807b875d307c"}, {"port": "994c862a-05ad-4b51-a24d-e8ee09c442c8", "tag": "port-1"}, {"port": "8694753c-ec94-4daf-8e5b-c6457d45d229", "tag": "port-2"}, {"uuid": "76a6dd25-3f37-4a13-b6d6-09432ca5ce5e", "tag": "net-1"}, {"uuid": "76a6dd25-3f37-4a13-b6d6-09432ca5ce5e"}, {"uuid": "7f4c8801-8d53-42bd-9b66-592d29699089", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7f4c8801-8d53-42bd-9b66-592d29699089", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5072f4bd-45c8-4d4c-986f-f46f763f25c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a4624ab9-bf26-4ece-8638-0d5581238fbb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ef0f2747-c8f1-45f1-a3c3-6877e713eb26", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--842117976"}], "key_name": "tempest-keypair-712446299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:30.485386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:30.486484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:30.499231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:30.505885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:30.506552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:30.507552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:30.508202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:30.508814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:30.746491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] validate_networks() for [('287d113c-d67d-4c07-a4ab-807b875d307c', None, None, None, None, None), (None, None, '994c862a-05ad-4b51-a24d-e8ee09c442c8', None, None, None), (None, None, '8694753c-ec94-4daf-8e5b-c6457d45d229', None, None, None), ('76a6dd25-3f37-4a13-b6d6-09432ca5ce5e', None, None, None, None, None), ('76a6dd25-3f37-4a13-b6d6-09432ca5ce5e', None, None, None, None, None), ('7f4c8801-8d53-42bd-9b66-592d29699089', '10.2.2.100', None, None, None, None), ('7f4c8801-8d53-42bd-9b66-592d29699089', '10.2.2.200', None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:42:30.853099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:30.867754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01fbf8eb-9c73-4b3b-b6ed-aa662d0a02cc tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.386762 Sep 23 03:42:30.880402 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 517/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:30 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:30.917619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:30.918256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:30.950008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:30.950576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:30.951041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:30.951816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:30.954043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:30.955992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:31.169425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:31.694097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:31.705745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:31.707664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:31.708978 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b4dacd32-e770-4361-a78b-305547b91f92 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.813164 Sep 23 03:42:31.709815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 518/1141] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:30 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:31.714754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:31.715734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:31.722216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:31.723083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:31.723745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:31.724694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:31.725406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:31.725951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:31.949428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:31.958082 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fdf4691-49cb-42a2-a60a-f2899e0a3622 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1468 microversion: 2.1 time: 0.246866 Sep 23 03:42:31.959245 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 519/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:31 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:31.964470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:31.965291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:31.972990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:31.973909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:31.974383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:31.975455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:31.976084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:31.976704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:32.220740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:32.233295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42d497e5-67c7-4698-9808-3e1dbf8aedd1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1368 microversion: 2.1 time: 0.271949 Sep 23 03:42:32.249391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 520/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:31 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:32.249391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67627c3d-d16c-4926-a278-5d28cbaa59d8", "name": "network-vif-plugged", "status": "completed", "tag": "d2956182-e36b-4f33-b9d8-bc6ef45bd0d0"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:32.268917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:32.276291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:32.277183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:32.294149 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] Creating event network-vif-plugged:d2956182-e36b-4f33-b9d8-bc6ef45bd0d0 for instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 on n-h1-858495-2 Sep 23 03:42:32.301699 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-11be1c07-5ff7-4859-ada9-be5ef045b75f req-684c959e-6d9c-48e7-9a14-f7da7dc6055c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064488 Sep 23 03:42:32.302844 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 521/1144] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:32.460471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02e18bd3-f18d-4111-9d92-72d0523b3b17 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c8b5eb0d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:32.587050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02e18bd3-f18d-4111-9d92-72d0523b3b17 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10" status: 200 len: 371 microversion: 2.1 time: 0.281569 Sep 23 03:42:32.588650 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 522/1145] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:42:32 2022] GET /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10 => generated 371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:32.593495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:32.594445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:32.600955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:32.603432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:32.604112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:32.604710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:32.605632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:32.606299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:32.607087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:32.637927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:32.869543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:32.882874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05953b06-4aa9-4c30-a07e-7d261e29e7fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.292654 Sep 23 03:42:32.897629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 523/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:32 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:32.904607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:32.905242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:32.913588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:32.914162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:32.914608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:32.915337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:32.915833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:32.916265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.181967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.189847 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d70fa7c9-bdf0-4028-942b-2cc1870c7e08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 200 len: 1469 microversion: 2.1 time: 0.290984 Sep 23 03:42:33.190636 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 524/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:32 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:33.195002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b5ebb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:33.264488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.265288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.266049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.267260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.268056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.268779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.342770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e998c8d9-363b-4688-b06d-0af657b6c60f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10" status: 200 len: 328 microversion: 2.1 time: 0.151043 Sep 23 03:42:33.343292 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 525/1148] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:42:33 2022] PUT /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10 => generated 328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:33.351874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:33.351874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:33.359317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.359816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.360263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.360976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.361499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.361911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.574073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.583266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.584723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.585919 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18323a14-3b75-4ede-a444-8ad09124cce9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.241603 Sep 23 03:42:33.586482 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 526/1149] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:33 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:33.592288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:33.597578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.598550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Searching by: {'reservation_id': 'r-35mfl40h', 'deleted': False, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:42:33.607936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.608417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.609004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.609780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.610231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.610727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:33.712223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:42:33.824775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:33.833420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:33.833946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:33.834381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.159630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1639d674-d212-464c-8c19-27b9c4fddfbb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-35mfl40h" status: 200 len: 2930 microversion: 2.1 time: 0.571881 Sep 23 03:42:34.160297 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 527/1150] 10.222.0.25 () {58 vars in 1197 bytes} [Fri Sep 23 03:42:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-35mfl40h => generated 2930 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:34.177552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:34.177552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:34.188764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.190032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.190232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.190926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.191479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.191917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.337376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:42:34.338676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:42:34.339230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:42:34.339819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:42:34.340298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:42:34.350092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.350951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.351708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.352622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.353939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.354548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.374862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Getting quotas for project f60be92080c34eff88c4c4cee896897a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:34.378988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Getting quotas for user a32a76472d734439a0e262e0b6d104ee and project f60be92080c34eff88c4c4cee896897a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:34.472555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:34.481198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9e23c48-558e-4992-85fc-fd41acd06a23 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1557 microversion: 2.1 time: 0.319670 Sep 23 03:42:34.482156 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 528/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1557 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:34.486595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d659575e-3567-4ba3-9a82-6f0bfcf706e8 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:34.503349 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d659575e-3567-4ba3-9a82-6f0bfcf706e8 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10" status: 202 len: 0 microversion: 2.1 time: 0.019767 Sep 23 03:42:34.504265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 529/1152] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 03:42:34 2022] DELETE /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:34.511833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:34.512527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:34.519224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.519786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.520714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.521902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.522360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.522787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.582445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:42:34.587254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5072f4bd-45c8-4d4c-986f-f46f763f25c3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a4624ab9-bf26-4ece-8638-0d5581238fbb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef0f2747-c8f1-45f1-a3c3-6877e713eb26',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:42:34.770067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:34.781978 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a736c7f-6f23-4efb-b63b-2267fb16d70d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.275813 Sep 23 03:42:34.783639 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 530/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:34.791180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:34.829940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_groups [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Querying cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) for 2 instances {{(pid=128723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 03:42:34.830661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.831138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.831568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.854714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e63b7df2-272a-4a38-b99a-ea88aecfa9c6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/ab4d4248-9f4e-447d-bbe5-e55d312db5c5" status: 200 len: 271 microversion: 2.1 time: 0.069023 Sep 23 03:42:34.858314 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 531/1154] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/os-server-groups/ab4d4248-9f4e-447d-bbe5-e55d312db5c5 => generated 271 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:34.864853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:34.865622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:34.873068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.873273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.873603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.874300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:34.874757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:34.875180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:34.968837 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98461faf-e7ba-45f7-aa42-a4010e00ef75 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108404 Sep 23 03:42:34.977307 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 532/1155] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:34.991139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9488d086-b9ee-4424-ada5-31309cfeb59d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 4.514032 Sep 23 03:42:34.993219 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 624/1156] 10.222.0.25 () {62 vars in 1189 bytes} [Fri Sep 23 03:42:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 4517 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 03:42:34.995912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1c06b78-2376-404a-908a-99e88c857110 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c8b848160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.006151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.010636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:35.044087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.045152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.045867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.050761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.051536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.052286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.148595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1c06b78-2376-404a-908a-99e88c857110 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10" status: 200 len: 371 microversion: 2.1 time: 0.168155 Sep 23 03:42:35.151505 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 533/1157] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/os-quota-sets/ce5f597f32544f11af09b2bf75cbaf10 => generated 371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:35.168421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.169605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:35.198468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.200502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.201031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.202210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.205272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.207080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.416069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.437637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.439779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.441980 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6f0b0d9-4f44-4ba4-9768-c30cc7a3f269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.447442 Sep 23 03:42:35.442734 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 625/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:34 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:35.451885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.453198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:35.533760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6eece18b-67e3-462c-ab32-959c3500e532 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1619 microversion: 2.1 time: 0.380770 Sep 23 03:42:35.534481 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 534/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:35 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1619 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:35.548142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-492c0cb6-3997-465d-bccb-b48193685860 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c8b859700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.562182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.571289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.572811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:35.574060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5d5939b-62be-4ae6-b7bf-06b78541cde9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1285 microversion: 2.32 time: 0.130194 Sep 23 03:42:35.586608 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 626/1160] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:35 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:35.592027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.593666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:35.602402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.604357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.605307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.607221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.607844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.608964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.632257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:35.790410 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd1bdd5a-619e-47a3-9233-a6ac04b91286 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 200 len: 1620 microversion: 2.1 time: 0.202099 Sep 23 03:42:35.791964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 627/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:35 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 1620 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:35.808844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:35.815996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:35.825905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.825905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.825905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.825905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:35.826387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:35.826387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:35.949320 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-492c0cb6-3997-465d-bccb-b48193685860 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.413740 Sep 23 03:42:35.950424 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 535/1162] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:42:35 2022] GET /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b/defaults => generated 371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:36.022388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1276709928", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1af7665c-7c20-4487-814f-72a67ee18bd8"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:36.106860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:36.110491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:42:36.116793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbe8a90e-d6d0-45d7-92b3-88e38f116d9b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.313705 Sep 23 03:42:36.120391 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 628/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:35 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:36.312761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b19d550>, body: {"quota_set": {"ram": "5120"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:36.412685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:42:36.413306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:42:36.413752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:42:36.414171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:42:36.414595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:42:36.434869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.435167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.435554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.436289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.436748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.437332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.494019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:36.504470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:36.541421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:42:36.545401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:42:36.635589 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b0135bc-a9b4-4752-838a-a5adfbc83a16 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618034 Sep 23 03:42:36.642253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.643533 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 536/1164] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:42:36.643954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.644615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.645678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.647046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.648457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.678285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:36.679046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:36.704726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.707996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.708689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.709725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.711861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.712421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.802328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7dcff58-df2c-42e1-8a74-ece5b458d8fa tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642" status: 200 len: 328 microversion: 2.1 time: 0.497792 Sep 23 03:42:36.804135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 629/1165] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:42:36 2022] PUT /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642 => generated 328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:36.811941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:36.812774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:36.821560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.824256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.826350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.826350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:36.826940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:36.831944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:36.964818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:36.979504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:36.996629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:36.997806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d07c823c-2178-4269-8889-3ebe06fba433 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.353168 Sep 23 03:42:36.998421 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 537/1166] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:36 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:37.023859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e257cf1-bed9-4cf1-ae39-bb99daad5fce tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:37.025730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e257cf1-bed9-4cf1-ae39-bb99daad5fce tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:37.054280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:37.069303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:37.072254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:37.087294 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76968a25-6c9d-4bdb-9dd6-22d72e43e499 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1575 microversion: 2.32 time: 0.281824 Sep 23 03:42:37.093231 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 630/1167] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:36 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1575 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:37.103768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67627c3d-d16c-4926-a278-5d28cbaa59d8", "tag": "d2956182-e36b-4f33-b9d8-bc6ef45bd0d0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:37.131069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.136385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.137391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.158916 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] Creating event network-changed:d2956182-e36b-4f33-b9d8-bc6ef45bd0d0 for instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 on n-h1-858495-2 Sep 23 03:42:37.159386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e257cf1-bed9-4cf1-ae39-bb99daad5fce tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:37.164848 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fd10894f-5150-41ae-a722-75be8c2a4b4a req-4baa5f80-21f5-4f73-ac11-2525c2a1dbc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069982 Sep 23 03:42:37.165792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 631/1168] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:37.168659 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e257cf1-bed9-4cf1-ae39-bb99daad5fce tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1217 microversion: 2.1 time: 0.156898 Sep 23 03:42:37.173209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c8b1578b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:37.191849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 538/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:36 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:37.198178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:37.199589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:37.206603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.207349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.207977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.208963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.209776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.210224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.281257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.281997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.282614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.283539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.284152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.285028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.312092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-216197ed-dcf6-4641-8cc0-741ac90d4a7f tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642/detail" status: 200 len: 916 microversion: 2.1 time: 0.144246 Sep 23 03:42:37.313022 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 632/1170] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:42:37 2022] GET /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642/detail => generated 916 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:37.585089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b184d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:37.611467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:37.628857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47225069-e65e-41fa-94f3-1f39b3d4f80f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.435017 Sep 23 03:42:37.629846 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 539/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:37 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:37.774627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.792847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.796622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.799445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.800840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.802046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.902854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.910136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.910136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:37.910136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:37.910136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:37.911637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.008002 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0952c1bf-04d4-4ce0-8d02-aa2dec238466 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642?user_id=17d8b6d0e7394800b2d6a3fa94a2fd7c" status: 200 len: 328 microversion: 2.1 time: 0.437747 Sep 23 03:42:38.017510 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 633/1172] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:42:37 2022] PUT /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642?user_id=17d8b6d0e7394800b2d6a3fa94a2fd7c => generated 328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:38.021908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c8342e07-ef75-48f2-abbb-93c8be15ad2d tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c9025f820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.029178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.030349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:38.038964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.041682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.043979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.046474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.048252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.052002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.165097 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c8342e07-ef75-48f2-abbb-93c8be15ad2d tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642?user_id=17d8b6d0e7394800b2d6a3fa94a2fd7c" status: 200 len: 370 microversion: 2.1 time: 0.147901 Sep 23 03:42:38.176138 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 540/1173] 10.222.0.25 () {58 vars in 1323 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/os-quota-sets/24d8dcb1628647c7ab883f56e2a02642?user_id=17d8b6d0e7394800b2d6a3fa94a2fd7c => generated 370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:38.181249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.182428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:38.193011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.194069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.195451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.196523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.197261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.198081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.405896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.419699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.426553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.427943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53fa03bb-79be-4f96-a36d-84091d578cdb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1593 microversion: 2.32 time: 0.250570 Sep 23 03:42:38.429686 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 541/1174] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1593 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:38.444427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.456673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:38.474282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.474894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.475339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.476141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.481374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.483710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.493328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.526739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.532376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.542011 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba48f5ef-407e-4b90-a39b-1e9a344db27a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.518182 Sep 23 03:42:38.549731 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 634/1175] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:38.591680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.607487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8bd7515f-4612-4870-937c-a4f615ddd36e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1269 microversion: 2.1 time: 0.169034 Sep 23 03:42:38.608386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 542/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:38.657132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.658061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:38.666089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.666827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.667597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.668473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:38.669091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:38.669780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:38.879421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:38.881237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-272ebdfe-f07e-447a-961b-27dc47193646 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Calling method '.version_select at 0x7f0c8b5eb9d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:38.893257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1cff0bee-a319-4ae2-92f7-07c0189ef347 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.240325 Sep 23 03:42:38.911563 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 635/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:39.136056 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-272ebdfe-f07e-447a-961b-27dc47193646 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.258896 Sep 23 03:42:39.137273 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 543/1178] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:42:38 2022] GET /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b/defaults => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:39.150968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b143550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:39.249797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.250630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.251333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.252263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.252966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.253581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.255938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "name": "network-vif-plugged", "status": "completed", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:39.289539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.290676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.299266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.305334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:39.330894 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] Creating event network-vif-plugged:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h2-858495-2 Sep 23 03:42:39.351673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c71f03a4-785f-4b21-81d3-201d15be43b6 req-2787f362-20ee-4aa7-87d1-ef878c62dde7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105574 Sep 23 03:42:39.353382 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 544/1179] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:39.458649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:39.460041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:39.482009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.486743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.487596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.488348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.489046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.489687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.575859 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03f8dd11-8f67-4252-bd4c-a2b736f2e7c6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b" status: 200 len: 329 microversion: 2.1 time: 0.430196 Sep 23 03:42:39.581441 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 636/1180] 10.222.0.25 () {60 vars in 1263 bytes} [Fri Sep 23 03:42:39 2022] PUT /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b => generated 329 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:39.591480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:39.592097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:39.598816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.599299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.599968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.600740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.601197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.601776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.619813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.635436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.637297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.638786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8bdb9e69-9077-4f89-a862-29a83495f3d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1593 microversion: 2.32 time: 0.186393 Sep 23 03:42:39.659117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 545/1181] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:39 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1593 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:39.665202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b5eba60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:39.749615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.751018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.751733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.752716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.753640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.755394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.772765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.784995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.786986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.787994 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-95e3667d-9352-4d5d-ba35-61e53fd542ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.205189 Sep 23 03:42:39.788878 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 637/1182] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:39 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:39.795985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:39.796449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:39.804978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.805467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.805967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.806675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.807127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.807554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.848993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:39.888603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:39.900121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4858de84-11c3-4102-9670-b9182ce10d01 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1275 microversion: 2.1 time: 0.109022 Sep 23 03:42:39.909830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 638/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:39 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:39.925058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:39.928270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:39.934030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.934955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.935307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:39.936080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:39.936595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:39.937136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:40.171384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:40.188856 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10c62984-a7c6-45c8-bc08-8d8e8638d3e9 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.269373 Sep 23 03:42:40.207829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 639/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:39 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:40.253593 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0499d072-92f9-4744-ba75-19ebd2957ec6 tempest-QuotasAdminTestJSON-125548198 tempest-QuotasAdminTestJSON-125548198-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b" status: 200 len: 329 microversion: 2.1 time: 0.593068 Sep 23 03:42:40.255206 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 546/1185] 10.222.0.25 () {60 vars in 1263 bytes} [Fri Sep 23 03:42:39 2022] PUT /compute/v2.1/os-quota-sets/d08f01d6ea0147539c7340b8ab62c50b => generated 329 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:40.672077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:40.672834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:40.682425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:40.682950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:40.687289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:40.687450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:40.688024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:40.688353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:40.818216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:40.819365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:40.834165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:40.836047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:40.837893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:40.839393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:40.840367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:40.842127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:40.976642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:40.997421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:40.999753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.002526 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ef2faec-cc87-4d0f-844e-ab2c666a554d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1660 microversion: 2.32 time: 0.335284 Sep 23 03:42:41.003916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 640/1186] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:40 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1660 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:41.024925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:41.027283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:41.036804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:41.037986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:41.038823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:41.040897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:41.041851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:41.042708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:41.447578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.478946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.485514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.487718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6cd0dd8a-8378-4025-9c01-942a6f15c765 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.673502 Sep 23 03:42:41.502189 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 547/1187] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:40 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:41.508125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.518860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e067885d-0b2f-4fd2-9a04-22e5eb26c726 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.512691 Sep 23 03:42:41.519808 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 641/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:41 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:41.526349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:41.527655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:41.537632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:41.538777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:41.539817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:41.542053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:41.543013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:41.543874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:41.780304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:41.787366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:41.798637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c85b0e5a-5575-4293-97cf-9547e3898d9e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.292363 Sep 23 03:42:41.799973 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 548/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:41 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:42.036540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:42.038318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:42.050247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.050933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.051527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.052721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.053314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.054586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.301062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.312648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.314215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.315378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfd38a3f-b501-463a-a534-170dbbeccce7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1660 microversion: 2.32 time: 0.283295 Sep 23 03:42:42.315941 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 642/1190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:42 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1660 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:42.536465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:42.547377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:42.548048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:42.550417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:42.573605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.575901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.576511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.579176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.581185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.581927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.582422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.589090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.589700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.595068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.595664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.596319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.888540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.901709 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef696a44-1ef1-4793-8abe-80396c485911 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.359278 Sep 23 03:42:42.903676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 643/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:42 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:42.908885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:42.909773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:42.917393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.918130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.918569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.919620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:42.919906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:42.920563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:42.940514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.953473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.956179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:42.957803 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db925327-0587-436e-abf5-3492849c58f9 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.429997 Sep 23 03:42:42.959027 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 549/1192] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:42 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:43.108806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:43.122210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8b4611ab-4a67-4e9d-bee7-f45f3f1391cb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1312 microversion: 2.1 time: 0.216790 Sep 23 03:42:43.137258 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 644/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:42 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:43.346586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:43.347203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:43.358395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:43.358900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:43.359360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:43.360085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:43.360549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:43.360981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:43.374912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14ba8cd-1be2-461b-b588-d97cc518cefa", "tag": "137b2e78-7ecf-4a50-838a-bffc85ba5bb9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:43.416346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:43.417458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:43.418272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:43.463609 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] Creating event network-changed:137b2e78-7ecf-4a50-838a-bffc85ba5bb9 for instance a14ba8cd-1be2-461b-b588-d97cc518cefa on n-h1-858495-2 Sep 23 03:42:43.471469 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-86ef0056-d984-4b53-b6bf-0fcc82fe94e6 req-0b31fcf4-54f2-4634-88d2-c8359378e24a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100696 Sep 23 03:42:43.472659 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 645/1194] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:43.908699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:43.926352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:43.928054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:43.932216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-64d4eeed-8b77-43fe-af7e-6d0cd8782402 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1706 microversion: 2.32 time: 0.589976 Sep 23 03:42:43.932555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:43.933394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:43.935756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 550/1195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:43 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1706 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:42:43.954377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:43.955230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:43.956259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:43.958281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:43.961616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:43.963897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:43.998699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:43.999350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:44.021812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:44.023706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:44.026868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:44.028809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:44.065706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:44.082485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.095781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.109423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae354b01-46b0-42dd-8063-06a549d927cc tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 1.184887 Sep 23 03:42:45.110078 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 646/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:43 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:45.121890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "name": "network-vif-unplugged", "status": "completed", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:45.162113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.162955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.163866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.165440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.181483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.183016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.184245 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d215d76c-b50b-43ef-8d24-401f1aa2c3fd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 1.200079 Sep 23 03:42:45.197236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 551/1197] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:43 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:45.201269 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] Creating event network-vif-unplugged:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h1-858495-2 Sep 23 03:42:45.215092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:45.215637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:45.215965 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0a97a223-051e-4a69-8bb8-2dd3eda2091d req-2a758b0d-a33e-403d-8709-51215a25daab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104750 Sep 23 03:42:45.216884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 647/1198] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:45.224550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:45.228721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:45.235738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.236233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.237745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.238902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.240776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.241367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.241971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.244399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.247384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.249425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.250733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:45.253667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.254123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.658351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.671800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.674760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.676308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-26cc65e6-271d-454d-9a5e-b9e708e60022 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1752 microversion: 2.32 time: 0.458274 Sep 23 03:42:45.677648 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 648/1199] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:45 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1752 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:45.719198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:45.731297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0de23cde-1201-44c7-adee-a60e39e39566 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1461 microversion: 2.1 time: 0.532121 Sep 23 03:42:45.740162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 552/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:45 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1461 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:45.758127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:45.759053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:45.769472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.770278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.771496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:45.772423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:45.773082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:45.773753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.067585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ebe70261-27a0-4735-9b49-954dff467aad tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1612 microversion: 2.1 time: 0.314541 Sep 23 03:42:46.069028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 553/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:45 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1612 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:42:46.102816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de6d7820-420d-476b-a225-73de5f61ba57 tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] Action: 'create', calling method: .version_select at 0x7f0c8b035280>, body: {"security_group": {"name": "tempest-securitygroup-148251257", "description": "tempest-description-1791286558"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:46.103864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:46.105614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:46.113230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.115411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.116096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.117199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.117916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.118599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.178269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b7e40d7565384402aec88733ef3b39c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61ad557826942c5b4fff9004fa4c908', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:46.180187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] flavor_id is None. Assuming migration. {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 03:42:46.181574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 03:42:46.401523 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa779952-05dc-45a6-ba2c-b04c44be3287 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40/action" status: 202 len: 0 microversion: 2.1 time: 0.302331 Sep 23 03:42:46.402472 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 554/1202] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:42:46 2022] POST /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:46.407541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:46.408158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:46.416111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.416610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.417335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.418151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.418699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.419135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.542292 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de6d7820-420d-476b-a225-73de5f61ba57 tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.824825 Sep 23 03:42:46.543813 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 649/1203] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:42:45 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:42:46.552405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:46.552405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:46.557064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.557683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.558213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.559100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.559676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.560399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.648199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:46.659343 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51963c07-1025-4c0d-9fcf-bfa92d52f79f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.255634 Sep 23 03:42:46.676642 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 555/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:46 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:46.685747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:46.702023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:46.712720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.716897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.717882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.720716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:46.721432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:46.722083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:46.863185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:46.881519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:46.885804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:46.890431 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e8598be-9e02-4afd-9d8e-8842895241c8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.345369 Sep 23 03:42:46.926310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 650/1205] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:46 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:46.941308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e436a5c3-1803-429c-9601-5bd858e1a50e tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] Action: 'create', calling method: .version_select at 0x7f0c8b035a60>, body: {"security_group": {"name": "tempest-securitygroup-406695951", "description": "tempest-description-803992723"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:47.105638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:47.116052 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e74662c-42ce-4114-a93e-120a87e355a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1470 microversion: 2.1 time: 0.439927 Sep 23 03:42:47.119833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 556/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:46 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:47.126453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:47.127681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:47.147865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:47.148391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:47.152475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:47.153477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:47.156124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:47.158578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:47.472714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e436a5c3-1803-429c-9601-5bd858e1a50e tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.544585 Sep 23 03:42:47.473314 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 651/1207] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:42:46 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:47.495602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:47.518654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:47.537199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:47.537815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:47.554504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:47.560100 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] Creating event network-changed:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h1-858495-2 Sep 23 03:42:47.567715 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8757d456-94fc-4b75-ba12-35baa6b4ae5b req-fb800ce3-1ee1-4313-8209-056e815f92c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092972 Sep 23 03:42:47.568775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:47.570531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:47.572069 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4b18135-7aeb-4233-9461-65c689dc157b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1798 microversion: 2.32 time: 0.449616 Sep 23 03:42:47.573191 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 557/1208] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:47 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1798 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:47.574181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 652/1209] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:47.701886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7352d8c9-7cab-4c12-941f-dc44d0a56f5c tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] Action: 'create', calling method: .version_select at 0x7f0c8b313dc0>, body: {"security_group": {"name": "tempest-securitygroup-1940119880", "description": "tempest-description-1864423304"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:47.705856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:47.708141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:47.733464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:47.733983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:47.737751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:47.740250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:47.742795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:47.745331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.100924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.114479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f946d46a-aab2-4d00-9b59-903a3d15afe2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.425840 Sep 23 03:42:48.115506 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 653/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:47 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:48.126344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:48.129629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:48.149972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.150644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.151311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.152482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.161196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.166385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.196298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7352d8c9-7cab-4c12-941f-dc44d0a56f5c tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.621717 Sep 23 03:42:48.196908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 558/1211] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:42:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:48.203188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:48.203799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:48.228727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.229569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.230678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.232150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.232882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.233519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.451111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.464818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.470064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.476824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-894447e4-c1cf-4ccf-aaf8-b1ed95a27793 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.360050 Sep 23 03:42:48.479787 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 654/1212] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:48 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:48.493157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8261eaf-2def-48e6-84f5-24cfeef71506 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] Action: 'create', calling method: .version_select at 0x7f0c8b0359d0>, body: {"security_group": {"name": "tempest-securitygroup-1366408378", "description": "tempest-description-150436574"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:48.498067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.510966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63db5f1c-f5f7-44b1-936d-55e2638d5ea4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1470 microversion: 2.1 time: 0.312423 Sep 23 03:42:48.511555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 559/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:48 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:48.599236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:48.600992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:48.608534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.609288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.609858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.610595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:48.611239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:48.611733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:48.744343 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8261eaf-2def-48e6-84f5-24cfeef71506 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.262577 Sep 23 03:42:48.745061 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 655/1214] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:42:48 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:48.758423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1109ca1d-50c7-4335-a9b2-4473613367c2 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] Calling method '.version_select at 0x7f0c8b035a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:48.883075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.929984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.940240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:48.950160 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0564846c-0a7b-44f1-b986-ca0ed65372e8 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1844 microversion: 2.32 time: 0.354348 Sep 23 03:42:48.955526 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 560/1215] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:48 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1844 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:42:49.164008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:49.165644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:49.192570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:49.197913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:49.198660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:49.200799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:49.204055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:49.204754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:49.266313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=13 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:49.568548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=64 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:49.653600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:49.674384 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ce1babe-83c4-44a7-abd5-93b363f43131 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.531742 Sep 23 03:42:49.675409 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 561/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:49 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:49.701527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "970b186d-c284-4ec2-8027-c9877ffd29a2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:49.733942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:49.735916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:49.737309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:49.779256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:49.783619 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] Creating event network-changed:970b186d-c284-4ec2-8027-c9877ffd29a2 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:49.793816 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-96715ba7-c3e0-4d26-9966-95b75087613c req-dbbb98df-1542-4cfe-a72a-549a1fdef22b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108094 Sep 23 03:42:49.794671 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 562/1217] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:49.804487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:49.806964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:49.829844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:49.830698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:49.831463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:49.832683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:49.839462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:49.840274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.114685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.127075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.128766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.129926 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-416d1bf7-fc27-4f78-80bc-387e553baa4a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.333815 Sep 23 03:42:50.149471 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 563/1218] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:49 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:50.154827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:50.155425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:50.166721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.167220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.167670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.168392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.168851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.169285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.260147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=72 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:50.501662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.520568 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba88d502-4ea2-4143-9596-1f7aec8fde89 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1470 microversion: 2.1 time: 0.369910 Sep 23 03:42:50.521448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 564/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:50 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:50.542572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:50.543197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:50.550126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.550620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.551068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.551785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.552248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.552680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.580851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:50.848217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.875096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.876787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:50.878139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3d4852a2-6279-4694-8013-ef2e1d1c2489 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1865 microversion: 2.32 time: 0.344306 Sep 23 03:42:50.882706 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 565/1220] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:50 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1865 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:50.908934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:50.914916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:50.941475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.953280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.953945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:50.954810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:50.955520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:50.956164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:51.289448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:51.327735 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8021deb0-89d1-470c-92fc-ca0cf32fc112 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.422964 Sep 23 03:42:51.329195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 566/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:50 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:51.336798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:51.338115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:51.345001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:51.346102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:51.359415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:51.360631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:51.361784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:51.362624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:51.621733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:51.635944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:51.637227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:51.638458 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4bcdf932-d364-4633-a58a-3dbdf82cbaac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.308099 Sep 23 03:42:51.639749 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 567/1222] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:51 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:51.658535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14ba8cd-1be2-461b-b588-d97cc518cefa", "name": "network-vif-plugged", "status": "completed", "tag": "137b2e78-7ecf-4a50-838a-bffc85ba5bb9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:51.679804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:51.680987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:51.681647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:51.698650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] Creating event network-vif-plugged:137b2e78-7ecf-4a50-838a-bffc85ba5bb9 for instance a14ba8cd-1be2-461b-b588-d97cc518cefa on n-h1-858495-2 Sep 23 03:42:51.706608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-96a8d8ff-71fa-4772-936a-a734e5081286 req-b24c537a-c975-4793-b000-e4884cf6c184 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065380 Sep 23 03:42:51.707652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 568/1223] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:51.716208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:51.717238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:51.725903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:51.726938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:51.728160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:51.729624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:51.730457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:51.731281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.003782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.016987 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91e0f901-d054-49bb-94dc-8e84e9a36243 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.307644 Sep 23 03:42:52.022416 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 569/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:51 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:52.028045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "994c862a-05ad-4b51-a24d-e8ee09c442c8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:52.037992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=12,nova_api:UPDATE=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:52.046591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.047086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.047527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.098183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] Creating event network-changed:994c862a-05ad-4b51-a24d-e8ee09c442c8 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:52.113944 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a1936b69-2883-41ed-b608-b5c39f032593 req-39c96c03-92db-4af7-9292-4caacf0ad641 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089852 Sep 23 03:42:52.116338 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 570/1225] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:52.128188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:52.128972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:52.137157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.137711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.138284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.139047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.139552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.140007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.423200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.433646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.435395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.436940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea36835f-0171-4697-8b25-a58c0fd0e21c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.316515 Sep 23 03:42:52.437561 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 571/1226] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:52 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:52.443281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:52.444089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:52.451519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.452250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.453237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.454250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.454858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.455432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.680053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.689647 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e4126ab-246a-49db-91c6-10f912c605c9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.250722 Sep 23 03:42:52.691882 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 572/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:52 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:52.697823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:52.698571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:52.704948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.706057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.706762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.707737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:52.708423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:52.709094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:52.937697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.947056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.948660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:52.950313 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-739f5e04-5e20-49a2-8393-433edd712d6a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.257159 Sep 23 03:42:52.951147 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 573/1228] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:52 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:53.044520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:53.045484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:53.051421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.051919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.052387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.053105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.053593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.054028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.324958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:53.336110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b76aa51c-5a5a-4386-ae99-7815d4eef6a4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.297637 Sep 23 03:42:53.336733 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 574/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:53 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:53.347074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1109ca1d-50c7-4335-a9b2-4473613367c2 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 17591 microversion: 2.1 time: 4.592621 Sep 23 03:42:53.348696 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 656/1230] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Sep 23 03:42:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 17591 bytes in 4595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:42:53.418851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a442115-a0eb-4328-bead-65fbae7fdd64 tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] Calling method '.version_select at 0x7f0c8b313e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:53.473002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:53.473948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:53.485583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.486417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.489340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.490746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.491492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.491881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.761674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a442115-a0eb-4328-bead-65fbae7fdd64 tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.348434 Sep 23 03:42:53.769556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 575/1231] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Sep 23 03:42:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:53.777640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:53.779024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:53.790005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:53.794522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.797832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.798644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.800731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:53.803289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:53.803653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:53.804312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:53.805837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:53.809166 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c581fbc-f77b-4100-b418-bf344f5e9b1f tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.343439 Sep 23 03:42:53.811956 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 657/1232] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:53 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:53.822237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-148e482f-2d88-40a0-b7ca-f44e91767f38 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] Calling method '.version_select at 0x7f0c8b0319d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.068766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:54.098859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9a4e61c-9041-41b7-a85f-2feac32a8b8a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1317 microversion: 2.1 time: 0.327746 Sep 23 03:42:54.103364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 576/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:53 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:54.113119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.113779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:54.129910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.130544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.131016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.131826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.132187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.132794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.181025 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-148e482f-2d88-40a0-b7ca-f44e91767f38 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cce62260-b5cf-4cb3-ad76-394204c9d503" status: 202 len: 0 microversion: 2.1 time: 0.366149 Sep 23 03:42:54.182109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 658/1234] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:42:53 2022] DELETE /compute/v2.1/os-security-groups/cce62260-b5cf-4cb3-ad76-394204c9d503 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:54.188169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "8694753c-ec94-4daf-8e5b-c6457d45d229"}, {"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "275db122-e490-4cee-bc28-544f7af60b07"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:54.203402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.204538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.205136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.235026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Creating event network-changed:8694753c-ec94-4daf-8e5b-c6457d45d229 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:54.235545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] Creating event network-changed:275db122-e490-4cee-bc28-544f7af60b07 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:54.244872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-035d5903-0d2e-44e0-accf-d6c7db0e7e91 req-699fd079-1b8d-4a29-a3fa-ce790d8f01b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059513 Sep 23 03:42:54.245822 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 659/1235] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:54.252451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d114387-e1ca-4432-944b-b3c9669aa961 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] Calling method '.version_select at 0x7f0c8b0ff1f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.452562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:54.476886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:54.494294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:54.496505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bebb251-7576-4e74-816d-41c2ff82bebb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.390962 Sep 23 03:42:54.497296 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 577/1236] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:54 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:54.507622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.511786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:54.522791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.523301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.523753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.524514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.524988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.525454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.681055 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d114387-e1ca-4432-944b-b3c9669aa961 tempest-SecurityGroupsTestAdminJSON-293221783 tempest-SecurityGroupsTestAdminJSON-293221783-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/54ad53d7-42af-4702-b9fc-07c3976971f1" status: 202 len: 0 microversion: 2.1 time: 0.433779 Sep 23 03:42:54.682499 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 660/1237] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:42:54 2022] DELETE /compute/v2.1/os-security-groups/54ad53d7-42af-4702-b9fc-07c3976971f1 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:54.690990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5bb83876-74fd-4e7e-b341-cdaa4bff62ff tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] Calling method '.version_select at 0x7f0c8b031dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.819445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:54.829660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fdcd84ec-a27c-456f-8425-483a4ff91fa4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.331099 Sep 23 03:42:54.830257 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 578/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:54 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:54.837053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:54.837693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:54.844001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.844686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.845274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:54.846372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:54.846846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:54.847818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.064348 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5bb83876-74fd-4e7e-b341-cdaa4bff62ff tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a4d0aeee-eeea-4047-a1f2-93256cdf2f9f" status: 202 len: 0 microversion: 2.1 time: 0.377154 Sep 23 03:42:55.070228 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 661/1239] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:42:54 2022] DELETE /compute/v2.1/os-security-groups/a4d0aeee-eeea-4047-a1f2-93256cdf2f9f => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:55.079233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1947781a-e81d-4623-8af0-b7ad7131c39b tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] Calling method '.version_select at 0x7f0c8afd6f70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:55.165661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.176815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.178724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.184827 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62a4daa6-d7dd-4505-a713-f1294a51ca9e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.351620 Sep 23 03:42:55.206671 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 579/1240] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:54 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:55.213855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:55.215021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:55.224344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.224949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.225495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.226294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.227344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.227344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.426823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1947781a-e81d-4623-8af0-b7ad7131c39b tempest-SecurityGroupsTestAdminJSON-1042032170 tempest-SecurityGroupsTestAdminJSON-1042032170-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/650a795d-21cc-4e5e-a869-1faf382bc284" status: 202 len: 0 microversion: 2.1 time: 0.354923 Sep 23 03:42:55.428093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 662/1241] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:42:55 2022] DELETE /compute/v2.1/os-security-groups/650a795d-21cc-4e5e-a869-1faf382bc284 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:42:55.444910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.454494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc974843-745e-4274-b1df-bad97a54fac5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1466 microversion: 2.1 time: 0.246213 Sep 23 03:42:55.455151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 580/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:55 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:55.489958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:55.491992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:55.501658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.503051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.503646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.505238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.505956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.506553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.529131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:55.529835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:55.539123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.540644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.541092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.543924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.545926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.547332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.798379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0852d0e9-44f2-42b3-9d12-c27c2af95ade tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1617 microversion: 2.1 time: 0.323304 Sep 23 03:42:55.815715 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 663/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:55 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1617 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:55.860768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:55.864192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:55.879557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.880696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.882111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.884870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.885923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:55.886662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:55.887731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:55.893972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.899642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:55.901199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90950fbb-34e2-41a7-9c29-4b6f111557cd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.377822 Sep 23 03:42:55.904255 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 581/1244] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:55 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:55.975732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-999157673", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1af7665c-7c20-4487-814f-72a67ee18bd8"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:56.059138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:42:56.244636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:56.269339 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6bbf3aee-3151-4783-b58f-2f0a73f673f5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.405081 Sep 23 03:42:56.273681 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 664/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:55 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:56.285227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:56.292024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:56.303049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.304061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.304825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.305781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.306530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.307446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.454067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:42:56.455467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:42:56.456313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:42:56.456896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:42:56.457884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:42:56.472983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.474132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.474588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.475486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.476328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.476778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.500460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:42:56.506258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:42:56.524201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:42:56.529005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:42:56.614944 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-718a1b53-187c-4daf-819f-3ab3d95126fe tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648224 Sep 23 03:42:56.615654 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 582/1246] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:42:56.634496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "8bd7259d-b43a-4662-9c32-fb99612627dd"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:56.659395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.660196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.661617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.683794 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] Creating event network-changed:8bd7259d-b43a-4662-9c32-fb99612627dd for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:56.696307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cd1561ae-5ffc-43ce-8c58-c26b69f64376 req-afc95470-75b3-4f00-8b2b-11adadac0037 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079244 Sep 23 03:42:56.697490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 583/1247] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:56.706795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25c0d5f7-320c-4d08-a272-11df87d1e133 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:56.707502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-25c0d5f7-320c-4d08-a272-11df87d1e133 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:56.822109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25c0d5f7-320c-4d08-a272-11df87d1e133 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:56.833770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-25c0d5f7-320c-4d08-a272-11df87d1e133 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1216 microversion: 2.1 time: 0.134581 Sep 23 03:42:56.850320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 584/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:56 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:56.945176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:56.946839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:56.965101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.966146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.968101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:56.969912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:56.971678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:56.974261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:57.294071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.315769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.318117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.320958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-543e0989-06ef-4e30-b662-2ae4f5af52b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 1.044900 Sep 23 03:42:57.322601 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 665/1249] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:56 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:57.328360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:57.330005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:57.340151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:57.341001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:57.341688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:57.343116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:57.345278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:57.346114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:57.776880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.790248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-237df1c8-a336-490e-83de-ff55e7c6503a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.466111 Sep 23 03:42:57.791036 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 666/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:57 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:57.806660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.808995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.810747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.812520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c348ab70-7d96-4fd8-ba34-be93a6d2c427 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.875104 Sep 23 03:42:57.813676 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 585/1251] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:56 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:57.863245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:57.864814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:57.872462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:57.873154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:57.873788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:57.875472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:57.876074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:57.876611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:57.956142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:57.966807 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ce80114d-7675-4ff7-bfcd-555567a373f5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1268 microversion: 2.1 time: 0.110680 Sep 23 03:42:57.967942 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 667/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:57 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1268 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:58.352768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:58.353984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:58.363241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.363854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.364904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.365148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.373665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.374315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.643400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:58.647786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:42:58.656659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:58.658261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:58.659531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de8198cf-adcb-41e2-b4eb-93e461924be6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.311403 Sep 23 03:42:58.661427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 586/1253] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:58 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:42:58.720693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b"}, {"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "88d28e56-054a-4607-9395-9c4ece17b2b1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:42:58.745334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.745845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.746280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.757849 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Creating event network-changed:a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:58.759157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] Creating event network-changed:88d28e56-054a-4607-9395-9c4ece17b2b1 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:42:58.764543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a2f6b754-a9a8-47f7-a110-2aea78743232 req-fc273f8d-0b61-40e8-88b2-963ea5054b37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047355 Sep 23 03:42:58.765738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 668/1254] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:42:58.818026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:58.825490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:58.840981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.842437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:58.843262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:58.843575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.845623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.848617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.849475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.850577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.858485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.859805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.862501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:58.863994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:58.865587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:58.867185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:59.104524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.119199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-818098e6-1ab6-4b1b-a5b1-e0813f70db71 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.303653 Sep 23 03:42:59.135012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 587/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:58 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:59.157804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:59.158692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:59.170232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:59.170627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:59.171067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:59.171792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:59.172254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:59.173269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.183228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:59.199736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.201285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.202566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-64d94a3c-cb6d-4f2e-b7cd-649c46e48dd5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.368452 Sep 23 03:42:59.218266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 669/1256] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:58 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:42:59.334078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.349062 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fd9a88d-20e3-45f6-9bee-bee3db237a1a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1274 microversion: 2.1 time: 0.212522 Sep 23 03:42:59.350958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 588/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:42:59 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:42:59.687356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:42:59.688045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:42:59.694668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:59.698716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:59.699650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:59.700883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:42:59.701864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:42:59.702723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:42:59.936340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.952543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.958153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:42:59.963247 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2754b8ed-e272-4c9d-aa59-7f1798da69f4 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.277044 Sep 23 03:42:59.963247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 670/1258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:42:59 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:00.152991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:00.153780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:00.164216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.165439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.165980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.166859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.167973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.168572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.265125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:00.269745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:00.294372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.298929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.300212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.304110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.307839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.308536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.498506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:00.507574 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-655ccdb7-65a6-409a-b556-b6002ef8e79b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.360818 Sep 23 03:43:00.513478 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 589/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:00 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:00.518459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:00.519080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:00.546600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.547106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.547552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.548282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.548741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.549182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:00.677077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:00.691803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:00.693406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:00.694612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbe8e230-9b73-4d9e-a03d-2a23cbd1ace8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.449322 Sep 23 03:43:00.717442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 671/1260] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:00 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:00.900491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:00.909745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc32dab6-e96b-4a94-be74-7f1e8059c7b3 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.395025 Sep 23 03:43:00.918607 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 590/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:00 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:00.951677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1820082072", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:00.987008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:00.987755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:00.996075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:00.999222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:00.999914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.000876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.003059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.006864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.025633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:43:01.365872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:01.366688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:01.368560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:01.369875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:01.370574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:01.381872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.383487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.384190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.385278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.385881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.386531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.411365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Getting quotas for project 07c7ee89de494792bc07413ccdc24147. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:43:01.416659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Getting quotas for user 4a13a042477b4308a37f825130e309d8 and project 07c7ee89de494792bc07413ccdc24147. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:43:01.423179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.434552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.436019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.437229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8985ce23-147b-4ee8-b008-2f2908d7f642 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.454156 Sep 23 03:43:01.437884 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 591/1262] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:00 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:01.452338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:43:01.456770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:43:01.494475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:01.513438 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52624cb9-949b-47f6-8adf-2d435e3bee3d tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805978 Sep 23 03:43:01.514414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 672/1263] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:43:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:43:01.526174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5b52c66-d0a6-4ba9-a518-0e17d6d1e119 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:01.527107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5b52c66-d0a6-4ba9-a518-0e17d6d1e119 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:01.537034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:01.537575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:01.545129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.545651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.546093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.546805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.547261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.548119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.657685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5b52c66-d0a6-4ba9-a518-0e17d6d1e119 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.671922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5b52c66-d0a6-4ba9-a518-0e17d6d1e119 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1223 microversion: 2.1 time: 0.149797 Sep 23 03:43:01.672525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 592/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:01 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:01.733735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:01.734444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:01.741616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.745265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.747121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.749431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.751733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.753238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.753911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.762482 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8ddc32c-5ec6-41c8-bff9-04ef82d0f2e6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.230571 Sep 23 03:43:01.778391 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 673/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:01 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:01.941715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:01.942311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:01.967656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.975675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.976228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.979457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.980451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:01.980810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:01.981250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:01.984708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.986457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:01.987943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18d425e5-84c3-4d6e-82c4-d4584db19e37 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.258192 Sep 23 03:43:02.002348 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 593/1266] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:01 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:02.142597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:02.153805 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccbb0ec3-54b1-455f-9fd5-419801e02c9d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.217373 Sep 23 03:43:02.165463 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 674/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:01 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:02.479026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:02.480237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:02.488823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.489449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.491146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.492370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.493138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.494465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.697786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:02.698592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:02.711644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.712147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.712591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.713304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.714156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.714276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.749106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:02.845340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:02.854560 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2538044d-50ac-4abd-9767-27d9f3caa113 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1275 microversion: 2.1 time: 0.162347 Sep 23 03:43:02.855444 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 675/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:02 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:02.860639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:02.861462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:02.865515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:02.868254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.868934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.869585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.871527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:02.872158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:02.872748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:02.879436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:02.881567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:02.883757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-197dbe75-1b9b-44a1-b0b8-d687584e709b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1886 microversion: 2.32 time: 0.414066 Sep 23 03:43:02.913721 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 594/1269] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:02 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1886 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:03.016855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:03.017871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:03.026598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.027356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.028344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.029943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.030591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.031274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.092372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:03.102152 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9888fe78-9603-445f-8946-119be5d0716d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.245411 Sep 23 03:43:03.103366 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 676/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:02 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:03.179864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:03.180781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:03.191072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.192288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.193009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.194590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.195763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.196243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.207603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:03.218981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:03.221334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:03.222628 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96ab1710-5207-4e7b-9121-5c139edeed52 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.210946 Sep 23 03:43:03.225432 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 595/1271] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:03 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:03.341575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:03.351192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbd49154-54a5-44d0-9d5b-382ef6d5f2ee tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.175871 Sep 23 03:43:03.353449 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 677/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:03 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:03.530110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32786389-4406-4643-b442-671703947f73", "tag": "0d52b494-5feb-4a3a-ab56-293fdeb3e58f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:03.542892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.543364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.543895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.560449 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] Creating event network-changed:0d52b494-5feb-4a3a-ab56-293fdeb3e58f for instance 32786389-4406-4643-b442-671703947f73 on n-h1-858495-2 Sep 23 03:43:03.568013 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d203e93c-643f-496f-b320-fe6904696e33 req-20d31e5f-501a-44d4-a2d5-7f6d5c8d08dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040800 Sep 23 03:43:03.569056 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 596/1273] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:03.877474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:03.878067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:03.885797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.886416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.887124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.887932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.888463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.888961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.919076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:03.920043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:03.931911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.932701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.933315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:03.934237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:03.934863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:03.935449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.356937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:04.364693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3153624e-32a1-4538-9487-c5c5b3ac5827 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1281 microversion: 2.1 time: 0.491169 Sep 23 03:43:04.365265 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 678/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:03 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1281 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:04.370776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:04.371123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:04.382663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.382920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.386542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.386542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.386542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.386542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.735919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:04.747383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:04.748830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:04.750159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e4c2704-3973-4a26-81de-209fb7be33c2 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.837037 Sep 23 03:43:04.750742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 597/1275] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:03 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:04.763800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:04.764416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:04.766635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:04.771083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.771575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.772081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.772800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.774003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.774604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.775897 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d592f861-3b5a-4a83-a1e5-e50f6ec8b844 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.409585 Sep 23 03:43:04.776481 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 679/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:04 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:04.781475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:04.782278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:04.788988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.790261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.790947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:04.791837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:04.792437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:04.793003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.191198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:05.201726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:05.211827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:05.213435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:05.214612 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a3093ce-7dcc-4946-8b1c-16519551579f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1812 microversion: 2.25 time: 0.462953 Sep 23 03:43:05.216003 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 598/1277] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:04 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1812 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:05.216923 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6ed771c-555c-4c8e-908a-fecea79e6501 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.439123 Sep 23 03:43:05.217562 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 680/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:04 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:05.388295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:05.389008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:05.395474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.396585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.397027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.397746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.398197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.399214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.493241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:05.503811 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b34bcf0-af58-4fef-ab77-cde2d2f7a0bb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1281 microversion: 2.1 time: 0.119342 Sep 23 03:43:05.504675 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 599/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:05 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:05.780535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:05.781157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:05.788162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.788668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.789714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.790441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.790904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.791332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.802626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:05.803296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:05.817733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.818680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.819601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:05.821336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:05.822168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:05.822793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.258809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.266673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ae1e2ea-957f-4775-b6ae-c476ab10f731 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.468153 Sep 23 03:43:06.267350 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 600/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:05 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:06.272417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.273044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:06.274299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:06.280693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.281333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.281856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.282829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.283351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.283775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.288431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.290643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.292133 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ed46119-46ee-430f-a99f-0ac746ded953 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.515739 Sep 23 03:43:06.292706 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 681/1281] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:05 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:06.297750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:06.298334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:06.304704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.305222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.305791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.306564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.307067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.307840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.487087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:06.728766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.738998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.739318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.744016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:06.753047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07225021-024d-4661-ae7d-277088c5c3a7 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.459035 Sep 23 03:43:06.753684 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 682/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:06 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:06.760796 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-526d451c-58d5-40df-810e-333aa4a7296e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1802 microversion: 2.25 time: 0.478296 Sep 23 03:43:06.762968 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 601/1283] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:06 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1802 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:06.768244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:06.772685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:06.781925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.783637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.784673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.785899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.786869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.787323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.791768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f80bf7a-4c6f-4a07-8bd7-76b03e0ac489 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '.version_select at 0x7f0c8b2dcf70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:06.795402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f80bf7a-4c6f-4a07-8bd7-76b03e0ac489 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.795899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f80bf7a-4c6f-4a07-8bd7-76b03e0ac489 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.796343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f80bf7a-4c6f-4a07-8bd7-76b03e0ac489 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.808859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f80bf7a-4c6f-4a07-8bd7-76b03e0ac489 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 4049 microversion: 2.25 time: 0.021199 Sep 23 03:43:06.815030 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 602/1284] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Sep 23 03:43:06 2022] GET /compute/v2.1/os-migrations => generated 4049 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:06.826490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:06.827093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:06.832952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.833466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.833902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:06.834594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:06.835047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:06.835543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.207024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:07.215659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f2be469-7d69-437a-971c-a321cf231162 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.460921 Sep 23 03:43:07.216451 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 683/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:06 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:07.257690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:07.286514 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65f6a5d8-c242-4663-9031-40544fe5fec5 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 2420 microversion: 2.25 time: 0.463257 Sep 23 03:43:07.287688 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 603/1286] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:06 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 2420 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:07.292151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:07.292849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:07.299088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.299969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.301023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.302219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.302997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.303670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.315645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:07.316268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:07.324424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.324930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.325405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.326110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.326612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.326979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.716460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:07.728833 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9690f12-313c-4a5c-8a5b-d96e25c64bf2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.440137 Sep 23 03:43:07.730931 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 684/1287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:07 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:07.741657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:07.741657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:07.744527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:07.746744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.747356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.747886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.748709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.749257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.749820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.781400 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7fdebeb-8a15-460a-aeaa-ee52c0cf74a2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 2420 microversion: 2.25 time: 0.469600 Sep 23 03:43:07.782193 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 604/1288] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:07 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 2420 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:07.787232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:07.795431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:07.812474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.813228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.813228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.813922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:07.814175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:07.814792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:07.826618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:08.678329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:08.699354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:08.706358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:08.707998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:08.709320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f732e0cd-464f-425c-b874-4d33f29d8668 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.978631 Sep 23 03:43:08.709903 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 685/1289] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:07 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:08.713537 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e44b855-0e69-4e6e-a2bd-2116d8eeed17 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.927408 Sep 23 03:43:08.713537 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 605/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:07 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:08.716866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851b3412-f951-4815-90a0-d3f056cb238e", "tag": "fcda4888-d8b5-4f69-b875-b4c18866b73d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:08.735671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:08.736514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:08.743280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:08.743759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:08.744195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:08.745631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:08.746161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:08.746624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:08.747500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:08.747958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:08.748383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:08.763922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] Creating event network-changed:fcda4888-d8b5-4f69-b875-b4c18866b73d for instance 851b3412-f951-4815-90a0-d3f056cb238e on n-h2-858495-2 Sep 23 03:43:08.773258 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2148cd3f-084e-4c6f-8bfa-3e98877b22c2 req-2154e1d8-1cac-49c6-b263-7d012c232313 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060565 Sep 23 03:43:08.773902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 606/1291] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:08.786259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:08.787022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:08.800568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:08.801227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:08.801887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:08.802749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:08.803385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:08.804065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:08.905773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lazy-loading 'services' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:09.030400 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7fc03564-c7a1-452d-8d3c-3343a12be612 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments/122ad226-8edc-4de9-b4e0-cae8410444ee" status: 202 len: 0 microversion: 2.25 time: 0.302486 Sep 23 03:43:09.031318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 686/1292] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Sep 23 03:43:08 2022] DELETE /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments/122ad226-8edc-4de9-b4e0-cae8410444ee => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:09.041933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:09.046510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:09.047467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:09.051221 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44315fe3-9ac8-43c4-ba10-b4ded4994028 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.269052 Sep 23 03:43:09.054445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 607/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:08 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:09.063375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:09.065867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:09.066652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.067158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.067818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.068528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.069182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.072356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.072920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.073328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.073485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.074195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.074660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.075101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.117960 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83525a29-2c65-4fd3-8a2f-b9b239a9086f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058170 Sep 23 03:43:09.121596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 608/1294] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:09 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:09.220968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:09.229203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31f431bd-acfd-4e49-afe7-9b48fab12379 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.196591 Sep 23 03:43:09.229803 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 687/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:09 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:09.446779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32786389-4406-4643-b442-671703947f73", "name": "network-vif-plugged", "status": "completed", "tag": "0d52b494-5feb-4a3a-ab56-293fdeb3e58f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:09.456563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.456959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.457883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.471193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] Creating event network-vif-plugged:0d52b494-5feb-4a3a-ab56-293fdeb3e58f for instance 32786389-4406-4643-b442-671703947f73 on n-h1-858495-2 Sep 23 03:43:09.475852 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-eccad0b1-2ebe-41f3-b290-69431113b575 req-a14948b2-1ba3-4d11-8d21-a5fb7b000b44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Sep 23 03:43:09.476798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 609/1296] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:09.738715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:09.739332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:09.740279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:09.741017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:09.745911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.746488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.746994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.747278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.747772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.747896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.748220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.748492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.748956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:09.749156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.749447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:09.749883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:09.979551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:09.987198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9dbc3945-08ad-4620-957c-d0d282c4818f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.252444 Sep 23 03:43:09.987803 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 688/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:09 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:09.996651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:10.006128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:10.008189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:10.009431 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd1d53f7-23c4-4f7b-8b73-f89c5ab12d04 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.273970 Sep 23 03:43:10.010014 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 610/1298] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:09 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:10.080847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:10.081491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:10.087716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.088226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.088682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.089496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.089947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.090399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.130648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:10.133572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:10.139749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.140242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.140689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.141430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.141895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.142327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.173871 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9e92052-7f9b-4884-8824-e55539db665b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.047119 Sep 23 03:43:10.174699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 611/1299] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:10 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:43:10.226330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:10.234286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd9348c4-4061-401d-969e-6e94e0c28077 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.157297 Sep 23 03:43:10.234793 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 689/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:10 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:10.252014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:10.252631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:10.259293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.259783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.260262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.261018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:10.261528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:10.261963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:10.391111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:10.399388 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54c8b85e-a4e2-4b26-9da7-1f0511d47ed4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.151263 Sep 23 03:43:10.399989 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 612/1301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:10 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:11.011119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:11.011736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:11.018605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.019090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.019547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.020236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.020950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.021399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.037017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:11.037989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:11.041612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:11.046664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.047383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.047827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.048539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.048997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.049619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.274143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.281940 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b0c2241-d26e-4338-bd16-3acaebbd57af tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1316 microversion: 2.1 time: 0.275393 Sep 23 03:43:11.282524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 690/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:11 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:11.287534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:11.290332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:11.296498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.296989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.297126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.297695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.298145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.298663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.299193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.308498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.310026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.311196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32a4f94d-4aa9-4459-a803-9e620b98d206 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.279387 Sep 23 03:43:11.311769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 613/1303] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:11 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:11.316749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:11.317382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:11.318131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:11.324240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.325834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.326287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.327010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.327475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.328090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.333651 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c37d50d-8667-4408-b1be-463f72e9ada5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050071 Sep 23 03:43:11.334229 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 691/1304] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:11 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:11.422966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:11.423586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:11.425493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:11.431720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.432213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.432655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.433885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:11.434029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:11.434408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:11.438915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:11.459783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.468587 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d66bac89-5f2f-4004-866b-99fed7747dcb tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.155115 Sep 23 03:43:11.469263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 614/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:11 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:11.569924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:11.577639 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4923aa55-b596-439c-909b-f2e3fac9e4a5 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.158575 Sep 23 03:43:11.578215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 692/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:11 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:12.306579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.307247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:12.309165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:12.315354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.315860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.316346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.317076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.317579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.318022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.337805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.338576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:12.345778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.346280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.346726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.347459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.347929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.348375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.566322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:12.574775 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20bb02d4-6911-48c2-85ec-ed06265ad37f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1465 microversion: 2.1 time: 0.273046 Sep 23 03:43:12.575362 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 615/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:12.580066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.582364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:12.588474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.588982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.589448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.590172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.590637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.591072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.591262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:12.602928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:12.604430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:12.605758 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d116812b-bb28-4e6d-afc1-336662b27886 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.272020 Sep 23 03:43:12.606336 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 693/1308] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:12.611032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.611590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:12.618811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.619011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.619331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.620148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.620681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.621120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.624729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-465ec40b-2047-4c9d-ba84-d048476fdcbd tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.048302 Sep 23 03:43:12.625329 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 616/1309] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:12.629685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.630297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:12.637524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.638027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.638470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.639185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:12.639647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:12.640073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:12.930708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:12.949553 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf7dba2d-6a20-47ec-b3cc-d2cbdd2ca347 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.341614 Sep 23 03:43:12.950660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cfd8a8dd-c818-4a53-987b-d74d9fb85e98 tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1616 microversion: 2.1 time: 0.324171 Sep 23 03:43:12.951633 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 694/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:12.957936 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 617/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1616 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:12.986387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:12.988190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:13.004564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.005597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.006338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.015552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.017153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.017367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.164527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2014643300", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1af7665c-7c20-4487-814f-72a67ee18bd8"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:13.228986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:43:13.451726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:13.473794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07e51c4b-9927-44b6-93ae-32f7579b6a54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.520326 Sep 23 03:43:13.474473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 695/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:12 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:13.635559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:13.636486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:13.647184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.647778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.648505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.649330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.649892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.650392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.673859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:13.674495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:13.674862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:13.675292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:13.676602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:13.690328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.691141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.691897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.692581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.693049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.693519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.717092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:43:13.721512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Getting quotas for user 9fbb51e3276f4407b824d409896528e3 and project a6525256320b4b68b685b5c3e52f5c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:43:13.735430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:43:13.738154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:43:13.801761 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-777f5568-df13-4192-ad46-d95daedb6588 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641397 Sep 23 03:43:13.809658 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 618/1313] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:43:13.829963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:13.833491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:13.844307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.844840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.845315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.846154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:13.847523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:13.848170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:13.907107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-111a70d9-9c4a-413f-a3fa-39c1be3881be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092473 Sep 23 03:43:13.908144 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 619/1314] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:13 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:13.916302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a0425d6-ada4-4e34-9980-5223fef65a93 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:13.917146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5a0425d6-ada4-4e34-9980-5223fef65a93 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:13.928965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:13.948808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:13.950785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:13.952758 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6f93966-f8ef-4a44-bac8-6c167063a1da tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.323573 Sep 23 03:43:13.954168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 696/1315] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:13 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:13.995460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:13.996475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:14.004924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a0425d6-ada4-4e34-9980-5223fef65a93 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:14.005627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.006288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.006741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.008453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.008982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.009844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.013511 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a0425d6-ada4-4e34-9980-5223fef65a93 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1217 microversion: 2.1 time: 0.103924 Sep 23 03:43:14.014413 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 620/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:13 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:14.217380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:14.229515 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb6df06e-d46b-401c-99c3-31cd650ae4c2 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.240188 Sep 23 03:43:14.230755 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 697/1317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:13 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:14.506958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:14.508729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:14.522331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.524184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.525574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.527321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.528014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.528678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.573365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851b3412-f951-4815-90a0-d3f056cb238e", "name": "network-vif-plugged", "status": "completed", "tag": "fcda4888-d8b5-4f69-b875-b4c18866b73d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:14.591456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.592988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.593668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.614461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] Creating event network-vif-plugged:fcda4888-d8b5-4f69-b875-b4c18866b73d for instance 851b3412-f951-4815-90a0-d3f056cb238e on n-h2-858495-2 Sep 23 03:43:14.631510 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f04cfff2-5591-417c-af6a-c131fa5f3e62 req-943dc6b5-1c87-4d51-9283-888dba76abef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064288 Sep 23 03:43:14.632695 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 698/1318] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:14.707199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:14.717578 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-869cc001-1705-416f-9766-9ad246a920f6 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.218065 Sep 23 03:43:14.718878 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 621/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:14 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:14.928156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:14.934067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:14.947670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.948520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.949267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.950535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.951823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.952653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.983708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:14.985995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:14.996111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.997046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:14.997573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:14.998945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:14.999088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.000278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.010808 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83a715c4-ea9e-473d-9c9c-4f9f11b2c45a tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092053 Sep 23 03:43:15.011932 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 699/1320] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:14 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:15.040306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:15.040987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:15.051303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.052233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.052838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.053835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.054587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.055427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.222648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.231430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86d22705-60cf-4caf-ac25-bafdb2f9f9d1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1269 microversion: 2.1 time: 0.195133 Sep 23 03:43:15.232339 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 700/1321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:15 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:15.260058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:15.260720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:15.267745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.268637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.268995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.269801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.270624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.272970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.310304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.327771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.330159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.332012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca326cf7-f298-46fa-ad8a-5b389422887d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.354078 Sep 23 03:43:15.332846 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 622/1322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:14 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:15.461456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.470819 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cffbee7d-06ef-429c-8081-b270d0ea5bf0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.217938 Sep 23 03:43:15.471408 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 701/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:15 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:15.745448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:15.746238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:15.753658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.754229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.754785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.755572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:15.756095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:15.756625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:15.926138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:15.937826 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fef48a0e-b9ec-4fb8-8bec-45ffe52722b2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.196915 Sep 23 03:43:15.938539 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 623/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:15 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:16.025262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:16.027763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:16.034755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.035210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.035653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.036381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.036845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.037279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.081047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2bb3f7cb-622a-4664-83cb-b1e50ba70ffe tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060647 Sep 23 03:43:16.081813 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 702/1325] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:16 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:43:16.257744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:16.258391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:16.271208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.271708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.272320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.273191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.273674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.274104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.351141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:16.355330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:16.360859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eec3b9d8-0a70-466f-bf4d-156c27f8debd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1269 microversion: 2.1 time: 0.108278 Sep 23 03:43:16.361108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:16.362197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:16.365509 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 624/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:16 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:16.369513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.370238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.370834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.371742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.372492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.373202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.494942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:16.495564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:16.503093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.504052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.504521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.505211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.505691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.506260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.647461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:16.658227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:16.659689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:16.660876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e9e1688-b312-4c61-ae1b-bd225a3c0701 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.304259 Sep 23 03:43:16.678916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 703/1327] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:16 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:16.702075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:16.710059 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67cd703d-4b24-4028-812a-72b9e9c5f6e1 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1323 microversion: 2.1 time: 0.220143 Sep 23 03:43:16.710823 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 625/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:16 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:16.973646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:16.974279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:16.981966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.982460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.982899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:16.983609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:16.984071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:16.984497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.099368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:17.102981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:17.111069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.111819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.112449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.113591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.114301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.114916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.164386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6ae9962-d596-42ec-938e-81f6c97322ad tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070219 Sep 23 03:43:17.172102 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 626/1329] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:17 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:43:17.256815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:17.266711 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63323b9f-fa0f-46f7-8854-957d0a69fa69 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.297170 Sep 23 03:43:17.267326 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 704/1330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:16 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:17.392522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:17.394156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:17.405054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.405583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.406030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.406746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.407206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.407637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.495559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:17.504962 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7b4c52d-5504-433b-806b-a6bceca9d92b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1275 microversion: 2.1 time: 0.118373 Sep 23 03:43:17.505198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 627/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:17 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:17.689147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:17.695727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:17.702500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.703004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.703485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.704429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.704890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.705341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.735855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:17.736845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:17.744977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.745544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.745992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:17.746744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:17.747206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:17.747638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.124006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.134203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.134804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.135684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.137289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ffb257c1-869c-4a38-afe9-27b24b443897 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.452901 Sep 23 03:43:18.137894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 705/1332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:17 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:18.143410 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5863faa-9964-45e5-8a04-2d607ba34d08 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1473 microversion: 2.1 time: 0.412502 Sep 23 03:43:18.158672 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 628/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:17 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1473 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:18.171133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.172313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.180629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.182870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.183532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.183992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.184497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.184727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.185392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.185995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.192688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.193742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.194201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.195530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.196235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.196985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.213274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Request method failure captured: Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e/diagnostics HTTP/1.1 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLStDP0SU-WjTBsZkkmRT2bsX6Ijk1yvt29_qp550hWnwrqp8ghORqaUbFaMVPdWZZOSkTjjKU1o0OKlLIcfYeWXpp1OOE5L7TowUWQMaTyYRf1QWy40u8hputAe1a-Ht2IfTWI5mNJyeTqR07fKYaVbQx6SE1lxsqROzPHMhS1nYYHk Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 07c7ee89de494792bc07413ccdc24147 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:43:18.222115 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07c7ee89de494792bc07413ccdc24147"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 07c7ee89de494792bc07413ccdc24147 Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerDiagnosticsNegativeTest-1421324806-project Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4a13a042477b4308a37f825130e309d8 Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1421324806-project Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:43:18.223668 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '851b3412-f951-4815-90a0-d3f056cb238e'} Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:43:18.224410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:18.227311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:18.228490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-458ac465-b732-4580-82bc-9beae80f8d17 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.058382 Sep 23 03:43:18.228490 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 706/1334] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:43:18 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e/diagnostics => generated 117 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:18.236800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.237311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.239325 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ed3ef3a-b6e3-4d0d-953b-07124b06b161 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.063460 Sep 23 03:43:18.240306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 629/1335] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 03:43:18 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:18.258544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.259435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.260142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.261176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.262088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.263142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.298091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.298717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.307594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:18.311405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.312180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.313660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.314410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.317297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.318102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.432948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:18.511561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40bb5988-cea4-4954-b7f8-04cb235caf99 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "DELETE /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 204 len: 0 microversion: 2.1 time: 0.277409 Sep 23 03:43:18.519778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 707/1336] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:18 2022] DELETE /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:18.539133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.549684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.563309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.563309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.563546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.567233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.571010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.571343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.645782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.669275 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5c89a70-6690-42d6-99b1-5d37e505e67d tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.375093 Sep 23 03:43:18.670301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 630/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:18 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:18.699239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:18.700037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:18.715434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.716207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.716783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.717738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:18.719123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:18.722516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:18.888242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.912298 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3711034-f56d-4c73-acc2-a54ea5391d9b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1479 microversion: 2.1 time: 0.386118 Sep 23 03:43:18.925381 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 708/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:18 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1479 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:18.940519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:18.950005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b734354-3b42-4313-9158-5067cf45e750 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.255291 Sep 23 03:43:18.950713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 631/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:18 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:19.170108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:19.172217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:19.191973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.195766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.196747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.203569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.204517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.207509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.509422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:19.521150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:19.522737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:19.523990 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-607c3d13-857b-46cc-9ea0-67bf32054361 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.360908 Sep 23 03:43:19.524890 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 709/1340] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:19 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:19.710841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:19.711948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:19.720323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.720824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.721271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.722122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.722590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.723025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.915571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:19.925926 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e33f072-2ed9-4770-a566-f26cba680f09 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.220977 Sep 23 03:43:19.926681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 632/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:19 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:19.953874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:19.954824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:19.968511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.971633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.972804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.974194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.975102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.976648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.977300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:19.978324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:19.986260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.987431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.988036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:19.988944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:19.989800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:19.990250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:20.374788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:20.393993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d83c21d9-5d09-4d4c-96b2-c059902643c0 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1479 microversion: 2.1 time: 0.444913 Sep 23 03:43:20.396180 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 710/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:19 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1479 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:20.400974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:20.419298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-809b06f7-6b1f-45d8-8cd1-c317ac7ea33b tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.448992 Sep 23 03:43:20.419899 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 633/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:19 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:20.560404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:20.562775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:20.573504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:20.574330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:20.574940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:20.575839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:20.576464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:20.577337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:20.951742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:20.952366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:20.959120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:20.959857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:20.960486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:20.962010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:20.962769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:20.963219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:21.523876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:21.529002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:21.546084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e68acc2-4cba-451d-ad8a-b6d34f6e7e0b tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.598399 Sep 23 03:43:21.546938 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 634/1344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:20 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:21.551835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:21.552653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:21.566030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:21.568515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:21.569927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:21.570102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e4d23940-0c2b-41b7-b9e5-fef4a683e03a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 1.018515 Sep 23 03:43:21.570309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:21.570768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:21.571500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:21.572607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:21.573236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:21.586168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 711/1345] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:20 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:21.596963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:21.597931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:21.606625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:21.607412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:21.608044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:21.609029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:21.609721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:21.610458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:22.016109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:22.018564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:22.029413 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53782d4a-6f9f-4864-bc35-f6ed0e178d06 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.439766 Sep 23 03:43:22.030392 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 712/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:21 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:22.036155 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5d7bb0d-01a0-47a4-bf3f-ce24b28d517b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1479 microversion: 2.1 time: 0.487922 Sep 23 03:43:22.037344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 635/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:21 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1479 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:22.187908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851b3412-f951-4815-90a0-d3f056cb238e", "name": "network-vif-deleted", "tag": "fcda4888-d8b5-4f69-b875-b4c18866b73d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:22.217373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:22.219304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:22.219758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:22.241746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] Creating event network-vif-deleted:fcda4888-d8b5-4f69-b875-b4c18866b73d for instance 851b3412-f951-4815-90a0-d3f056cb238e on n-h2-858495-2 Sep 23 03:43:22.252497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f2662e0d-bc20-41f2-8f2a-251897dfdd41 req-8f01ec32-5415-4864-9583-3427dc1a0369 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069189 Sep 23 03:43:22.254846 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 713/1348] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:22.641067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:22.646451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:22.674332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:22.676320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:22.677579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:22.678767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:22.679904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:22.682557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:22.839347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:22.841167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:22.853091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:22.854234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:22.855682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:22.858092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:22.859027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:22.859914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.109907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.123351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.125454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.127003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eeb62129-fd1f-446b-b7fe-4567330c513d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.504483 Sep 23 03:43:23.143090 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 714/1349] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:22 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:23.155944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:23.157086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:23.163062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.165087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:23.165898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:23.166890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.167974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:23.168639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:23.169253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.175154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-979c1b36-8fb1-4d31-9942-bf19ea8836a2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.607654 Sep 23 03:43:23.175954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 636/1350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:22 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:23.207737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:23.209056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:23.218532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:23.219134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:23.219650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.220521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:23.221023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:23.221696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.264634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:23.265237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:23.265790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:23.266318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lazy-loading 'fault' on Instance uuid 851b3412-f951-4815-90a0-d3f056cb238e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:23.344786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.356217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d84ab44e-6a1c-4853-bae4-aa92a8790204 tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1313 microversion: 2.1 time: 0.153592 Sep 23 03:43:23.358376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 637/1351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:23 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:23.396453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:23.404944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adf872d1-2f2c-416b-8c56-37a854b11184 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.260343 Sep 23 03:43:23.405936 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 715/1352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:23 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:24.158511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:24.159799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:24.162757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:24.165231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:24.175763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.176682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.177743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.179055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.179768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.180759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.199131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:24.199754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:24.212730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.213223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.213699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.214428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.215980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.216516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.605920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:24.613879 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90b3d558-5880-4881-9092-65aa070652e2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1475 microversion: 2.1 time: 0.418540 Sep 23 03:43:24.620431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:24.626433 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 716/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:24 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:24.633118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:24.635703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:24.637583 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-272ecc92-8dc8-40a0-bf35-cc98fa3b1e75 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.482687 Sep 23 03:43:24.638945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df4e38-f8c7-432d-ba5a-45035364bb7e", "tag": "a2b8a2cf-6ae3-4524-bd52-400c49f5c494"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:24.653799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.653799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.653799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.654886 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 638/1354] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:24 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:24.662082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:24.662219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] Creating event network-changed:a2b8a2cf-6ae3-4524-bd52-400c49f5c494 for instance a9df4e38-f8c7-432d-ba5a-45035364bb7e on n-h2-858495-2 Sep 23 03:43:24.662779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:24.668683 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5c6173f9-7b12-4248-8ff0-55a055583591 req-750e1faa-ddc1-48cf-80ec-0e15239dc231 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Sep 23 03:43:24.670186 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 717/1355] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:24.675931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:24.676155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.677757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.678252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:24.679427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.680365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.680769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.681210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.687696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.688194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.688634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.689398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.689845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.690269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.732100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:24.732597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:24.733077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:24.733584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lazy-loading 'fault' on Instance uuid 851b3412-f951-4815-90a0-d3f056cb238e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:24.787640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13a042477b4308a37f825130e309d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7ee89de494792bc07413ccdc24147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:24.798896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c83495ea-9ae5-47c6-a17f-f6bd9813546b tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 200 len: 1313 microversion: 2.1 time: 0.142667 Sep 23 03:43:24.799724 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 639/1356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:24 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:24.996801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:25.008500 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a8c96a7-fc4a-4569-a103-5c14cff1d222 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.336831 Sep 23 03:43:25.009609 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 718/1357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:24 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:25.183502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6405b2f6-8cd2-4099-9f33-a95d4e8baa92"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:25.186177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:25.193391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.193976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.194912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.196347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.197025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.197602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.326067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:25.588200 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7709037a-57a7-4696-bb79-13de964e971e tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "POST /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408054 Sep 23 03:43:25.594253 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 640/1358] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:43:25 2022] POST /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:25.622933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "name": "network-vif-unplugged", "status": "completed", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:25.651799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:25.653050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:25.670927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.672992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.674421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:25.684787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.685774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.686384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.686940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.689460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.691095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.693743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.735598 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Creating event network-vif-unplugged:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h1-858495-2 Sep 23 03:43:25.763741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] Instance ce2fc494-7c63-438b-918d-9ab074149b40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:43:25.819664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1f2cce6b-5665-4c9a-972e-39235bfd43b4 req-81308a90-d70e-43f5-8e60-ee954176dbf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.328290 Sep 23 03:43:25.820566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 719/1359] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:25.828323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:25.830880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:25.848062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.849015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.854311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:25.859424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:25.860018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:25.860537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:26.183424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:26.214016 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81c4178b-df6d-402e-bb5d-18ca5fa66628 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1474 microversion: 2.1 time: 0.571525 Sep 23 03:43:26.217584 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 641/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:25 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1474 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:26.224028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:26.228503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] [instance: 851b3412-f951-4815-90a0-d3f056cb238e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:26.244210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:26.251704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:26.261679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:26.262530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:26.263810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:26.264875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:26.265662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:26.268040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:26.269845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:26.276181 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79d5c1e6-a10b-4fcb-ba2e-714aab2b927d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.454182 Sep 23 03:43:26.279414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 720/1361] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:25 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:26.285583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:26.287365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:26.308520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] HTTP exception thrown: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. Sep 23 03:43:26.310926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:26.311676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:26.312301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:26.314156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Request method failure captured: Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e HTTP/1.1 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLStDP0SU-WjTBsZkkmRT2bsX6Ijk1yvt29_qp550hWnwrqp8ghORqaUbFaMVPdWZZOSkTjjKU1o0OKlLIcfYeWXpp1OOE5L7TowUWQMaTyYRf1QWy40u8hputAe1a-Ht2IfTWI5mNJyeTqR07fKYaVbQx6SE1lxsqROzPHMhS1nYYHk Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 07c7ee89de494792bc07413ccdc24147 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:43:26.315339 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07c7ee89de494792bc07413ccdc24147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07c7ee89de494792bc07413ccdc24147"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 07c7ee89de494792bc07413ccdc24147 Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1421324806 Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiagnosticsNegativeTest-1421324806-project Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4a13a042477b4308a37f825130e309d8 Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1421324806-project Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. Sep 23 03:43:26.316909 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '851b3412-f951-4815-90a0-d3f056cb238e'} Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:26.317731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. Sep 23 03:43:26.318995 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:26.322797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:26.323467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:26.324451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] Returning 404 to user: Instance 851b3412-f951-4815-90a0-d3f056cb238e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:26.328958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0de447d-7b67-4bff-988b-ef85280f7cac tempest-ServerDiagnosticsNegativeTest-1421324806 tempest-ServerDiagnosticsNegativeTest-1421324806-project] 10.222.0.25 "GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e" status: 404 len: 111 microversion: 2.1 time: 0.109924 Sep 23 03:43:26.329966 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 642/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:26 2022] GET /compute/v2.1/servers/851b3412-f951-4815-90a0-d3f056cb238e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:26.790664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:26.807872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d94cfe86-83af-4cf0-8822-1af6d766992c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.526985 Sep 23 03:43:26.821400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 721/1363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:26 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:27.247407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:27.248502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:27.257636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.261017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.262448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.266597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.267276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.268567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.321048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:27.327535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:27.343051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.344156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.344976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.346033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.346713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.349462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.698528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:27.710521 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e399cbc-e601-4b89-8a36-d81f37f6bd78 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1474 microversion: 2.1 time: 0.469130 Sep 23 03:43:27.711104 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 643/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:27 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1474 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:27.721116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:27.743665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:27.748727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:27.751136 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65fa9d4a-589d-4c1e-9e52-f09b9ea74647 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.442266 Sep 23 03:43:27.752257 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 722/1365] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:27 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:27.835990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:27.836928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:27.859593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.861614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.862392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.863165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.863848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.864579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.891441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:27.930502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:27.931008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:27.931485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:27.972395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Creating event network-changed:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h1-858495-2 Sep 23 03:43:27.995326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] Instance ce2fc494-7c63-438b-918d-9ab074149b40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:43:28.020561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-186a054c-abb3-483b-a973-669078b10af9 req-9afbd140-789c-40d5-8479-8c558ac777ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133370 Sep 23 03:43:28.034078 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 723/1366] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:28.163656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:28.178123 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e3da64e-276d-4b21-8da4-e441e4dea689 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.348102 Sep 23 03:43:28.193974 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 644/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:27 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:28.736438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:28.738064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:28.752181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:28.752678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:28.753194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:28.760394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:28.762353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:28.762829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:28.779440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:28.780047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:28.791904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:28.793936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:28.794380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:28.795100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:28.795562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:28.795990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:29.464337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:29.476053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:29.477673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:29.479307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e08515cb-80a0-4581-bbf3-b4a5ac7582e7 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.703786 Sep 23 03:43:29.480577 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 645/1368] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:28 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:29.485669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:29.486518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:29.507423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:29.517937 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da55634d-183c-4af1-b8ad-811110241bef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1472 microversion: 2.1 time: 0.785856 Sep 23 03:43:29.518323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:29.519393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:29.520006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:29.532384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:29.532998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:29.533731 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 724/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:28 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1472 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:29.533890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:30.450637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:30.488005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9bdc6d7-3545-469c-aa09-2366ff43f0a8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 1.002383 Sep 23 03:43:30.488687 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 646/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:29 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:30.509818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:30.512613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:30.524898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:30.525724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:30.526450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:30.527444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:30.528498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:30.529184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:30.564359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:30.565063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:30.578382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:30.583902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:30.584947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:30.587207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:30.593739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:30.595966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.127040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.128281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.138925 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5f324160-7575-4fa4-9708-9ee8fce99507 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1469 microversion: 2.1 time: 0.578976 Sep 23 03:43:31.140230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.140711 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 647/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:30 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1469 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:31.142141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.143484 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-817abd22-7a6c-4a97-a93b-5e270b5a181b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.641275 Sep 23 03:43:31.153603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 725/1372] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:30 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:31.165751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:31.166416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:31.172979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.174257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.175857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.177909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.180481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.181123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.189552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:31.386177 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-471388d4-a0e4-4c7c-83e3-2a62c1151c3f tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "POST /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40/action" status: 202 len: 0 microversion: 2.1 time: 0.225035 Sep 23 03:43:31.387541 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 726/1373] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:43:31 2022] POST /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:43:31.425581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:31.425581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:31.436552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.436552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.436552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.436552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.437075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.437438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.570395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9df4e38-f8c7-432d-ba5a-45035364bb7e", "name": "network-vif-plugged", "status": "completed", "tag": "a2b8a2cf-6ae3-4524-bd52-400c49f5c494"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:31.593747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.594253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.594704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.614169 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] Creating event network-vif-plugged:a2b8a2cf-6ae3-4524-bd52-400c49f5c494 for instance a9df4e38-f8c7-432d-ba5a-45035364bb7e on n-h2-858495-2 Sep 23 03:43:31.622288 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-31a1208e-31b4-4f04-b044-cebd3cb84b71 req-c17ad009-4826-4f4b-8135-e0118c8d82b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477667 Sep 23 03:43:31.626768 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 648/1374] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:31.638336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:31.639817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:31.653569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.654613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.656018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.657162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:31.657890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:31.658771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:31.725856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.750482 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-64e2201d-7782-416f-904a-f68d93ab66c8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.358642 Sep 23 03:43:31.753083 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 727/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:31 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:31.954342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:31.965637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29781b76-e0c1-4bf5-a276-30b00a9ccee2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.332335 Sep 23 03:43:31.981191 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 649/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:31 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:32.188250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:32.189512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:32.199032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.199705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.200258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.201107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.201890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.202442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.502103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.517220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.519277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.521071 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67460c5e-a259-4739-af95-99b9c01b8d71 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.340703 Sep 23 03:43:32.522708 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 728/1377] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:32 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:32.585786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-940459284", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:32.651835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:32.652562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:32.653050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:32.653721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:32.654326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:32.665066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.665965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.666206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.667181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.667653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.668914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.690296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Getting quotas for project 2e4a0449c7b043fc9890906ccd51a550. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:43:32.693066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:32.695744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Getting quotas for user 352b37d7c729462ea9bc9a6689e9f4c5 and project 2e4a0449c7b043fc9890906ccd51a550. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:43:32.713671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:43:32.716117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:43:32.772648 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e571ce6-df35-40eb-b018-54df77ee6fbb tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.448111 Sep 23 03:43:32.773656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 650/1378] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:43:32.781062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:32.781726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:32.787587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:32.793882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:32.801749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.802340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.802780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.816732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.816732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.817518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.893074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.904529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.906028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:32.916081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3837ac8d-5028-4b3f-acdb-48cdcab9ebea tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "PUT /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1358 microversion: 2.75 time: 0.132582 Sep 23 03:43:32.932855 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 651/1379] 10.222.0.25 () {62 vars in 1297 bytes} [Fri Sep 23 03:43:32 2022] PUT /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:32.942240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:32.942886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:32.970347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.970864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.971319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:32.975646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:32.976931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:32.977506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.109841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.119075 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1a1b7c6-1d73-43e5-8318-b986ab6cbd9c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.347153 Sep 23 03:43:33.119695 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 729/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:32 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:33.126080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:33.127992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:33.212037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.224257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40da7893-204e-416b-a679-74d4bb6e7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1812 microversion: 2.1 time: 0.290126 Sep 23 03:43:33.226262 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 652/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:32 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1812 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:33.231910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:33.232863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.233042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:33.235134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.240134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.242661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.243363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.244412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.245102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.245844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.247417 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65420206-1081-4ac6-b650-cc3599c16a5d tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1358 microversion: 2.75 time: 0.126271 Sep 23 03:43:33.248577 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 730/1382] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:33 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1358 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:33.259043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:33.264018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.264739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.265488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.266517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.267250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.267896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.319642 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76d68d62-843c-4bac-92d4-1f05a73b34cb tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064833 Sep 23 03:43:33.320645 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 731/1383] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:43:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:33.500098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.512729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53af5cc1-a93a-4962-9bbb-3c2266536496 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1317 microversion: 2.1 time: 0.283557 Sep 23 03:43:33.513858 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 653/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:33 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:33.559460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:33.560385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:33.582260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.583012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.583778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.585231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:33.585745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:33.586193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:33.869655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.880904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.883136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:33.884385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adc6cc12-77ef-462b-9eb8-c8fcf2a9ca2d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.329603 Sep 23 03:43:33.884954 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 732/1385] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:33 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:34.173280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:34.177295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:34.198014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.199081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.200417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.204987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.205818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.206501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.285149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:34.286092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:34.299884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.300925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.306712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.317958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.319316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.319956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.579545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:34.583448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:34.589596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-286278b5-4fa1-4d4b-9892-ae4a0f7df102 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.445592 Sep 23 03:43:34.591446 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 654/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:34 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:34.595959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:34.597427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:34.603900 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e96fd99-e8a9-4b91-b58b-7dbff12ffbd1 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1410 microversion: 2.75 time: 0.324450 Sep 23 03:43:34.605017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 733/1387] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:34 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1410 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:34.638276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:34.641600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:34.661803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.664964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.667042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.670190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.672172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.673026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.912499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:34.913145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:34.922671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.925740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.926403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.930108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:34.932159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:34.932782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:34.991611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.016530 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0610cd06-868b-4b14-9031-62c89391ac28 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1466 microversion: 2.1 time: 0.421685 Sep 23 03:43:35.043122 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 655/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:34 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:35.061323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:35.062489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:35.082680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.083472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.084879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.090029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.092636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.097250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.412418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.422894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.424734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.426101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f5ecb93-92f4-44be-ab52-690c363e858c tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.518668 Sep 23 03:43:35.426945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 734/1389] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:34 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:35.438776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-891c7095-2102-49b2-989d-3d3266b68bea tempest-ServersOnMultiNodesTest-1668612115 tempest-ServersOnMultiNodesTest-1668612115-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1617 microversion: 2.1 time: 0.388166 Sep 23 03:43:35.438776 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 656/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:35 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1617 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:35.464326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:35.467277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:35.475952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.476660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.477275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.480543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.481586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.482208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.524241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:35.590863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:35.627831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:35.628575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:35.638808 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1cd51c46-6a57-41b9-84fb-c80522f9448e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 204 len: 0 microversion: 2.1 time: 0.178523 Sep 23 03:43:35.640113 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 657/1391] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:35 2022] DELETE /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:35.649968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:35.650945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:35.656876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.657398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.657859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.659180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.659972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.660302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.660983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.661969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.662870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.664014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.666610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.668118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.862492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.874161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.875821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.897203 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6820079b-b9a1-49be-be60-a63217e0fb02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1416 microversion: 2.75 time: 0.255392 Sep 23 03:43:35.899026 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 658/1392] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:35 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1416 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:35.906795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:35.907679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:35.915877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.916573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.917103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.918118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:35.918971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:35.921808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:35.967335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:35.979475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6ff652d-f43d-4350-8de0-910ac5c85315 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.367368 Sep 23 03:43:35.993875 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 735/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:35 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:36.085006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fa3d534-f0e6-4a00-b5b4-4b36933d1f77", "device": "/dev/xvdb"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:36.087944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:36.095741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.096236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.097007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.097474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.097911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.098342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.117479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:36.127508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ca5a6d7-dfdc-48ad-90fa-72cdc6932890 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1472 microversion: 2.1 time: 0.227191 Sep 23 03:43:36.129395 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 659/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:35 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:36.455121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:36.455889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:36.465988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.465988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.465988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.465988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.466811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.467458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.748808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:36.764659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:36.767516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:36.768724 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-912a565f-f566-48e8-a0d1-22184e3748b3 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.318709 Sep 23 03:43:36.782159 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 660/1395] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:36 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:36.794903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "8694753c-ec94-4daf-8e5b-c6457d45d229"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:36.805684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.806277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.806813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.820676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] Creating event network-vif-plugged:8694753c-ec94-4daf-8e5b-c6457d45d229 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:36.826608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8c25c04d-1852-401e-96f4-c82a6444d498 req-928b4c53-81be-4117-821a-4a89a1b7a9f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Sep 23 03:43:36.827798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 661/1396] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:36.955332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:36.957126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:36.967595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.968462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.969147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:36.970283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:36.970989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:36.971645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.116395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:37.129108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:37.133308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:37.160820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c3940f00-0085-46b1-be8b-884f5bb16e44 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1416 microversion: 2.75 time: 0.206461 Sep 23 03:43:37.161731 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 662/1397] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:36 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1416 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:37.170326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:37.177092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:37.192784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.194872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.195709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.196636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.198037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.201681 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7247377-21a2-4fbf-910f-492707820ee7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.120868 Sep 23 03:43:37.202435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 736/1398] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:43:36 2022] POST /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:37.203570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.230436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:37.231154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:37.249874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.250721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.251811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.255712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.257130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.257921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.614799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:37.625665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ad904ea-4c85-4b86-80dd-a501d9ce9807 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1472 microversion: 2.1 time: 0.422042 Sep 23 03:43:37.629810 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 737/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:37 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1472 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:37.661850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:37.676423 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e0ff13f-205c-4511-88f2-bd34b28d010c tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.512740 Sep 23 03:43:37.707769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 663/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:37 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:37.801857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:37.802544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:37.812049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.813003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.813654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:37.814868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:37.815950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:37.817040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.201730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:38.203041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:38.214058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.214969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.215731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.217088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.218081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.218875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.283329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.300079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.304254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.307144 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3a11ddd-76ee-4adc-839c-c0f61af00c59 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.510057 Sep 23 03:43:38.309461 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 738/1401] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:37 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:38.344686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.363832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.366205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.387050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ded9371a-065b-41d1-8f2a-f6f6d5c3608e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1416 microversion: 2.75 time: 0.191324 Sep 23 03:43:38.388285 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 664/1402] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:38 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1416 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:38.582557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:38.598373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.599188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.600058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.619804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Creating event network-changed:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h2-858495-2 Sep 23 03:43:38.627057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] Instance ce2fc494-7c63-438b-918d-9ab074149b40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 03:43:38.641000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-df807d2b-3853-4b16-a66e-b0aaa5dc5a26 req-e7db745a-aa0b-4bd6-a433-a5aa14224a98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183228 Sep 23 03:43:38.642151 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 739/1403] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:38.657173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:38.658361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:38.666412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.667605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.668236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.669008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.669513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.669956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.735019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:38.738524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:38.755102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.757024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.757497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.758453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.760016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.760687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:38.910826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:38.936463 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7fe5ebbe-dcb5-41f0-bd4c-bbf9179ea1e1 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1472 microversion: 2.1 time: 0.284766 Sep 23 03:43:38.938913 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 665/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:38 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:38.961343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "88d28e56-054a-4607-9395-9c4ece17b2b1"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "970b186d-c284-4ec2-8027-c9877ffd29a2"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "275db122-e490-4cee-bc28-544f7af60b07"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "8bd7259d-b43a-4662-9c32-fb99612627dd"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:38.982135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:38.983954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:38.984743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.007108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.013147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Creating event network-vif-plugged:88d28e56-054a-4607-9395-9c4ece17b2b1 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:39.014287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Creating event network-vif-plugged:a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:39.015376 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Creating event network-vif-plugged:970b186d-c284-4ec2-8027-c9877ffd29a2 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:39.018983 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-400719e1-4deb-45fc-9eb2-7f2c2ed1af6a tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.299888 Sep 23 03:43:39.019324 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Creating event network-vif-plugged:275db122-e490-4cee-bc28-544f7af60b07 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:39.020873 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 740/1405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:38 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:39.027011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] Creating event network-vif-plugged:8bd7259d-b43a-4662-9c32-fb99612627dd for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:39.058691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ea7e2947-bfca-474a-8c52-2d556804e97d req-6614f1ed-4502-478b-a665-9defe62213c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.117744 Sep 23 03:43:39.059869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 666/1406] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:39.346542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:39.348666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:39.387599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.388663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.389571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.390880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.397212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.399212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.438538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:39.439554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:39.457905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.459573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.460609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.464564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.466573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.469761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.692586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.708894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.715185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.725982 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea18bf99-d14e-4087-8f7f-561f951604b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1416 microversion: 2.75 time: 0.291117 Sep 23 03:43:39.730342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 667/1407] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:39 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1416 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:39.833802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.836312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:39.847664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.849080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:39.851054 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d0bd8f1-b6cb-488f-865c-d9aff6c856c5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.512306 Sep 23 03:43:39.861806 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 741/1408] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:39 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:39.963421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:39.964065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:39.974102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.975725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.976552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:39.977612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:39.978325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:39.979329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.052805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:40.053468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:40.061932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.062754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.063387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.064295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.065927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.066568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.439751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:40.442891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:40.451861 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e4ff247-1175-4e94-83c3-d98c8655e350 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.404316 Sep 23 03:43:40.452608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb3e4048-51e8-4eb2-a7f9-5496af8b262f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1472 microversion: 2.1 time: 0.494326 Sep 23 03:43:40.453779 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 668/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:39 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:40.472456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 742/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:40 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:40.610825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dc20dd2e-2695-44c1-a203-5a2fb7cb4dec"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:40.614907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:40.624655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.625379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.625982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.626947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.627552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.628118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.775626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:40.776255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:40.790626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.791132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.791585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.792318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:40.792785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:40.793270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:40.947600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:40.959508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:40.961267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:40.967390 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5171576a-d5e7-4ac4-a7c8-55a4066b31ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1416 microversion: 2.75 time: 0.196359 Sep 23 03:43:40.982834 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 743/1411] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:40 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1416 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:40.998024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:40.998815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:41.008035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.008704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.009497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.010399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.011017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.011610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.036921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] HTTP exception thrown: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Request method failure captured: Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments/6405b2f6-8cd2-4099-9f33-a95d4e8baa92 HTTP/1.1 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 74 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSsNUcNb_4GJywK2kkjVYgdvv-jHtbThlnmUVlfaJUZuf_6KjYvzu33KVuxyEgN56wF-zVtcq_EuaV_sO5ix9etRQlCa2uKs8SGws1pjFGmEe_4s5eBXtWXi8rb7naI-nA1vB8lq3xM_ipTuFxM4dYzheVDtQnSxKiE7CezLY7BsanU Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ff1879025d2d4d7abf52ddedefa25b14 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 03:43:41.065245 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ff1879025d2d4d7abf52ddedefa25b14 Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesAdminNegativeTest-644505112-project-admin Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2c371dba86124d779568ae4476fcbf10 Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesAdminNegativeTest-644505112-project-admin Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: {"volumeAttachment": {"volumeId": "dc20dd2e-2695-44c1-a203-5a2fb7cb4dec"}} Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:43:41.067104 n-d-858495-2 devstack@n-api.service[128723]: exception: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '67627c3d-d16c-4926-a278-5d28cbaa59d8', 'id': '6405b2f6-8cd2-4099-9f33-a95d4e8baa92', 'body': {'volumeAttachment': {'volumeId': 'dc20dd2e-2695-44c1-a203-5a2fb7cb4dec'}}} Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 03:43:41.068169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. (HTTP 404) (Request-ID: req-0dd54d21-bb4d-4fe4-8bd6-1dfa89022eb7) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 03:43:41.069509 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:41.071029 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. Sep 23 03:43:41.072452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:41.074422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Returning 400 to user: Volume dc20dd2e-2695-44c1-a203-5a2fb7cb4dec could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:41.075585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-308510d2-9799-462e-a20c-cc07eb696eca tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments/6405b2f6-8cd2-4099-9f33-a95d4e8baa92" status: 400 len: 107 microversion: 2.1 time: 0.620059 Sep 23 03:43:41.079116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 669/1412] 10.222.0.25 () {60 vars in 1433 bytes} [Fri Sep 23 03:43:40 2022] PUT /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments/6405b2f6-8cd2-4099-9f33-a95d4e8baa92 => generated 107 bytes in 621 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:43:41.086306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-plugged", "status": "completed", "tag": "994c862a-05ad-4b51-a24d-e8ee09c442c8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:41.104659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.105968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.106635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.120118 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] Creating event network-vif-plugged:994c862a-05ad-4b51-a24d-e8ee09c442c8 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:41.127920 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4747adcf-8eea-4ce0-a1c8-8b89f32b510a req-75edc974-040e-4c88-890f-978ab9a27b5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046084 Sep 23 03:43:41.129073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 670/1413] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:41.180890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:41.184912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:41.213095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.215696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.216619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.217622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.218288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.218923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.344901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:41.362079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:41.368780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:41.371429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfde68a9-6ebf-4e01-ba5b-121e19538f46 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.386624 Sep 23 03:43:41.373043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 744/1414] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:40 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:41.480034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:41.484817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:41.508304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.509492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.510772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.524399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.525418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.529715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lazy-loading 'services' on Instance uuid 67627c3d-d16c-4926-a278-5d28cbaa59d8 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:41.530701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.776694 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a86dc341-37c3-425a-815e-ff73daa8bdd6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments/6405b2f6-8cd2-4099-9f33-a95d4e8baa92" status: 202 len: 0 microversion: 2.1 time: 0.600920 Sep 23 03:43:41.777294 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 671/1415] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 03:43:41 2022] DELETE /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments/6405b2f6-8cd2-4099-9f33-a95d4e8baa92 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:43:41.804977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:41.805840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:41.819055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.820220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.821119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:41.822599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:41.823317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:41.823998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.009912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.024750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34c05757-bdc7-4765-992a-2d572d2b0107 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1430 microversion: 2.1 time: 0.241580 Sep 23 03:43:42.028465 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 672/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:41 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1430 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:42.048578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:42.058341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:42.086517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.087209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.087680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.096295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.096931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.100321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.209021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-609ab33d-6d69-4e4b-be96-10669e507d4d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170541 Sep 23 03:43:42.210256 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 673/1417] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:42 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:42.216121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9df4e38-f8c7-432d-ba5a-45035364bb7e", "name": "network-vif-deleted", "tag": "a2b8a2cf-6ae3-4524-bd52-400c49f5c494"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:42.248035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.256706 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8c69acd-78c0-43fc-9624-fbe93161d543 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.784010 Sep 23 03:43:42.259015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.259967 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 745/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:41 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:42.260765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.261868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.285802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:42.286882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:42.309342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.310350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.311736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] Creating event network-vif-deleted:a2b8a2cf-6ae3-4524-bd52-400c49f5c494 for instance a9df4e38-f8c7-432d-ba5a-45035364bb7e on n-h2-858495-2 Sep 23 03:43:42.312794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.317091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.319725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.320530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.329559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6d0a744c-39cb-4410-988e-59a75a711f8b req-4cc1b08e-6442-4996-bc9c-8a54a8c1ff6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117356 Sep 23 03:43:42.333443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 674/1419] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:42.412124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:42.413226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:42.434430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.435211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.435897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.437028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.437787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.438532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.522185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.539416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.545649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.555195 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04f67105-b4f7-4cad-9e78-26f6b946ed88 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1437 microversion: 2.75 time: 0.292328 Sep 23 03:43:42.556438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 746/1420] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:42 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1437 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:42.597987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:42.617597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:42.675602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.676836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:42.681399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.681985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.683266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.689832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.690872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.888634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:42.889654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:42.890324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:42.891086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:42.893167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:42.899740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:42.916820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.944345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.946286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:42.947896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e041b542-f4e7-44c1-8e7b-3ad9ffe2252a tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1874 microversion: 2.32 time: 0.546626 Sep 23 03:43:42.968695 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 675/1421] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:42 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1874 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:42.978801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:42.997902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.997902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.997902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:42.997902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:42.998285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:42.998285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.053596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:43.054386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:43.067323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.072330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.072926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.074239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.075139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.077774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.092565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.113129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.123181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.128988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:43.135900 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c51b005-599f-4793-897e-9faabfa0fe1c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "POST /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b/action" status: 202 len: 1494 microversion: 2.75 time: 0.543091 Sep 23 03:43:43.151668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 747/1422] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:43:42 2022] POST /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b/action => generated 1494 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 23 03:43:43.161856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.166273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.167111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.167616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid a9df4e38-f8c7-432d-ba5a-45035364bb7e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:43.169520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:43.172618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:43.210816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.211316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.211763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.212483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.212945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.213397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.230005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.239957 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3b34979-962f-4668-a5e9-fe6984187153 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1307 microversion: 2.1 time: 0.191889 Sep 23 03:43:43.241245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:43.242059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 676/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:43 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:43.266842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:43.269434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:43.295185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:43.315766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.316008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.316485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.317227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.319207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.324787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.325892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.327415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.329761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.339420 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c2cc00c-cbbd-4abb-9159-b593c81a74a2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.175228 Sep 23 03:43:43.346042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 748/1424] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:43 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:43.352485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:43.366379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:43.373307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.374069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.374674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.375585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.376193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.376781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.378971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbd194a3-786d-4eda-aafc-c4d5a784bdb7 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125577 Sep 23 03:43:43.381574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 677/1425] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:43 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:43.595202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:43.604470 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86a2ce7d-b5f9-4257-acb0-c4068a990eeb tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.256873 Sep 23 03:43:43.605547 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 749/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:43 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:43.977733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:43.978504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:43.987426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.988104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.988643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:43.989600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:43.990719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:43.991261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.249238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.261957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.263571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.264928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a67a04f6-3fd2-476f-84d7-43bb48d4cf62 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2829 microversion: 2.32 time: 0.292054 Sep 23 03:43:44.265492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 678/1427] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:43 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2829 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:44.276326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:44.277793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:44.289090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.298816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:44.301147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.303712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:44.306711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.308239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.308895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.309621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.325875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.326589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.327441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.328447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.329065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.329779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.387230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.388130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.388776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.389248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid a9df4e38-f8c7-432d-ba5a-45035364bb7e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:44.552432 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00d28535-9b20-4f74-898d-60933455ef2b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.261144 Sep 23 03:43:44.553229 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 679/1428] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 03:43:44 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b/os-interface => generated 1833 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:44.575999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.580449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:44.581071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:44.587811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9932c7e7-c8e1-46ce-8db4-6953f6e3a921 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1307 microversion: 2.1 time: 0.317931 Sep 23 03:43:44.588702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.589205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.589679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.590407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.590872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.591306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.595148 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 750/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:44 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:44.608234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:44.610610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:44.632726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.633237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.633718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.634524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.634989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.635419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.693061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ea74a0a-5abe-40fa-9eec-0526c7eb68d8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096709 Sep 23 03:43:44.698259 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 751/1430] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:44 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:44.703882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:44.704090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:44.711468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.711964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.712707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.713486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:44.713969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:44.714390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:44.728827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.742284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.743735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.759767 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ebad862-0f6d-45c9-bf62-d3f6e8c9e086 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.184901 Sep 23 03:43:44.760939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 680/1431] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:44 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:44.931597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:44.941621 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a2e8569c-152f-4e9a-9b64-2da1755ff827 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.241730 Sep 23 03:43:44.942532 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 752/1432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:44 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:45.618555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:45.619793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:45.628331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.629247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.629732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.630492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.631525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.632161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.667331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.668092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.668701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.669643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid a9df4e38-f8c7-432d-ba5a-45035364bb7e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:45.704900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:45.708018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:45.715599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.716569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.717180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.718127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.718910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.719513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.724792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:45.736883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ac0b3b5-c3b2-428a-bbd5-401dc8815deb tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1307 microversion: 2.1 time: 0.123045 Sep 23 03:43:45.753394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 681/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:45 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:45.754736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-733917b0-55e8-4e1c-8434-49c026dd8e9d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053852 Sep 23 03:43:45.755880 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 753/1434] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:45 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:45.796453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:45.801433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:45.805977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:45.810462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.811171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.811806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.812762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.813525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.814553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.894459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:45.908330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:45.910155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:45.916498 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d18bbef-18a7-482e-911e-b0446dad8eda tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.131843 Sep 23 03:43:45.917464 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 682/1435] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:45 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:45.966322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:45.966851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:45.973411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.973915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.974889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:45.975610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:45.976636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:45.976636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.145850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "tag": "970b186d-c284-4ec2-8027-c9877ffd29a2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:46.168862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.170156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.170822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.187384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:46.187797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] Creating event network-changed:970b186d-c284-4ec2-8027-c9877ffd29a2 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:43:46.194599 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d4fda1dc-852b-4a81-86ad-6fb004fe0bf7 req-1c5a3d84-6eeb-451f-bfd5-0c114bfbc96e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054137 Sep 23 03:43:46.196062 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 683/1436] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:46.203300 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e74e901a-ebc9-4f29-8b0d-d8ecd446fdcd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.240844 Sep 23 03:43:46.204295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 754/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:45 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:46.771449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:46.772262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:46.772899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:46.776401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:46.781250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.787722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.788927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.789537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.790194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.790837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.791463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.791809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.792299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.792688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.792812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.793590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.837260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44aa0b41-1954-49ad-be8d-99c3663a869b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071778 Sep 23 03:43:46.838871 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 684/1438] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:46 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:46.858301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:46.860437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.861146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.861800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.862527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid a9df4e38-f8c7-432d-ba5a-45035364bb7e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:46.870188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:46.923379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:46.940912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-509128ae-d5ed-4dca-9aba-b0ab20c4103c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 200 len: 1307 microversion: 2.1 time: 0.172707 Sep 23 03:43:46.941752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 755/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:46 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:46.951034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:46.951931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:46.975851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.977554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.978193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:46.981511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:46.982195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:46.983495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.235429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:47.236467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:47.237301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:47.247378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.249237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.250251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.256551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.257055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.257552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.283617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:47.286053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:47.312418 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3c0ba82-b2cd-4319-9274-b1b82fae8b02 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.362432 Sep 23 03:43:47.315447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 685/1440] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:46 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:47.661478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:47.681738 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dfa9c4d6-2871-45ce-ad6c-800e53da4f45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1468 microversion: 2.1 time: 0.448177 Sep 23 03:43:47.682364 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 756/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:47 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:47.852648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:47.855155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:47.868422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.869441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.870463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.872075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.872879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.873899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.936120 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-908d81f6-f1e8-41b7-a8fb-715898f04404 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089272 Sep 23 03:43:47.936747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 686/1442] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:47 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:47.969411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:47.970349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a9df4e38-f8c7-432d-ba5a-45035364bb7e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:47.977283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.977902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.978341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:47.979055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:47.979707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:47.980142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.000611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e HTTP/1.1 Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:43:48.003382 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. Sep 23 03:43:48.004894 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a9df4e38-f8c7-432d-ba5a-45035364bb7e'} Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:48.006967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. Sep 23 03:43:48.008538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:48.009912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance a9df4e38-f8c7-432d-ba5a-45035364bb7e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:48.009912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d6ff5f8-5559-4ff5-87b1-7c35f0a8d34e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e" status: 404 len: 111 microversion: 2.1 time: 0.040616 Sep 23 03:43:48.010494 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 757/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:47 2022] GET /compute/v2.1/servers/a9df4e38-f8c7-432d-ba5a-45035364bb7e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:48.015909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.016657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.024216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.024719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.025160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.025914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.026382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.026816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.056045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:48.147165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6514262-fd25-4535-8e2a-82c1e8eca673 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 204 len: 0 microversion: 2.1 time: 0.135188 Sep 23 03:43:48.148052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 687/1444] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:48 2022] DELETE /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:43:48.161396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.163193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.179705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.180989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.181639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.182579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.183196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.183990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.344798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.345855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.354183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.354950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.355558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.356508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.357135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.357771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.608905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.620128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.620128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.627422 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a9ee4a1-c81e-45a4-9114-7c55a3e56ba5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.287434 Sep 23 03:43:48.628260 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 688/1445] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:48 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:48.672192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.680523 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8dadced-80c2-49c2-8a7e-8f7b555f643a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1471 microversion: 2.1 time: 0.526201 Sep 23 03:43:48.681123 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 758/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:48 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:48.712717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.713699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.722035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.722850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.723439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.724385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.725134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.725606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.904576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.914556 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2162d75e-3613-4d35-86a4-5aaf231e5055 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1461 microversion: 2.1 time: 0.208338 Sep 23 03:43:48.915347 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 689/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:48 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1461 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:48.948631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.949452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.955906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.956135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.956412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.956857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.957596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.958069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.958572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.959946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:48.972265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.973103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.973853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:48.975084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:48.975853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:48.976510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.038106 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90185dab-5ca0-4f39-ad53-8daaf86a4e1d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089243 Sep 23 03:43:49.039034 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 690/1448] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:48 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:49.110268 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7fd39597-52ee-4215-a7f8-00ec775dcb81 tempest-MigrationsAdminTest-391605065 tempest-MigrationsAdminTest-391605065-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1612 microversion: 2.1 time: 0.165339 Sep 23 03:43:49.110930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 759/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:48 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1612 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:49.143136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:49.143639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:49.150360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.150952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.151500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.152286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.152823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.153510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.182469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:49.185778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:49.270100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c37440ee-3c37-4b22-8d6b-e278a56bf34e tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 204 len: 0 microversion: 2.1 time: 0.129850 Sep 23 03:43:49.270993 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 691/1450] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:49 2022] DELETE /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:49.279774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:49.280394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:49.287040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.287529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.288009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.288673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.289124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.289593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.434373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.442424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c2546228-10a3-4f8d-8d7d-3a92086b8a84 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1467 microversion: 2.1 time: 0.166950 Sep 23 03:43:49.443000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 760/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:49 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:49.656687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:49.657478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:49.664673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.665249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.665725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.666445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.666911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.667439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.706443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:49.707155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:49.713746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.714305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.714913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.715701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:49.716227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:49.716725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:49.740699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.749278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.750872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.757860 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b13cd58-5244-4ff9-a9ae-d5f959243065 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.104184 Sep 23 03:43:49.768021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 692/1452] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:49 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:49.876595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.884933 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c505f318-c965-4ff6-a775-2757e2581af5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1471 microversion: 2.1 time: 0.182212 Sep 23 03:43:49.889410 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 761/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:49 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:50.054954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:50.058820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:50.065668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.066307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.066804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.067527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.068294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.068730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.108437 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0cc7813b-a79e-4181-b98d-6c27ee949732 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060524 Sep 23 03:43:50.114241 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 693/1454] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:50 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:50.142526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "name": "network-vif-plugged", "status": "completed", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:50.161280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.161280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.161280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.184952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] Creating event network-vif-plugged:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h2-858495-2 Sep 23 03:43:50.194935 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72a2b8b3-3911-46ad-8fab-f6d2879de8fb req-67404195-9171-45b7-b213-4b39317028d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057623 Sep 23 03:43:50.196456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 762/1455] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:50.347695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32786389-4406-4643-b442-671703947f73", "name": "network-vif-deleted", "tag": "0d52b494-5feb-4a3a-ab56-293fdeb3e58f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:50.361647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.362527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.363259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.379408 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] Creating event network-vif-deleted:0d52b494-5feb-4a3a-ab56-293fdeb3e58f for instance 32786389-4406-4643-b442-671703947f73 on n-h1-858495-2 Sep 23 03:43:50.386629 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5e1a15ab-7b43-4e47-b434-a8db88eb2a86 req-7074bff7-e2fd-4d9c-9953-63dd8deca5bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046348 Sep 23 03:43:50.388210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 694/1456] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:50.484738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:50.486014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:50.503621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.504128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.506363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.506482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.506931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.507407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.661148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-699235735", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6f121f7c-6b72-46a2-9bbd-ba5658c47c71"}], "block_device_mapping_v2": [{"uuid": "dec73c64-8b73-498b-bca7-12b0149fad3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:50.799819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:50.814422 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a2c5da4-c95d-4dc0-9352-a324d377c2cf tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1467 microversion: 2.1 time: 0.346584 Sep 23 03:43:50.816073 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 763/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:50 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1467 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:50.835604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:50.836378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:50.853393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.853970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.854972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.856691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:50.857173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:50.857971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:50.983947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:50.998901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:51.001139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:51.016420 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-492a257a-13e9-4562-8cc0-217e02708773 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.198618 Sep 23 03:43:51.017566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 764/1458] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:50 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:51.025028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:51.025906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:51.034316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:51.035104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:51.035755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:51.036878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:51.037912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:51.038714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:51.079335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:51.080030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:51.080484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:51.080948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 32786389-4406-4643-b442-671703947f73 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:51.139139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:51.158534 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2cdc9bef-ae5f-43ff-8c55-080da79bcb75 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 200 len: 1306 microversion: 2.1 time: 0.137780 Sep 23 03:43:51.159395 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 765/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:51 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 1306 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:51.165780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:51.168125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:51.171055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] validate_networks() for [('6f121f7c-6b72-46a2-9bbd-ba5658c47c71', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:43:51.176797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:51.177334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:51.177805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:51.178517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:51.180444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:51.194020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:51.263827 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf462310-f4a7-418d-9e03-e3195e3e1ad5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102444 Sep 23 03:43:51.288266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 766/1460] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:43:51 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:43:51.632815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-593697778", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "756a5d72-5a39-4d3e-a912-e848e0dd3121"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:51.726583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] validate_networks() for [('756a5d72-5a39-4d3e-a912-e848e0dd3121', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:43:52.434666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:52.435251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:52.436705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:52.437174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:52.437636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:52.449203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.449956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.450593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.451522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.452192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.452629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.476739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:43:52.480971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Getting quotas for user 9855cf6129a34302a7e3e39d6a15a345 and project 28c366e7ad9146d09218783c948d17db. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:43:52.558773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:43:52.561310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dec73c64-8b73-498b-bca7-12b0149fad3a',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:43:52.733556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:43:52.734624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:43:52.735359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:43:52.735947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:43:52.736527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:43:52.758897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.759944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.760680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.762222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.762994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.764661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.789787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:43:52.798056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Getting quotas for user 0fc453bb00e54809ba847f3006c8aba2 and project 61037b48d36f46b48a8fb87dec8eeec0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:43:52.820008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:43:52.823675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:43:52.870655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-208ade64-821b-4236-92fb-47f4acafc4be tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.399787 Sep 23 03:43:52.871401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 695/1461] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 03:43:52.887936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:52.888584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:52.909410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.909890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.910328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.911052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.911591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.912211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.941472 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cbde551f-c465-496a-b725-34f1fc9c07f9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310951 Sep 23 03:43:52.955253 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 767/1462] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:43:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:43:52.961655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:52.976696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:52.977428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.977959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.978409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.981030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lazy-loading 'fault' on Instance uuid ce2fc494-7c63-438b-918d-9ab074149b40 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:52.991197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.991788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.992461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:52.994511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:52.995188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:52.995994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.067502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.078191 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e845383-7e9e-4193-9345-f3e6ca0f42a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 200 len: 1302 microversion: 2.1 time: 0.194109 Sep 23 03:43:53.080794 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 696/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:52 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:53.093083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:53.096403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 32786389-4406-4643-b442-671703947f73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.106402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.106750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.107789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.108770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.109830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.110711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.137877 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance 32786389-4406-4643-b442-671703947f73 could not be found. Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 HTTP/1.1 Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:43:53.141947 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 32786389-4406-4643-b442-671703947f73 could not be found. Sep 23 03:43:53.143315 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '32786389-4406-4643-b442-671703947f73'} Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32786389-4406-4643-b442-671703947f73 could not be found. Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:53.144453 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32786389-4406-4643-b442-671703947f73 could not be found. Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32786389-4406-4643-b442-671703947f73 could not be found. Sep 23 03:43:53.147040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:43:53.149003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.150036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance 32786389-4406-4643-b442-671703947f73 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:53.151065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77b649f1-0bec-4399-8a1b-643d66246547 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73" status: 404 len: 111 microversion: 2.1 time: 0.066117 Sep 23 03:43:53.151819 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 697/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:53 2022] GET /compute/v2.1/servers/32786389-4406-4643-b442-671703947f73 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:53.159528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2fc494-7c63-438b-918d-9ab074149b40", "name": "network-vif-deleted", "tag": "69c2dcc0-df8d-469a-9805-deb69c6b287b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:53.164920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.167338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.187791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.188501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.189104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.198838 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-85917955-6b4e-4524-abba-f7d2851dbbf6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.241075 Sep 23 03:43:53.212459 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 768/1465] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:52 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:53.212459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:53.212459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.227563 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] Creating event network-vif-deleted:69c2dcc0-df8d-469a-9805-deb69c6b287b for instance ce2fc494-7c63-438b-918d-9ab074149b40 on n-h2-858495-2 Sep 23 03:43:53.232856 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1124676d-51d2-4836-8db6-3adfdc21f21f req-1f34a162-b82c-42b6-be5c-c3e857c8ed6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079595 Sep 23 03:43:53.233650 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 698/1466] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:53.239118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40190e30-55c5-4bab-b65b-3046c9a87927 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:53.240393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40190e30-55c5-4bab-b65b-3046c9a87927 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.357287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.370127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.375943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.382945 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-120093a3-e7be-4353-9c7e-bcc148684754 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1103 microversion: 2.25 time: 0.176315 Sep 23 03:43:53.401231 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 769/1467] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:53 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1103 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:53.413976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:53.414493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.426393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-40190e30-55c5-4bab-b65b-3046c9a87927 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.435751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40190e30-55c5-4bab-b65b-3046c9a87927 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1217 microversion: 2.1 time: 0.200804 Sep 23 03:43:53.436610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.438320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 699/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:53 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:53.440183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.441803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.444143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5aab34-4454-421e-ab2b-fd82c9e0d67a"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:53.444990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.447117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.448624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.450953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.455196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.463815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.464039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.467451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.468133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.470057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.506221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:53.622349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-230f37f9-bc56-48e5-a809-e981de3ad645 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 204 len: 0 microversion: 2.1 time: 0.235239 Sep 23 03:43:53.623107 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 770/1469] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:53 2022] DELETE /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:53.632038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:53.632735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:53.639323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.639902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.640355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.641715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:53.642383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:53.642836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:53.783632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:53.792635 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-610d88b8-1612-4a8a-b1f5-6d6a5ada529f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1472 microversion: 2.1 time: 0.165110 Sep 23 03:43:53.793227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 771/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:53 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:54.097660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-855818b0-c167-4911-853c-c69d644a28db tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "POST /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657848 Sep 23 03:43:54.098345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 700/1471] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:43:53 2022] POST /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:54.104672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.105290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: ce2fc494-7c63-438b-918d-9ab074149b40] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.113983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.114697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.115310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.116113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.118128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.119361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.135749 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] HTTP exception thrown: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Request method failure captured: Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 HTTP/1.1 Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSot_q0GJbl0xD6NZD2twbSNFL2Dxb1pirBP0R88RL3F9uybKl16rBFL2wPhCOb2jlsKnX1GDW8wWHiEGbAe8yVOvQd6Bwlf47Djb4tpeCTq_ICvNh75lB0DrSDPupoPg4xu5jzTEQbkgPhnfsY37rd-7otExzsu0fBe4NpdU1Apt3U Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:43:54.137431 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-MigrationsAdminTest-1963408465 Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 281de6c3e01748f5a0fa1f0c75bd477f Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. Sep 23 03:43:54.139104 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'ce2fc494-7c63-438b-918d-9ab074149b40'} Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:54.139886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. Sep 23 03:43:54.141175 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:54.142950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Returning 404 to user: Instance ce2fc494-7c63-438b-918d-9ab074149b40 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:54.142950 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d55a559-97e2-4c3b-9aca-1823595aca83 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40" status: 404 len: 111 microversion: 2.1 time: 0.038622 Sep 23 03:43:54.142950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 772/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/ce2fc494-7c63-438b-918d-9ab074149b40 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:54.151587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.152176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.162155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.162721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.163169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.163886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.164377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.164810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.191047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:54.229675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.230529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.246791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.249801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.250410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.251362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.252158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.252783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.285033 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d3b75b3d-8407-46d2-8b35-5091b5fab872 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 204 len: 0 microversion: 2.1 time: 0.140131 Sep 23 03:43:54.285666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 701/1473] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:54 2022] DELETE /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:54.294000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.294715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.301196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.302710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.303159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.303890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.304359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.304799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.356442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.360376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:54.367593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.369046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.377677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cdb20cf4-f7aa-4060-93ed-337b3b4354b8 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.151716 Sep 23 03:43:54.378269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 773/1474] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:54.409139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.409793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.416798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.417319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.417795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.419095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.419690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.420404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.480905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.489154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-200f491f-5d47-4c68-b61b-b17fa740d2b4 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1535 microversion: 2.1 time: 0.199067 Sep 23 03:43:54.490547 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 702/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1535 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:54.495861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.496823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.497908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.504092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.504853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.506129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.506924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.507484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.507990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.510983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.513182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.514364 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ab2be76-c8ec-4c3d-a8cd-a4cd058a289d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1232 microversion: 2.25 time: 0.110248 Sep 23 03:43:54.515113 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 774/1476] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1232 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:43:54.573018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.581465 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b4ccda62-7275-4797-9ebf-d54e54d0fca9 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1213 microversion: 2.1 time: 0.089551 Sep 23 03:43:54.582075 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 703/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:54.816007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:54.816784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:54.824290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.824859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.825465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.826310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:54.826992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:54.827714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:54.969612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:54.977736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90b0eecb-531f-4023-b453-754ba6191b89 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1472 microversion: 2.1 time: 0.165559 Sep 23 03:43:54.978335 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 775/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:54 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:55.406264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.407831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:55.416241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.418071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.419032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.420597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.421777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.422909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.501689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.513421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.515394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.516102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:55.516636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.522919 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d03cc95-2f2b-42d1-9ca8-3c9a33e28c5c tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.121650 Sep 23 03:43:55.524254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 704/1479] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:55 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:55.524741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.525239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.525759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.526473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.526930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.527359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.543062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.544122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:55.553771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.554628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.555335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.556520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.558033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.560751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.705773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.716189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.720281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.726381 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2642ed40-c5f9-4b49-b61f-54f2a2287dc2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1232 microversion: 2.25 time: 0.187258 Sep 23 03:43:55.727407 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 705/1480] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:55 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1232 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:55.736950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.740236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:55.743230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.752003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a00bd94a-192d-4798-9924-7e5fb90dabf7 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1535 microversion: 2.1 time: 0.242165 Sep 23 03:43:55.757817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.758778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.760500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.761507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.763334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.764944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.766037 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 776/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:55 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1535 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:55.801102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14ba8cd-1be2-461b-b588-d97cc518cefa", "name": "network-vif-deleted", "tag": "137b2e78-7ecf-4a50-838a-bffc85ba5bb9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:55.812743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:55.813658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:55.814534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:55.835681 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] Creating event network-vif-deleted:137b2e78-7ecf-4a50-838a-bffc85ba5bb9 for instance a14ba8cd-1be2-461b-b588-d97cc518cefa on n-h1-858495-2 Sep 23 03:43:55.844597 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1f48238a-9b1b-4110-b750-5467592575b7 req-4320ce50-0c71-41f6-9414-42f5dc051d68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048300 Sep 23 03:43:55.846161 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 777/1482] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:43:55.921222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:55.933290 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c83fb6c3-f3be-4e1a-9cfd-50339b389842 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1213 microversion: 2.1 time: 0.204185 Sep 23 03:43:55.934437 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 706/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:55 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:56.010988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:56.015014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:56.032795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.040283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.040764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.043596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.044110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.044552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.145493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.152127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.154910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.156388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid a14ba8cd-1be2-461b-b588-d97cc518cefa {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:43:56.211739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.224765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d2ffe44-cd39-46e5-a6d1-9c22ae8fa966 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 200 len: 1307 microversion: 2.1 time: 0.225738 Sep 23 03:43:56.225436 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 778/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:55 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:56.559187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:56.559793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:56.566712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.567267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.567699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.568495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.568947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.569387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.574957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:56.639316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.648824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.650297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.655277 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81c882b4-b363-4caf-9bd4-2c9cbbd04dc2 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.100138 Sep 23 03:43:56.655849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 707/1485] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:56 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:56.756558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:56.757596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:56.763998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.764785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.765312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.766108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.766639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.767143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.779232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:56.780223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:56.789950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:56.794332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.797515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.798182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.799103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:56.801665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:56.802324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:56.950148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.966000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.969520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.970782 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7516ec93-1227-4de7-a056-a73a4f1151c0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1232 microversion: 2.25 time: 0.218696 Sep 23 03:43:56.974124 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 779/1486] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:56 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1232 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:56.985150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:56.985727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.000682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.001184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.006128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.010008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.010786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.011463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.152301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:57.178754 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2b73fa3e-6684-4074-af07-fa49c3187b65 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1269 microversion: 2.1 time: 0.202596 Sep 23 03:43:57.191554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 780/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:56 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:57.241004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:57.251680 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22bbed7a-d191-4049-a26f-dfde9e3b16a8 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1535 microversion: 2.1 time: 0.476922 Sep 23 03:43:57.258802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.259717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: a14ba8cd-1be2-461b-b588-d97cc518cefa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.268180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.270360 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 708/1488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:56 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1535 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:43:57.273632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.274421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.275051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.275515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.275952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.295213 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa HTTP/1.1 Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:43:57.297672 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. Sep 23 03:43:57.299099 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a14ba8cd-1be2-461b-b588-d97cc518cefa'} Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:43:57.299910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. Sep 23 03:43:57.301145 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:43:57.306308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance a14ba8cd-1be2-461b-b588-d97cc518cefa could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:43:57.309782 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73a3ff72-96f7-418a-879b-fa515d35848d tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa" status: 404 len: 111 microversion: 2.1 time: 0.062291 Sep 23 03:43:57.311571 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 781/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:57 2022] GET /compute/v2.1/servers/a14ba8cd-1be2-461b-b588-d97cc518cefa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:57.320252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.320908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.328270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.328966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.329635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.330464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.331040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.331581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.367835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:57.566883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe2b9e3a-e3dd-494a-9851-a354abe59665 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 204 len: 0 microversion: 2.1 time: 0.250563 Sep 23 03:43:57.570378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 709/1490] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:57 2022] DELETE /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:57.579505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.580131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.592649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.593151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.593723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.594658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.595409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.596239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.633522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:43:57.701172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.702362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.751486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.754212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.754663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.764188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.765429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.767610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.814273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0bab685-4334-41fc-883f-caaf566e2317 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 204 len: 0 microversion: 2.1 time: 0.238799 Sep 23 03:43:57.827530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 782/1491] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:43:57 2022] DELETE /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:57.833741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.834472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:57.856195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.856689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.857131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.857876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:57.858511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:57.860051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:57.919329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:57.973285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:57.984922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.018363 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c67d616-b1d8-418b-903d-099485a4672e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.333424 Sep 23 03:43:58.020426 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 710/1492] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:57 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:58.041019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372fff14-6ce6-4e8f-b272-13d0d8485b6d", "name": "network-vif-deleted", "tag": "ed2259ea-d36d-4512-9835-850585ad8073"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:58.074964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.077987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.080792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.121785 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] Creating event network-vif-deleted:ed2259ea-d36d-4512-9835-850585ad8073 for instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d on n-h2-858495-2 Sep 23 03:43:58.128974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-81750b5b-c26c-43a1-83b6-863eb56f069f req-5cbd2b28-ccfa-4572-92b0-0cb680ab37ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106120 Sep 23 03:43:58.130272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 711/1493] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:58.142403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:58.143317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:58.155324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.156532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.158322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.159667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.160773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.164147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.183567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.193114 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fbd3e88-d6ea-467e-987a-24cd610af67f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 200 len: 1475 microversion: 2.1 time: 0.363513 Sep 23 03:43:58.199229 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 783/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:57 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:58.212952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:58.213963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:58.231810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.237033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.237514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.238307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.238886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.239857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.311713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.323301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.330288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.331715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-594c1a74-eb5c-41cd-a06c-083375537bd0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1250 microversion: 2.25 time: 0.199569 Sep 23 03:43:58.346023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 712/1495] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:58 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1250 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:58.357970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:58.358659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:58.368395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.369196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.369743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.370741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:58.371294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:58.371801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:58.446945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.459448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e852b90-deaa-49b9-b7e3-41a1710faa51 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1277 microversion: 2.1 time: 0.258613 Sep 23 03:43:58.465177 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 784/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:58 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:58.542398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.553390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2edba5d1-1e05-49a9-8f7e-4ac5e33acb54 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1364 microversion: 2.1 time: 0.205903 Sep 23 03:43:58.554556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 713/1497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:58 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:59.051580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.053243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:59.061585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.062201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.062691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.063673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.064211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.064712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.143195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.153201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.154827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.160037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:43:59.162682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-739915d4-e510-489c-8a4f-aa7d3535d2c5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.116585 Sep 23 03:43:59.163896 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 785/1498] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:59 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:59.230645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.231296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:59.242022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.242931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.243394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.244462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.244937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.246601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.367499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.368799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:59.379001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.380031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.382705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.384328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.385999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.386707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.510203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.524325 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6914c44f-35f0-40f8-9a18-8842ce4d3bd6 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 200 len: 1475 microversion: 2.1 time: 0.299168 Sep 23 03:43:59.525096 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 714/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:59 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:59.537072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.540568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:59.554304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.554808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.555257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.562359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.562871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.564279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.612630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.627352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.630400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.632681 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06e86af3-c0a8-4203-b9ec-59a69081885f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1292 microversion: 2.25 time: 0.274220 Sep 23 03:43:59.633563 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 786/1500] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:43:59 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1292 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:43:59.654187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.655143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:43:59.672707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.675947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.676754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.678697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.683220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.684074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.706188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.720208 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fe0ed77-5bc0-440d-ab9f-be1ebd3bd8bd tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1277 microversion: 2.1 time: 0.188027 Sep 23 03:43:59.733819 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 715/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:59 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:59.755640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bae1ff-f3a4-4ef5-b645-7923be9d2270", "name": "network-vif-deleted", "tag": "d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:59.783839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:43:59.784484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:43:59.787717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:43:59.815643 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] Creating event network-vif-deleted:d2f0e42d-cb2d-47fe-b17c-e9efea0d6a42 for instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 on n-h1-858495-2 Sep 23 03:43:59.827977 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b708bbd8-52b1-41c9-bf96-e52ec517448a req-b51f7d00-25e3-4be9-a77e-89a7639a0427 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094786 Sep 23 03:43:59.829624 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 716/1502] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:59.860444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:59.874474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87ba07a3-6e2a-4fa4-90b1-3c41d4736886 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1364 microversion: 2.1 time: 0.239668 Sep 23 03:43:59.875195 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 787/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:43:59 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:00.203440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:00.204989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:00.223262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.224368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.226796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.228278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.229075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.232531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.380760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:00.389845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:00.391318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:00.397805 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b9ca49e-4788-4346-b64e-cf5caed59752 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.206225 Sep 23 03:44:00.398438 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 717/1504] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:00 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:00.555274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:00.556737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:00.570817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.571724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.572664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.574361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.575532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.576327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.664219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:00.665160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:00.687746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.688265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.688713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.689477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.689950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.690390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.704093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:00.708358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:00.709060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:00.709748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid f3bae1ff-f3a4-4ef5-b645-7923be9d2270 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:01.198921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.209492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c431fcf-d118-45c7-94e8-8370d2ed1d70 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 200 len: 1309 microversion: 2.1 time: 0.659140 Sep 23 03:44:01.226194 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 788/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:00 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 1309 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:01.234043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:01.235001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:01.242055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.242770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.243457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.244478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.245219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.246356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.264783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:01.412675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.422894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-569fcb08-0063-4553-827d-97588d8d53a0 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1275 microversion: 2.1 time: 0.195214 Sep 23 03:44:01.438242 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 789/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:01 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:01.447451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:01.448483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:01.468129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.473047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.474484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.475344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.475910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.476462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.516373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.517066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.518019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.518653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lazy-loading 'fault' on Instance uuid 372fff14-6ce6-4e8f-b272-13d0d8485b6d {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:01.601625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.611376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.613291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.615464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9f7487c-9cb9-49b6-9e29-b55a924af699 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1292 microversion: 2.25 time: 0.958271 Sep 23 03:44:01.625034 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 718/1507] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:00 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1292 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:01.636387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:01.637566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:01.645605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.655803 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87388b3e-92e8-4584-994e-811ea7990ded tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 200 len: 1369 microversion: 2.1 time: 0.215791 Sep 23 03:44:01.659099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.659897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.661433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.663087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:01.663760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:01.664426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:01.703360 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 790/1508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:01 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 1369 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:01.793643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.803043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.805041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:01.811849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc95c33c-1380-4c0d-8b4d-2a652167688a tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.184813 Sep 23 03:44:01.813077 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 719/1509] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:01 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:02.063637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e", "tag": "9730b0c2-cb90-4b63-8ff8-66652f9cec25"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:02.081582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.082367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.083539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.101757 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] Creating event network-changed:9730b0c2-cb90-4b63-8ff8-66652f9cec25 for instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e on n-h2-858495-2 Sep 23 03:44:02.110083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b6cde924-1c1f-4787-9c0b-32214dbe9504 req-73769681-9792-4f12-a841-6d950d417c63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058405 Sep 23 03:44:02.111475 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 791/1510] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:02.221542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:02.222164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:02.230452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.231223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.231671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.232425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.232937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.233394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.240199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:02.241168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: f3bae1ff-f3a4-4ef5-b645-7923be9d2270] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:02.247586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.248073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.248510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.249212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.249869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.250299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.265626 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 HTTP/1.1 Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:02.267749 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. Sep 23 03:44:02.269687 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f3bae1ff-f3a4-4ef5-b645-7923be9d2270'} Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:02.271162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. Sep 23 03:44:02.272404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:02.273861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance f3bae1ff-f3a4-4ef5-b645-7923be9d2270 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:02.273861 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-692c2a7d-7ba7-4967-849a-52c33ad17bb5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270" status: 404 len: 111 microversion: 2.1 time: 0.033242 Sep 23 03:44:02.273861 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 792/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:02 2022] GET /compute/v2.1/servers/f3bae1ff-f3a4-4ef5-b645-7923be9d2270 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:02.280989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:02.281632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:02.289444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.289917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.290544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.291415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.292031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.292616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.466923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:02.776296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:02.831694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:02.863108 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9661d407-2de9-49f7-8d40-f5fd12386b08 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1474 microversion: 2.1 time: 0.584203 Sep 23 03:44:02.865754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-757ecc93-1c12-4fbe-8980-a89da0236f6a tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1858 microversion: 2.1 time: 0.646389 Sep 23 03:44:02.867036 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 793/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:02 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1474 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:02.868724 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 720/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:02 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1858 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:02.879339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:02.880760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:02.882266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:02.884762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:02.903066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.905598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.910215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.910814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.912255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.912749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.920318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.920885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:02.923591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.924106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:02.927495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:02.927765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.362044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:03.424643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.432418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:03.454274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.460090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.461447 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3072de59-b499-42b1-8c32-7a0c9a725102 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1292 microversion: 2.25 time: 0.590088 Sep 23 03:44:03.462052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 721/1514] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:02 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1292 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:03.483747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:03.484384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 372fff14-6ce6-4e8f-b272-13d0d8485b6d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:03.491518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.492027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.492469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.499012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.499679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.500360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.522627 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] HTTP exception thrown: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Request method failure captured: Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d HTTP/1.1 Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSot_q0GJbl0xD6NZD2twbSNFL2Dxb1pirBP0R88RL3F9uybKl16rBFL2wPhCOb2jlsKnX1GDW8wWHiEGbAe8yVOvQd6Bwlf47Djb4tpeCTq_ICvNh75lB0DrSDPupoPg4xu5jzTEQbkgPhnfsY37rd-7otExzsu0fBe4NpdU1Apt3U Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:03.525320 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 281de6c3e01748f5a0fa1f0c75bd477f Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. Sep 23 03:44:03.527019 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '372fff14-6ce6-4e8f-b272-13d0d8485b6d'} Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:03.527844 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. Sep 23 03:44:03.529267 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:03.530670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Returning 404 to user: Instance 372fff14-6ce6-4e8f-b272-13d0d8485b6d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:03.543741 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-27513b75-4b98-4c9e-9051-ee8a32c7bae2 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d" status: 404 len: 111 microversion: 2.1 time: 0.068549 Sep 23 03:44:03.549261 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 722/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:03 2022] GET /compute/v2.1/servers/372fff14-6ce6-4e8f-b272-13d0d8485b6d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:03.566180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:03.571993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:03.584209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.584862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.588260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.589892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.590634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.592397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.619833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.636993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5952ce10-6125-49d7-8dae-8878be4b2aa4 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.768318 Sep 23 03:44:03.655309 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 794/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:02 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:03.671276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858495-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:03.675014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:03.684786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.685467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.686053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.686964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.688619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.689188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.742679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lazy-loading 'flavor' on Instance uuid 33d26f0f-b9a2-4263-a720-db922e1602a1 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:03.760031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Going to try to live migrate instance to n-h1-858495-2 {{(pid=128724) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:44:03.774942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.785226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.788377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:03.797196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4bcda97e-49f6-4183-8639-66740ba2ae58 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.245123 Sep 23 03:44:03.802264 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 723/1517] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:03 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:03.813284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50442370-e340-40a8-b63b-b930a299bfbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '.version_select at 0x7f0c8bbb63a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:03.838841 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50442370-e340-40a8-b63b-b930a299bfbe tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759117793" status: 202 len: 0 microversion: 2.1 time: 0.035495 Sep 23 03:44:03.839816 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 724/1518] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759117793 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:03.893246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:03.894935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:03.902898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.903704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.904307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.905373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.905999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.906599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.935088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:03.948417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:03.948912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:03.949595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:03.950073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 10449dce-42c4-40b7-bb28-45b120b17bad {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:04.088120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:04.103795 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ebc1acf-72fb-481f-b8fb-f14df6758e9c tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 200 len: 1309 microversion: 2.1 time: 0.214792 Sep 23 03:44:04.117240 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 725/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:03 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:04.138066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10449dce-42c4-40b7-bb28-45b120b17bad", "name": "network-vif-deleted", "tag": "49d450de-5b78-493b-bc7e-f52f9679410e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:04.181231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:04.181749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:04.182193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:04.213087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] Creating event network-vif-deleted:49d450de-5b78-493b-bc7e-f52f9679410e for instance 10449dce-42c4-40b7-bb28-45b120b17bad on n-h2-858495-2 Sep 23 03:44:04.229688 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7a36e6c8-ca58-4b1a-9025-d21735ec2fe7 req-9dc524c8-cbc8-4f68-b204-63ba15892570 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095046 Sep 23 03:44:04.231984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 726/1520] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:44:04.495590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:04.496299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:04.512418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:04.514854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:04.515337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:04.516077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:04.520211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:04.522089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:04.897868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:04.911722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:04.913604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:04.915980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d54b2d56-8990-48b2-b4fa-1f966dce6355 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1292 microversion: 2.25 time: 0.428005 Sep 23 03:44:04.935779 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 727/1521] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:04 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1292 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:04.950670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:04.958780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:04.966650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:04.967832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:04.969110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:04.970193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:04.970935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:04.971388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.651182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ae6b427-9a52-45a0-bc2d-301f8a37e48d tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/action" status: 202 len: 0 microversion: 2.1 time: 1.995044 Sep 23 03:44:05.657062 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 795/1522] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:44:03 2022] POST /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/action => generated 0 bytes in 2002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:05.663844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:05.664617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:05.674960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.675591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.676189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.677307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.677828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.678252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.822480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:05.835050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8390778e-1e8c-4dbc-9085-cd1931274445 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.896229 Sep 23 03:44:05.836360 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 728/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:04 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:05.858843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:05.865731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:05.875265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.876567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.877245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.878445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.879202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.880439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.893235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:05.918799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:05.920517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:05.922367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:05.930873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9316f9d6-ff26-494f-bce8-c874d94b64b0 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.272461 Sep 23 03:44:05.945590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 796/1524] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:05 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:05.945590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:05.945590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 10449dce-42c4-40b7-bb28-45b120b17bad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:05.968231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.970029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.971717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:05.972919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:05.973437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:05.973968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.001300 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad HTTP/1.1 Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:06.003658 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. Sep 23 03:44:06.006022 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '10449dce-42c4-40b7-bb28-45b120b17bad'} Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:06.006962 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. Sep 23 03:44:06.008432 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:06.009880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance 10449dce-42c4-40b7-bb28-45b120b17bad could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:06.009880 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-35c935cb-2f97-44f9-beb9-f6e4ad0bc3f9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad" status: 404 len: 111 microversion: 2.1 time: 0.071349 Sep 23 03:44:06.009880 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 797/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:05 2022] GET /compute/v2.1/servers/10449dce-42c4-40b7-bb28-45b120b17bad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:06.016586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.017535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.026525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.027043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.027515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.028483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.029239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.029968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.118595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b21667f-21aa-4793-b7e3-266cda0b1e45 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 204 len: 0 microversion: 2.1 time: 0.280467 Sep 23 03:44:06.126091 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 729/1526] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:05 2022] DELETE /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:06.138345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.140992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.154637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.156012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.156713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.157851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.159272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.163825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.433518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:06.444867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07ec9337-955f-49ee-a2b6-f09521f9adf9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.434772 Sep 23 03:44:06.445536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 798/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:06 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:06.450582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef703227-17e5-4c1c-82b3-a7fa9bf5c5ae tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.513195 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef703227-17e5-4c1c-82b3-a7fa9bf5c5ae tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ab4d4248-9f4e-447d-bbe5-e55d312db5c5" status: 204 len: 0 microversion: 2.1 time: 0.065979 Sep 23 03:44:06.513888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 799/1528] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 03:44:06 2022] DELETE /compute/v2.1/os-server-groups/ab4d4248-9f4e-447d-bbe5-e55d312db5c5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:06.520750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.521938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.529479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.530147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.530767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.530990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:06.531594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.532389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.532979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.540824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:06.542298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:06.543505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6790609-0b49-40d5-a158-b307d1579a41 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1292 microversion: 2.25 time: 0.419342 Sep 23 03:44:06.544075 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 730/1529] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:06 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1292 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:06.548889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "233f0281-2871-478f-9f2d-150a7dbcaf2d", "tag": "e888093c-917a-40f3-b417-a4c8300e7e30"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:06.559976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.560428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.560897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.572999 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] Creating event network-changed:e888093c-917a-40f3-b417-a4c8300e7e30 for instance 233f0281-2871-478f-9f2d-150a7dbcaf2d on n-h2-858495-2 Sep 23 03:44:06.577862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-585031bb-9f48-4510-88a5-c8e4b151dad9 req-b759c88c-4bd4-470e-9b80-e05a614c0d9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Sep 23 03:44:06.578468 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 731/1530] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:06.583636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.584218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.591299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.591803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.592456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.593522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.594200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.594721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.629492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:06.696811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:06.719651 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7eb6d736-6757-40ca-a978-43c938d32a91 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1468 microversion: 2.1 time: 0.203500 Sep 23 03:44:06.721754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 800/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:06 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:06.737922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a6ae410-2257-401d-bfe8-0f785b5f3668 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 204 len: 0 microversion: 2.1 time: 0.157851 Sep 23 03:44:06.738591 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 732/1532] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:06 2022] DELETE /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:06.748453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.750340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.763056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.764726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.765536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.766716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.767544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.768690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.805856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:06.872497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:06.873921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:06.900659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.904238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.905488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.907023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:06.912211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:06.913234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:06.987391 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b5ee685-34a9-4424-a322-1e249eca9e14 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 204 len: 0 microversion: 2.1 time: 0.242975 Sep 23 03:44:06.989691 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 801/1533] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:06 2022] DELETE /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:44:06.999568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.001176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.012318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.013126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.013876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.015078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.015799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.017576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.132489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.141343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.142877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.149258 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75db6346-31b0-406e-a2fc-c510adb43e6e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.157228 Sep 23 03:44:07.150328 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 802/1534] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:06 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:07.154988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.160353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.165911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.166400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.166830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.167534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.168182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.168413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.199331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.210726 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6ae9757-1a84-4ea6-865a-ba1fffb1116d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.348808 Sep 23 03:44:07.211444 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 733/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:06 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:07.339831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.348278 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d73d75a-2f23-444b-8bc4-f50e9ff1621e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1473 microversion: 2.1 time: 0.196987 Sep 23 03:44:07.349583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 803/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:07 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:07.477729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.478454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.484624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.485107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.485582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.486282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.486733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.487161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.572851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.573650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.580380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.581039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.581580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.582363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.583450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.583953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.649502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.658566 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-599e40f5-20a2-4d81-a361-9d0a07e59d75 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.185040 Sep 23 03:44:07.659295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 734/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:07 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:07.685769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.688065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.695716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.696292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.697000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.697938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.698643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.699275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.730748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77a74a67-2e9c-44c4-b903-73b9efbeed48 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Sep 23 03:44:07.731344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 735/1538] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:07 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:44:07.743214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.743725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.747209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.749822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.750319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.750765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.751479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.751937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.752368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.756336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.757883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.758995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3103c34-4d0e-45ca-87c7-a49d9748dbdc tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.190308 Sep 23 03:44:07.759551 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 804/1539] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:07 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:07.763903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:07.764498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:07.771982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.772389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.772835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.773573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:07.774044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:07.774461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:07.778789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:07.839803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lazy-loading 'services' on Instance uuid a94bb775-83ab-4924-89f9-8319ba8ef5a0 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:07.912207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:07.918109 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37abf83f-4351-45e4-80f4-9b47ba4b57dd tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments/cb5aab34-4454-421e-ab2b-fd82c9e0d67a" status: 202 len: 0 microversion: 2.1 time: 0.179454 Sep 23 03:44:07.918934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 736/1540] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 03:44:07 2022] DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments/cb5aab34-4454-421e-ab2b-fd82c9e0d67a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:44:07.920722 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ddd8cc2-137c-47fc-be40-dcdf8eb8b257 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1468 microversion: 2.1 time: 0.160182 Sep 23 03:44:07.921299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 805/1541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:07 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:08.179365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.180075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.186359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.186906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.187277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.187969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.188426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.188858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.233744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.234369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.241838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.242334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.242776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.243601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.244165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.244597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.255403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.263707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.265153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.270522 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0cd5df0c-7b1e-4621-a523-a809866e7d87 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.096051 Sep 23 03:44:08.271118 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 737/1542] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:08.372895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.373546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.379793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.380281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.380720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.381459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.381926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.382354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.399537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.408076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-061acabe-3868-4f66-81cc-2029c415d1ee tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.178334 Sep 23 03:44:08.409176 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 806/1543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:08.561857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.565809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:08.571144 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f177ea9f-f25d-4853-ac01-b1871b447da5 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1473 microversion: 2.1 time: 0.202287 Sep 23 03:44:08.571730 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 738/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:08.682254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.682958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.689788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.690277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.690718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.691421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.691910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.692340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.786394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.787112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.794622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.795123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.795569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.796316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.796779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.797211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.827483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.837088 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2eb3796e-cfd7-4003-9568-2fdc36537f5e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.158709 Sep 23 03:44:08.837721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 807/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:08.929726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.938095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.939616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:08.940789 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3600409-b27a-4f6c-83ae-aa2930cc13df tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.159945 Sep 23 03:44:08.941381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 739/1546] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:08.944845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:08.945497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:08.951615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.952101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.952536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:08.953228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:08.953723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:08.954221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.089033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.097166 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42a2441b-73ca-4cc6-b17d-2e1413f051fd tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1468 microversion: 2.1 time: 0.156855 Sep 23 03:44:09.097787 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 808/1547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:08 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:09.299889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:09.300433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:09.307002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.307484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.307915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.308623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.309066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.309547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.378618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.387766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.389268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.395142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87b582f0-383f-4421-b2b2-b1ec57230be7 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.099245 Sep 23 03:44:09.395737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 740/1548] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:09 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:09.432736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:09.433366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:09.439455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.439945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.440380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.441076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.441577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.442600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.574052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.581986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f65fe536-1a4d-4121-b82c-93d43675a99f tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.153275 Sep 23 03:44:09.582608 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 809/1549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:09 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:09.594384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:09.595005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:09.598855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:09.602449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.602935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.603378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.604082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.604543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.604972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.740507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:09.749025 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2aadc0f7-cef4-4a42-8fc5-62bc20738843 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1473 microversion: 2.1 time: 0.158540 Sep 23 03:44:09.749769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 741/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:09 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:09.861483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:09.862749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:09.871624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.872233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.872748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.873657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.874179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.874677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.969091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:09.970890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:09.979989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.981033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.981777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:09.982520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:09.982981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:09.983410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.171282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.181678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-326af376-cc54-47a7-8b90-752bc371d506 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.324266 Sep 23 03:44:10.182323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 810/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:09 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:10.187907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:10.188859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:10.195776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.196364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.196867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.197679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.198200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.198694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.294103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.303570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.305616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.307104 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bca833be-001a-4249-82c1-c8332feb399c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.342709 Sep 23 03:44:10.322568 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 742/1552] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:09 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:10.424973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:10.425624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:10.434635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.435093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.435555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.436252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.436753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.437526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.467240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.476072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-677ccf3f-1d65-42f9-90a4-e2f82f09f853 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1468 microversion: 2.1 time: 0.292329 Sep 23 03:44:10.489424 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 811/1553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:10 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:10.612157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:10.613611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:10.642253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.644673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.646077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.653033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.653647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.654102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.654763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.676870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.678790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:10.684460 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08670c4e-f776-48b3-852d-c07875a7168e tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.264298 Sep 23 03:44:10.685403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 743/1554] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:10 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:10.702680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b05ad1-e4ec-4a08-b205-70d52a26651b", "name": "network-vif-deleted", "tag": "6781568a-8955-4a7c-8fb7-a865ce9e9d98"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:10.736819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.737465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.738166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.758011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] Creating event network-vif-deleted:6781568a-8955-4a7c-8fb7-a865ce9e9d98 for instance 58b05ad1-e4ec-4a08-b205-70d52a26651b on n-h1-858495-2 Sep 23 03:44:10.777421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b8993af0-f992-4ab4-a86f-5fd7682a5e7d req-cf0caa98-b9fd-4c96-8251-a83b1f60b2f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078363 Sep 23 03:44:10.779872 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 744/1555] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:10.792388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:10.793121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:10.812309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.812812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.813496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:10.814411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:10.815241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:10.815861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.090435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:11.104115 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ebfe13e9-e55e-40f1-ab4e-f25ba5338b50 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.500990 Sep 23 03:44:11.106178 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 812/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:10 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:11.218852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:11.219768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:11.243174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.243874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.244629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.246536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.247494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.248104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.476922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:11.489240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-760ff2d8-f25f-496e-9e7f-32ea7489d649 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1473 microversion: 2.1 time: 0.706633 Sep 23 03:44:11.490386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 745/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:10 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1473 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:11.495560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:11.496421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:11.503708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.504510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.505157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.506151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.506795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.507388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.580040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:11.591131 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-215d5827-5af7-4dd7-b4e7-5dba9d4b9c57 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.378922 Sep 23 03:44:11.592369 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 813/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:11 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:11.597455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4154353c-3b6b-4b0f-bc5f-04338e267e74", "name": "network-vif-deleted", "tag": "499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:11.609832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.610608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.611238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.639607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] Creating event network-vif-deleted:499f753c-5f7a-4cbf-8f9d-2eaaa7a29de7 for instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 on n-h1-858495-2 Sep 23 03:44:11.655375 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9759467d-cf62-459f-86e1-d60147f9b837 req-65c7f2c3-5566-4813-a323-5b61267b51e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061517 Sep 23 03:44:11.665847 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 814/1559] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:11.672160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:11.673129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:11.692359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.694065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.716116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.717050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.718015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.718669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.895116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:11.906320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d950089f-81c1-4097-ab5c-ab201064b375 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1426 microversion: 2.1 time: 0.239023 Sep 23 03:44:11.910557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 815/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:11 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1426 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:11.918573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:11.926509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:11.949192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.951428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.952151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:11.953143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:11.953850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:11.954549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.049969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.063240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.069061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.070543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-099aa6d9-feef-4e5c-b51b-c540b30dfe83 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.578982 Sep 23 03:44:12.073940 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 746/1561] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:11 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:12.133970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:12.134436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:12.151394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.154534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.155103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.156561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.160448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.161007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.174728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.197319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.201040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.211220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16784c7f-c25b-4312-8233-17399d1dee3f tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.296470 Sep 23 03:44:12.215040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 816/1562] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:11 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:12.452055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.467700 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f7cae1a-4cc3-4a19-8187-0ece958bb0d6 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.339205 Sep 23 03:44:12.468726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 747/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:12 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:12.516087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:12.517149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:12.525889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.526572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.529609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.531456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.532796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.533618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.597325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.597917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.599069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.599540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 4154353c-3b6b-4b0f-bc5f-04338e267e74 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:12.619338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:12.619912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:12.628969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.630608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.631253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.632206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.632865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.633780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.648139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:12.658437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb77cc27-091b-405a-b56b-f3a0a6b7ce19 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 200 len: 1308 microversion: 2.1 time: 0.146006 Sep 23 03:44:12.662310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 817/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:12 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 1308 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:12.950668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:12.951372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:12.966734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.969771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.970423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:12.971572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:12.972214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:12.978802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.048320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.061394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5b89767-ce9b-4c84-a57c-ae578ae6141b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.445954 Sep 23 03:44:13.077363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.079427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.079993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.080591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lazy-loading 'fault' on Instance uuid 50d6cc8b-acac-49a5-a872-07e776dccc70 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:13.082309 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 748/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:12 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:13.105005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.105967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.118177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.121599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.122070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.125680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.126493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.127187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.182524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.203544 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-84dd8288-d183-43f6-a86b-1ef0856caf42 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 200 len: 1303 microversion: 2.1 time: 0.258416 Sep 23 03:44:13.208207 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 818/1566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:12 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:13.245551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.247191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.266743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.267268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.268063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.272897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.277492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.278905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.401292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.416014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.417728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.420909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.429383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.430369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c2ddcaf-a31f-4f9a-81c7-0b1774ccc7ac tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.190793 Sep 23 03:44:13.431026 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 819/1567] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:13 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:13.431571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.433117 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc0ecbc6-febb-4880-b105-ed4e26c92a4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.333405 Sep 23 03:44:13.442341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 749/1568] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:13 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:13.493945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.494759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.498618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:13.505161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.505711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.506166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.506901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.507361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.507811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.680165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d6cc8b-acac-49a5-a872-07e776dccc70", "name": "network-vif-deleted", "tag": "d4811bc1-dad1-45e7-b932-16ece79a1dd4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:13.699295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.700082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.700797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.703299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:13.718405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1484331a-8530-4790-8d81-fc0b3d6a71e3 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.228443 Sep 23 03:44:13.719616 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 820/1569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:13 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:13.722610 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] Creating event network-vif-deleted:d4811bc1-dad1-45e7-b932-16ece79a1dd4 for instance 50d6cc8b-acac-49a5-a872-07e776dccc70 on n-h1-858495-2 Sep 23 03:44:13.725562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.726314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 4154353c-3b6b-4b0f-bc5f-04338e267e74] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.733812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.734465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.735138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.735887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.736350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.736771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.740060 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-231bf615-f715-4ee9-88ab-f441abb60ea5 req-79a942e7-01c3-4c8e-828d-8012700ea1e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066980 Sep 23 03:44:13.742992 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 750/1570] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:13.757926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 HTTP/1.1 Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:13.760244 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. Sep 23 03:44:13.762909 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '4154353c-3b6b-4b0f-bc5f-04338e267e74'} Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:13.764431 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. Sep 23 03:44:13.766372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.767845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance 4154353c-3b6b-4b0f-bc5f-04338e267e74 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:13.767845 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5aec45e-98f0-4281-bd84-7c90b404e49a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74" status: 404 len: 111 microversion: 2.1 time: 0.041866 Sep 23 03:44:13.767845 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 821/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:13 2022] GET /compute/v2.1/servers/4154353c-3b6b-4b0f-bc5f-04338e267e74 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:13.774655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.775633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 58b05ad1-e4ec-4a08-b205-70d52a26651b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.782635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.782841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.783388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.783977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.784440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.784878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.804204 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b HTTP/1.1 Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:13.805981 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. Sep 23 03:44:13.807693 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '58b05ad1-e4ec-4a08-b205-70d52a26651b'} Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:13.808515 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. Sep 23 03:44:13.809922 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:13.811116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance 58b05ad1-e4ec-4a08-b205-70d52a26651b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:13.811116 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f337aa11-b7df-4d97-87c3-e8c05631fd3a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b" status: 404 len: 111 microversion: 2.1 time: 0.038015 Sep 23 03:44:13.811116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 751/1572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:13 2022] GET /compute/v2.1/servers/58b05ad1-e4ec-4a08-b205-70d52a26651b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:13.816147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9eeb3fe-8640-420e-b135-6632c85cea7f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.845003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9eeb3fe-8640-420e-b135-6632c85cea7f tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/d5d0352b-eecb-44df-a77f-39cfa53c40e5" status: 204 len: 0 microversion: 2.1 time: 0.032634 Sep 23 03:44:13.845814 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 822/1573] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 03:44:13 2022] DELETE /compute/v2.1/os-server-groups/d5d0352b-eecb-44df-a77f-39cfa53c40e5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:44:13.853987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:13.854492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:13.860941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.861482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.861928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.862644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:13.863103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:13.864093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:13.891943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:14.007753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a14abe67-c250-4b6d-801b-7eac3c634baf tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 204 len: 0 microversion: 2.1 time: 0.156753 Sep 23 03:44:14.008694 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 752/1574] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:13 2022] DELETE /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:14.017640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.018362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.027231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.027732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.028175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.028893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.029367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.029810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.045675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:14.090474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.091451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.098393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.098974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.099770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.100810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.101607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.102109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.226033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.238027 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38415bfb-e705-4f37-9e9b-7831bd645627 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1471 microversion: 2.1 time: 0.223958 Sep 23 03:44:14.239596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 823/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:14.245408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.246390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 50d6cc8b-acac-49a5-a872-07e776dccc70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.254680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.255392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.255842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.257205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.257708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.258200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.274569 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] HTTP exception thrown: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Request method failure captured: Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 HTTP/1.1 Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSot_q0GJbl0xD6NZD2twbSNFL2Dxb1pirBP0R88RL3F9uybKl16rBFL2wPhCOb2jlsKnX1GDW8wWHiEGbAe8yVOvQd6Bwlf47Djb4tpeCTq_ICvNh75lB0DrSDPupoPg4xu5jzTEQbkgPhnfsY37rd-7otExzsu0fBe4NpdU1Apt3U Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:14.276493 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 281de6c3e01748f5a0fa1f0c75bd477f Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. Sep 23 03:44:14.278108 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '50d6cc8b-acac-49a5-a872-07e776dccc70'} Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:14.278899 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. Sep 23 03:44:14.280144 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:14.281300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.283144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Returning 404 to user: Instance 50d6cc8b-acac-49a5-a872-07e776dccc70 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:14.284514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89f32caa-7fe7-463d-b73a-d1991babf2e1 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70" status: 404 len: 111 microversion: 2.1 time: 0.043624 Sep 23 03:44:14.286201 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 824/1576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/50d6cc8b-acac-49a5-a872-07e776dccc70 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:14.290000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3661d2c-6791-433e-aad8-cf4bcb56002c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.204063 Sep 23 03:44:14.292529 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 753/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:14.295313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.296011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.310099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.311216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.311781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.312773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.313315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.313800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.340810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:14.451775 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-671a6146-20b1-4a8f-8271-582e880fcdef tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 204 len: 0 microversion: 2.1 time: 0.160986 Sep 23 03:44:14.452580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 825/1578] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:14 2022] DELETE /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:44:14.467729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.468849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.473605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.474236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.481108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.481905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.482317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.482760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.483120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.483312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.484012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.484196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.484576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.485019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.485176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.486052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.724028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.734590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.735090 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb213af4-0727-4b0f-939c-a226d2911982 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1469 microversion: 2.1 time: 0.277091 Sep 23 03:44:14.746171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 754/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:14.746171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.746171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.746586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.747965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.748127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.748877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.749627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7ad39ff-d18b-4078-82e9-b543832d281f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.289613 Sep 23 03:44:14.749763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.750812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.751518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.752291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.766079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 826/1580] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:14.777977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:14.780966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:14.791116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.791653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.792105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.793141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:14.793751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:14.794317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:14.843903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.849221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:14.858261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.859788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.868503 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4967553-bbf9-4395-9795-111bd54f2a80 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.131436 Sep 23 03:44:14.869420 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 755/1581] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:14.961939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:14.969926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b9f766a-939d-4440-b6de-dce6d69a4a24 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.202434 Sep 23 03:44:14.970592 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 827/1582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:14 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:15.262312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:15.262856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:15.271799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.272627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.273321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.274347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.274907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.275461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.315911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:15.317152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:15.324240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.324729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.325164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.325899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.326357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.326787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.495726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:15.508427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4b84193-b5b1-4c16-8af2-2fb2d34e2d5a tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1471 microversion: 2.1 time: 0.249158 Sep 23 03:44:15.509535 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 756/1583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:15 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:15.540028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:15.557116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-398392d0-4b52-48be-88b9-bc6b079fd213 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.244837 Sep 23 03:44:15.558384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 828/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:15 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:15.624752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233f0281-2871-478f-9f2d-150a7dbcaf2d", "name": "network-vif-plugged", "status": "completed", "tag": "e888093c-917a-40f3-b417-a4c8300e7e30"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:15.636028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.636440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.636882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.650896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] Creating event network-vif-plugged:e888093c-917a-40f3-b417-a4c8300e7e30 for instance 233f0281-2871-478f-9f2d-150a7dbcaf2d on n-h2-858495-2 Sep 23 03:44:15.656180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-13507a4d-4fb2-439e-81ba-a2b2a88ae9dd req-0566f1da-8858-41ee-9492-86ca077537ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035447 Sep 23 03:44:15.657108 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 757/1585] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:15.772508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:15.773426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:15.780089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:15.781197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:15.781662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.782402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.783014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.784428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.785828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.786630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.795677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.796255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.796712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:15.797810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:15.798287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:15.798883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.050890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.055215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.073781 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b1516a9f-e2ac-4e86-8150-37327e17a4c3 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1469 microversion: 2.1 time: 0.306942 Sep 23 03:44:16.074394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 829/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:15 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:16.090716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.098786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:16.101258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.103582 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7dc1ecff-e205-4d17-b6a2-432e2ab96269 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.328701 Sep 23 03:44:16.123345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 758/1587] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:15 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:16.126670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:16.133147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:16.133813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:16.141434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.142233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.142440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.143125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.143749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.144460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.149845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.150353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.150822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.151619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.152099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.152654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.275819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.289384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.291296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.298354 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98f81643-c099-4b10-8101-bc67b788d175 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.205832 Sep 23 03:44:16.299505 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 830/1588] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:16 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:16.383665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.400224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91c35415-e118-4701-a94e-85783bd3b99d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.274997 Sep 23 03:44:16.402072 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 759/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:16 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:16.416540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8248d817-a49e-4ec5-9c53-ad5f529201a8", "name": "network-vif-deleted", "tag": "6fd82832-c276-44ae-877f-3fd8e01484ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:16.428279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.428789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.429261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.444019 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] Creating event network-vif-deleted:6fd82832-c276-44ae-877f-3fd8e01484ce for instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 on n-h1-858495-2 Sep 23 03:44:16.450066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-06307ed2-9431-48c2-ad25-8f770ae11403 req-b988ae8f-3a05-4d3a-bcac-075247a66c2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037700 Sep 23 03:44:16.451055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 831/1590] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:16.534324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:16.534943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:16.542370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.543011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.543388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.544121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.544584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.545005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.588177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:16.588895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:16.595613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.596110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.596558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.597329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:16.597880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:16.598438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:16.778207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.788331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-121b511d-7d47-46c6-ad64-dd8c0319eb40 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1471 microversion: 2.1 time: 0.258953 Sep 23 03:44:16.802793 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 760/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:16 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:16.812069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:16.822826 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ad0f220-f11b-4d78-8265-6e684299c33d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.239136 Sep 23 03:44:16.823247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 832/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:16 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:17.107880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.108521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.121138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.126288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.126840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.127687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.128171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.129719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.132411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.133041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.149801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.155766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.156470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.157416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.158041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.158657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.206369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.207044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.207658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.208359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lazy-loading 'fault' on Instance uuid 8248d817-a49e-4ec5-9c53-ad5f529201a8 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:17.655592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281de6c3e01748f5a0fa1f0c75bd477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dda867554c4c3fb49a7cbf68fd13df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.664228 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd09a712-6f92-440f-939a-b0bb02f45f57 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 200 len: 1303 microversion: 2.1 time: 0.560914 Sep 23 03:44:17.677477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 761/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 1303 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:17.677477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.679447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.687249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.688739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.688739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.689595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.690133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.690710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.732152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6e3c6e7-5c8d-47f8-9e95-42473b42b2b1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060882 Sep 23 03:44:17.732670 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 762/1594] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:44:17.743151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.743779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.750245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.750766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.751216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.752007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.752795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.754935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.776207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.789452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.791474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.792905 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f210f1ac-e9c3-4b33-b872-b542d15c4504 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.665861 Sep 23 03:44:17.794182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 833/1595] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:17.799989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.800910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.808814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.809727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.810437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.811669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.812319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.812998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.860379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.870084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.871954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:17.878738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f9b57f1-2186-4f6f-b68e-b41c5e6ce8aa tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.139410 Sep 23 03:44:17.880112 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 763/1596] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:17.885098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:17.886313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:17.895278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.896057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.896656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:17.897621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:17.898519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:17.899126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.092798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:18.101322 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60ba68c2-8454-4acd-9525-a115c6dde743 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.305671 Sep 23 03:44:18.102287 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 834/1597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:18.107686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.110120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.117275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.117869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.118525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.119308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.119834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.120340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.166914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ce7759d-a56b-48a4-a3bb-e5f885bea4e1 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063205 Sep 23 03:44:18.174990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 835/1598] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:44:18.183982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.184609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.185664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:18.207570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.208878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.210382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbfc1dc2-347b-47ae-abf4-85e72e4823c8 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1471 microversion: 2.1 time: 0.328993 Sep 23 03:44:18.210613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.211619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.212322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.212941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.227993 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 764/1599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:17 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:18.254310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.254960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.267704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.268445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.271037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.271992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.272649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.273965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.313196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:18.433855 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab77f009-9aa3-42ab-ab62-cb50baf48a7f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 204 len: 0 microversion: 2.1 time: 0.186949 Sep 23 03:44:18.434808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 765/1600] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:18 2022] DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:44:18.441065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af7665c-7c20-4487-814f-72a67ee18bd8", "name": "network-vif-deleted", "tag": "85b6322e-6c5b-4652-9d6e-ba756d914a6e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:18.444368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:18.452029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.452518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.452982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.455989 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f933b05a-369a-4d0c-a544-4b4deafef594 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.279209 Sep 23 03:44:18.475250 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] Creating event network-vif-deleted:85b6322e-6c5b-4652-9d6e-ba756d914a6e for instance 1af7665c-7c20-4487-814f-72a67ee18bd8 on n-h2-858495-2 Sep 23 03:44:18.476733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 836/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:18.480498 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7289cd18-8bd1-4a3e-8c56-6517081d4949 req-5cdda77d-e6f6-4443-be81-0fe902fdaef0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044276 Sep 23 03:44:18.481634 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 766/1602] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:18.482568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.483283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.489377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.489892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.490333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.491045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.491505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.492379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.631098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:18.639573 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e93f357-5518-40f4-8d7b-ff6d7c909fc3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1680 microversion: 2.1 time: 0.162116 Sep 23 03:44:18.640177 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 837/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:18.688749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.689943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] [instance: 8248d817-a49e-4ec5-9c53-ad5f529201a8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.697281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.697960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.698512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.699352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.699923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.700434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.715588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] HTTP exception thrown: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Request method failure captured: Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 HTTP/1.1 Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSot_q0GJbl0xD6NZD2twbSNFL2Dxb1pirBP0R88RL3F9uybKl16rBFL2wPhCOb2jlsKnX1GDW8wWHiEGbAe8yVOvQd6Bwlf47Djb4tpeCTq_ICvNh75lB0DrSDPupoPg4xu5jzTEQbkgPhnfsY37rd-7otExzsu0fBe4NpdU1Apt3U Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:18.717432 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9dda867554c4c3fb49a7cbf68fd13df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f9dda867554c4c3fb49a7cbf68fd13df Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MigrationsAdminTest-1963408465 Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 281de6c3e01748f5a0fa1f0c75bd477f Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MigrationsAdminTest-1963408465-project Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. Sep 23 03:44:18.718863 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8248d817-a49e-4ec5-9c53-ad5f529201a8'} Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:18.719801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. Sep 23 03:44:18.721213 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:18.723796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] Returning 404 to user: Instance 8248d817-a49e-4ec5-9c53-ad5f529201a8 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:18.723796 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a315b0fc-5302-41fb-8609-df41e306e837 tempest-MigrationsAdminTest-1963408465 tempest-MigrationsAdminTest-1963408465-project] 10.222.0.25 "GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8" status: 404 len: 111 microversion: 2.1 time: 0.034566 Sep 23 03:44:18.723796 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 767/1604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/8248d817-a49e-4ec5-9c53-ad5f529201a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:18.823704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.824224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.830510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.831196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.832022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.833366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.833824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.834256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.914477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:18.915741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:18.923480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.924394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.925082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:18.926112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:18.927515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:18.928188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.015536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.020689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.033551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.033904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.035121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.037943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.040609 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-523695ec-6042-40cc-9e38-e7a15fccc4e0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.220661 Sep 23 03:44:19.041934 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ca3c683-b9c2-4d44-8826-386a4f303e7b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1446 microversion: 2.75 time: 0.131669 Sep 23 03:44:19.042278 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 838/1605] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:19.042650 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 768/1606] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:18 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:19.130463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:19.131114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:19.137871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.138359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.139261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.140136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.140600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.141027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.251707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:19.252253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:19.258580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.259303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.259752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.260496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.261159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.261866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.296132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.296830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.297281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.297773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 1af7665c-7c20-4487-814f-72a67ee18bd8 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:19.364228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.372580 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4db60aa8-f932-47ff-bc24-ae19658c0f8e tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1306 microversion: 2.1 time: 0.125703 Sep 23 03:44:19.377212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 769/1607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:19 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:19.392549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.397754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:19.405591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f3b82a4-0d4e-4bb6-9ca5-2d655e1385d5 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1317 microversion: 2.1 time: 0.279555 Sep 23 03:44:19.407208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 839/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:19 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:19.483295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:19.484344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:19.496014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.496521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.497904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.501482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.502008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.502467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.673255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:19.675442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:19.681109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.693181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e755cb7-4df3-4d75-b5fc-d18ecbdb4fa8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.215928 Sep 23 03:44:19.712355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 770/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:19 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:19.721066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.724394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.724849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.728271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:19.728910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:19.729382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:19.973336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:19.982871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54229a45-8a1b-489e-97b6-4e6063aeb2d0 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1680 microversion: 2.1 time: 0.322761 Sep 23 03:44:19.983470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 840/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:19 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:20.078770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:20.079492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:20.084126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:20.085021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:20.087934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.088600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.089044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.090960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.091430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.092586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.095213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.095923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.096556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.098071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.098708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.099299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.220878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.233342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.236481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.243925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f669ac27-3b02-42e3-99ab-7a6de86ab675 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1464 microversion: 2.75 time: 0.168332 Sep 23 03:44:20.245876 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 841/1611] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:20 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:20.309260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.320214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.321713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.322855 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f14634f-2ed7-49c5-b4fc-71d497fdf94b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.248454 Sep 23 03:44:20.323618 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 771/1612] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:20 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:20.397198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:20.398568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:20.405248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.406171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.406851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.407986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.409077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.409796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.430956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:20.431600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:20.445024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.445770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.446386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.447584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.448345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.449401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.452298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.453140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.453929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.454749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 1af7665c-7c20-4487-814f-72a67ee18bd8 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:20.498892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:20.521886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.531876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-838854fb-eefe-4909-aa1d-66a8fea97ebd tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1306 microversion: 2.1 time: 0.139114 Sep 23 03:44:20.532894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 842/1613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:20 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1306 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:20.654814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.664634 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-78daf3ce-f124-4e92-ba0c-97384dc6940b tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1506 microversion: 2.1 time: 0.238408 Sep 23 03:44:20.665166 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 772/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:20 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:20.720529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:20.722110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:20.732383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.732974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.733546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.734502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:20.735050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:20.735566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:20.917922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:20.928742 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d58bc99c-7899-4744-bdb3-ccfd30c86886 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.213397 Sep 23 03:44:20.929635 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 843/1615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:20 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:21.016032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:21.016988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:21.028568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.029075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.029571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.030301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.030765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.031200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.236701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.245381 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-179de85d-ae4d-4c92-abae-f9837042bcb4 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1680 microversion: 2.1 time: 0.233231 Sep 23 03:44:21.247212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 773/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:21 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:21.293870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:21.294588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:21.309629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.310285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.310857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.311636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.312187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.312687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.349322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:21.350216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:21.358646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.359710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.360320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.361199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.361957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.362620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.465985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.475719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.477185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.498320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ea37255-db4e-4f1f-b51d-3f7c6d7800f4 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1464 microversion: 2.75 time: 0.208504 Sep 23 03:44:21.498929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 844/1617] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:21 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:21.565479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:21.566787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:21.595410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.596221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.596940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.599348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.610547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.611362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.612092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.615846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.619101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.625921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d15a11af-d0f3-4008-adbe-299c608ec2a5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.280748 Sep 23 03:44:21.627427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 774/1618] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:21 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:21.720638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.721469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.722230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.723385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 1af7665c-7c20-4487-814f-72a67ee18bd8 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:21.781033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:21.793327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c3fc126-b660-4062-8bc6-3f76ac9da1a2 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1306 microversion: 2.1 time: 0.239141 Sep 23 03:44:21.794843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 845/1619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:21 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:21.918713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e", "name": "network-vif-plugged", "status": "completed", "tag": "9730b0c2-cb90-4b63-8ff8-66652f9cec25"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:21.941030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.943382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.944134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.957133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:21.957991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:21.966337 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] Creating event network-vif-plugged:9730b0c2-cb90-4b63-8ff8-66652f9cec25 for instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e on n-h2-858495-2 Sep 23 03:44:21.979812 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7f60b51a-3180-463f-86d9-b8aed06977b4 req-38f17892-5e4b-4b51-a303-0dc9b109e0b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065783 Sep 23 03:44:21.981083 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 775/1620] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:21.983075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.983969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.985280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:21.987165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:21.989614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:21.990946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.270472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:22.271994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:22.313034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.313663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.323114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.324048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.324716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.326150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.506909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:22.523075 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-00366b05-a1a5-47a9-a1d7-0422881aca93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.570292 Sep 23 03:44:22.523912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 846/1621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:21 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:22.541734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:22.542682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:22.561230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.562293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.562747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.569615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.569615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.569615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.691954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:22.702286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:22.704492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:22.711047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a553974-a595-499e-9c5c-d750e813f6ae tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.179127 Sep 23 03:44:22.711669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 847/1622] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:22 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:22.716968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:22.718029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:22.720345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:22.730082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.731554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.733057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.734690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.735402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.736317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.742487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ecdfd6e5-4d66-45d3-837e-9dab1a4d8951 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1680 microversion: 2.1 time: 0.477962 Sep 23 03:44:22.745452 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 776/1623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:22 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1680 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:22.897741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b7ae940>, body: {"quota_set": {"ram": "5120"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:22.969082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.969908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.970420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.971447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:22.971858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:22.972302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:22.991066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:23.004371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.015115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.016842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.018027 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d463f087-c8cf-48ec-87b5-c0121f9b9467 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.305339 Sep 23 03:44:23.019136 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 848/1624] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:22 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:23.024146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:23.024765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:23.031152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.032007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.032632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.033544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.034811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.035475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.046943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cfdc6ab6-ed0b-4bfe-8e68-8c267dba99d5 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5" status: 200 len: 148 microversion: 2.57 time: 0.299904 Sep 23 03:44:23.047909 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 777/1625] 10.222.0.25 () {62 vars in 1303 bytes} [Fri Sep 23 03:44:22 2022] PUT /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5 => generated 148 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:44:23.060060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Calling method '.version_select at 0x7f0c8b6244c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:23.074606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.075022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.075465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.075917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 1af7665c-7c20-4487-814f-72a67ee18bd8 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:23.134184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.134723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.135230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.136085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.136744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.137232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.139500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.149124 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46f587fb-0adb-46db-bfb0-c8d8d877ee32 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1306 microversion: 2.1 time: 0.128672 Sep 23 03:44:23.149981 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 849/1626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:23 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:23.157963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2a4bebd-aae6-438d-b070-4f5739a4ac6d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5/detail" status: 200 len: 463 microversion: 2.57 time: 0.102103 Sep 23 03:44:23.161394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 778/1627] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Sep 23 03:44:23 2022] GET /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5/detail => generated 463 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:44:23.316476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "494f0384-0010-4f62-8fb6-3ee5e4c22232"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:23.320090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:23.326604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.327141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.327587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.328353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.328811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.329260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.330837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b887700>, body: {"quota_set": {"ram": "2048"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:23.398283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] HTTP exception thrown: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Request method failure captured: Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d/os-volume_attachments/872a0deb-375b-45a3-8802-3bac48e2b25d HTTP/1.1 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 74 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSsNUcNb_4GJywK2kkjVYgdvv-jHtbThlnmUVlfaJUZuf_6KjYvzu33KVuxyEgN56wF-zVtcq_EuaV_sO5ix9etRQlCa2uKs8SGws1pjFGmEe_4s5eBXtWXi8rb7naI-nA1vB8lq3xM_ipTuFxM4dYzheVDtQnSxKiE7CezLY7BsanU Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ff1879025d2d4d7abf52ddedefa25b14 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:44:23.402555 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff1879025d2d4d7abf52ddedefa25b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ff1879025d2d4d7abf52ddedefa25b14 Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-644505112 Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesAdminNegativeTest-644505112-project-admin Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2c371dba86124d779568ae4476fcbf10 Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesAdminNegativeTest-644505112-project-admin Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: {"volumeAttachment": {"volumeId": "494f0384-0010-4f62-8fb6-3ee5e4c22232"}} Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:23.404541 n-d-858495-2 devstack@n-api.service[128724]: exception: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '233f0281-2871-478f-9f2d-150a7dbcaf2d', 'id': '872a0deb-375b-45a3-8802-3bac48e2b25d', 'body': {'volumeAttachment': {'volumeId': '494f0384-0010-4f62-8fb6-3ee5e4c22232'}}} Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 03:44:23.405746 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. (HTTP 404) (Request-ID: req-007bffaa-e3df-49e3-ad51-f3a0c1771e95) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 03:44:23.408518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:23.411811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. Sep 23 03:44:23.413533 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:23.416295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] Returning 404 to user: Volume 872a0deb-375b-45a3-8802-3bac48e2b25d could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:23.416295 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0338572d-4bca-4f00-bec6-a5622b61a831 tempest-VolumesAdminNegativeTest-644505112 tempest-VolumesAdminNegativeTest-644505112-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d/os-volume_attachments/872a0deb-375b-45a3-8802-3bac48e2b25d" status: 404 len: 109 microversion: 2.1 time: 0.092570 Sep 23 03:44:23.416295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 850/1628] 10.222.0.25 () {60 vars in 1433 bytes} [Fri Sep 23 03:44:23 2022] PUT /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d/os-volume_attachments/872a0deb-375b-45a3-8802-3bac48e2b25d => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:23.425124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.426387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.426845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.427659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.428132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.428622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.470152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.470680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.471259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.472766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.475978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.476593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.553873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:23.555615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:23.573427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.574318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.574798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.575669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.576153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.576658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.587212 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4077bb86-9487-4584-abdf-eff41f985d5d tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5?user_id=f5f1d1e551084e14b28f40b41f7df1b8" status: 200 len: 148 microversion: 2.57 time: 0.259956 Sep 23 03:44:23.588693 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 779/1629] 10.222.0.25 () {62 vars in 1384 bytes} [Fri Sep 23 03:44:23 2022] PUT /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5?user_id=f5f1d1e551084e14b28f40b41f7df1b8 => generated 148 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:44:23.602635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-549d2747-9fc3-4fa4-adcf-a54a824d8675 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] Calling method '.version_select at 0x7f0c8b405820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:23.716842 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-549d2747-9fc3-4fa4-adcf-a54a824d8675 tempest-QuotasAdminTestV257-113834014 tempest-QuotasAdminTestV257-113834014-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5?user_id=f5f1d1e551084e14b28f40b41f7df1b8" status: 200 len: 190 microversion: 2.57 time: 0.120264 Sep 23 03:44:23.718345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 780/1630] 10.222.0.25 () {60 vars in 1364 bytes} [Fri Sep 23 03:44:23 2022] GET /compute/v2.1/os-quota-sets/7ce58faf6ba34ffbbcd48d26d1794cd5?user_id=f5f1d1e551084e14b28f40b41f7df1b8 => generated 190 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:44:23.746392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:23.747181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:23.764219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.765934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.768134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.770497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:23.771278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:23.772170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:23.951931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.975098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.982723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:23.991456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.000168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf652001-3494-40aa-9b88-44ec57c14cc9 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.258233 Sep 23 03:44:24.002284 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 781/1631] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:23 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:24.011614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:24.012083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f61e6a8-b3ec-4a82-8d68-db0be29a685a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.465383 Sep 23 03:44:24.012442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:24.013899 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 851/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:23 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:24.020884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.021399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.022160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.023643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.024453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.025156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.032291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94bb775-83ab-4924-89f9-8319ba8ef5a0", "name": "network-vif-deleted", "tag": "988e16a3-eb4d-49c5-897e-9ce9dba640c8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:24.060079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.063965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.065615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.091009 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] Creating event network-vif-deleted:988e16a3-eb4d-49c5-897e-9ce9dba640c8 for instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 on n-h2-858495-2 Sep 23 03:44:24.112781 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-45b64a64-c7e1-45fb-82ee-957ca5edeb75 req-1477fab1-de7d-491b-b860-cddcefad0549 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096981 Sep 23 03:44:24.114617 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 852/1633] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:24.126737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.135919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:24.137149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:24.139736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3687e007-cb04-485c-b2bb-7e1f850c15ef tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1613 microversion: 2.1 time: 0.134255 Sep 23 03:44:24.140772 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 782/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:24 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1613 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:24.148444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.149229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.149795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.150836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.151511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.152156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.177089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:24.178006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:24.186000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.186798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.187422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.189040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.189870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.190585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.233530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:24.234659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:24.235927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:24.236658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lazy-loading 'fault' on Instance uuid 1af7665c-7c20-4487-814f-72a67ee18bd8 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:24.317728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbb51e3276f4407b824d409896528e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6525256320b4b68b685b5c3e52f5c6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.335272 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a011d45f-1b32-4dcc-b8db-c41e4010dda9 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 200 len: 1306 microversion: 2.1 time: 0.164128 Sep 23 03:44:24.337508 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 783/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:24 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:24.431068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.447132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.450406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:24.452453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-293b45fc-c6cb-4786-9fc0-7388ef4d416f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.325603 Sep 23 03:44:24.454252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 853/1636] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:24 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:25.041876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:25.042587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:25.061015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:25.061759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:25.073525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.074391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.075326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.077223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.078502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.079510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.080779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.081156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.083067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.086051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.086577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.088381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.334186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.350318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.359669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.377725 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fc3e98f-6f16-4407-9008-3fe02f57ec05 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.342479 Sep 23 03:44:25.382376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 784/1637] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:25 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:25.404844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:25.406801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:25.418149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.428370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.428918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.429418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.430971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.431618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.432473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.432844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b783f303-84a6-4e1e-8258-f2cd05b5ebc2 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.376993 Sep 23 03:44:25.446127 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 854/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:25 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:25.446127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:25.446127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] [instance: 1af7665c-7c20-4487-814f-72a67ee18bd8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:25.449889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.450709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.451792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.452951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.454020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.454938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.509772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] HTTP exception thrown: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Request method failure captured: Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 HTTP/1.1 Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqu0IJ5iNJKn6FydjWD9CQhmzluqCnNq8Gs7_NWQeIhPkutvwtARn0YfJ27DAV8Zy3pG5AEqUfY-AiSviK0PdMhTj8mF5IHk8gKz2zR-SJcbWvVg3Mr_EcXjicU7mrMaFA8B9zaKBr4lJHoG7qmietyMLZmqFM08RHsDNm4alc5H5U Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:25.514906 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6525256320b4b68b685b5c3e52f5c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a6525256320b4b68b685b5c3e52f5c6a Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1676667270 Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9fbb51e3276f4407b824d409896528e3 Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersOnMultiNodesTest-1676667270-project Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. Sep 23 03:44:25.516978 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '1af7665c-7c20-4487-814f-72a67ee18bd8'} Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:25.517834 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. Sep 23 03:44:25.520404 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:25.522912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] Returning 404 to user: Instance 1af7665c-7c20-4487-814f-72a67ee18bd8 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:25.522912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0475e91-d1da-42b8-89eb-8fa0ebc84739 tempest-ServersOnMultiNodesTest-1676667270 tempest-ServersOnMultiNodesTest-1676667270-project] 10.222.0.25 "GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8" status: 404 len: 111 microversion: 2.1 time: 0.082861 Sep 23 03:44:25.522912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 855/1639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:25 2022] GET /compute/v2.1/servers/1af7665c-7c20-4487-814f-72a67ee18bd8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:25.531346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:25.532000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:25.534952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.535486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.535956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.536532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lazy-loading 'fault' on Instance uuid a94bb775-83ab-4924-89f9-8319ba8ef5a0 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:25.545234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.545827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.546267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.547001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:25.547517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:25.547998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:25.618192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.627918 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-412dcbe2-3f82-4020-97bf-e9bc22130854 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1331 microversion: 2.1 time: 0.243789 Sep 23 03:44:25.629032 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 785/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:25 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1331 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:25.906929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.923428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.931159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:25.933158 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da3454b5-740e-48b7-96ed-9b0def1bdcec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.410347 Sep 23 03:44:25.934949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 856/1641] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:25 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:26.415782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:26.416416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:26.427832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.439204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.439956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.441508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.446509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.447173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.470409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:26.471181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:26.493121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:26.503532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.505439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.507646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.512574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.516675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.517824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.561447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:26.603620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:26.614956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:26.620660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:26.629632 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ebdf5dc-45eb-485e-8396-44e17cd6d5bf tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.217959 Sep 23 03:44:26.632893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 786/1642] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:26 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:26.661479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:26.662582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:26.673034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.673749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.675664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.677972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.679211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.680151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.751084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.752508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.755025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.756446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lazy-loading 'fault' on Instance uuid a94bb775-83ab-4924-89f9-8319ba8ef5a0 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:26.782629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:26.811971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ecc1253-2e65-4bb1-8c78-0906cb444472 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.348481 Sep 23 03:44:26.818465 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 857/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:26 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:26.833535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:26.836248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:26.853240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.856735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.857391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.860786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.861797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.862360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.894119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:26.897791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:26.908867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e984976-eb67-4a14-b2a1-1e6c4c21a7e6 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1331 microversion: 2.1 time: 0.256878 Sep 23 03:44:26.910487 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 787/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:26 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:26.963239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:26.963907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:26.976508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.979308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.981712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:26.982662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:26.985945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:26.986623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.059628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56fce8cd-6ef0-4d50-865d-58d65d6b0ad8 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "DELETE /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 204 len: 0 microversion: 2.1 time: 0.238550 Sep 23 03:44:27.060888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 858/1645] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:26 2022] DELETE /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:27.073901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:27.075018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:27.084963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.085769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.089398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.089398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.089398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.089398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.345432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.366226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.368982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.375148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.386483 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c25cf6c9-ff41-4c4d-a41b-ee5b0b316a54 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1280 microversion: 2.25 time: 0.426152 Sep 23 03:44:27.390321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 788/1646] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:26 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1280 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:27.393307 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a514ed3-74e8-409d-a43e-edc7a147b684 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1512 microversion: 2.1 time: 0.326636 Sep 23 03:44:27.395225 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 859/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:27 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:27.687499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:27.688414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:27.740822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.741711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.742343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.744432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.746265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.747572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.846496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:27.847765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:27.858561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.864248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.865128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.867767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.868731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.871331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.874032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.884291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.886637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:27.893186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ecf385a2-d240-4edc-b605-d766bebe4c69 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.227766 Sep 23 03:44:27.913414 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 789/1648] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:27 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:27.936787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:27.937884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:27.945602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.946197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.946639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:27.947359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:27.947859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:27.948273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.020187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:28.020780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:28.021479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.022020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lazy-loading 'fault' on Instance uuid a94bb775-83ab-4924-89f9-8319ba8ef5a0 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:28.141460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.145998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.150596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:28.164207 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef4565b3-d4f2-4f7f-a29e-b783a0bd651e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.321503 Sep 23 03:44:28.167561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 860/1649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:27 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:28.168394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4818668d-bbad-4a1b-8034-b8f1b45c831f tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1331 microversion: 2.1 time: 0.239256 Sep 23 03:44:28.177565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 790/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:27 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1331 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:28.428910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:28.430828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:28.431483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:28.431991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:28.440877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:28.441391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:28.441997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:28.442267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:28.443137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.443275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.443955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:28.444437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:28.444863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.445315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:28.445922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:28.446569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:28.694446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.697674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.707206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-104cd641-a8ae-4013-8013-d5161008e56d tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1512 microversion: 2.1 time: 0.281078 Sep 23 03:44:28.707789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.708094 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 791/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:28 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:28.716339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:28.718601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f610f69-e625-4a43-ae7c-d7416fda486d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1475 microversion: 2.25 time: 0.296334 Sep 23 03:44:28.720714 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 861/1652] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:28 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:28.921767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85c478d0-2956-401e-92bf-3aa195da1029 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:28.931196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85c478d0-2956-401e-92bf-3aa195da1029 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.221981 Sep 23 03:44:28.931803 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 792/1653] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:44:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:28.997737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9c330d9f-f192-45b1-9d3c-e6aec8229755 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Calling method '.version_select at 0x7f0c935b7280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.014858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.015357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:29.026447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.027316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.031209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.032510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.033853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.035483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.091369 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9c330d9f-f192-45b1-9d3c-e6aec8229755 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 371 microversion: 2.1 time: 0.158231 Sep 23 03:44:29.092316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 793/1654] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:44:28 2022] GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:29.098560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.099388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:29.109740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.110709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.111323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.112258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.112955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.113639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.207560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:29.235651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:29.237154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:29.249545 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4290d618-e3a0-4359-9bbd-be352a46bfa5 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1452 microversion: 2.75 time: 0.155756 Sep 23 03:44:29.254138 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 794/1655] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:29 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:29.262061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c935b7310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:29.327907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:29.353185 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a82294c-efe0-4809-b2b4-bef26c4abb10 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1967 microversion: 2.25 time: 0.609145 Sep 23 03:44:29.354792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 862/1656] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:28 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1967 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:29.356128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.356677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.357226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.358028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.358484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.359179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.369751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.370635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:29.382698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.383823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.384318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.385444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.385901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.386332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.413229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:29.452213 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fb6757b-547c-4105-a15b-9830f121ca22 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 328 microversion: 2.1 time: 0.193914 Sep 23 03:44:29.454471 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 795/1657] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:29 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:29.470152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.471142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:29.480911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.481937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.482729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.483726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.484329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.484902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.539087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.539764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.542403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.542403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lazy-loading 'fault' on Instance uuid a94bb775-83ab-4924-89f9-8319ba8ef5a0 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:29.661795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8b1d78e76e41c8976073fb052f2e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa156d13dd41499d8ce020df00d215db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:29.674962 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d9adfcd-6c4e-479c-a388-54977e2e2996 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 200 len: 1331 microversion: 2.1 time: 0.217911 Sep 23 03:44:29.676584 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 796/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:29 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 1331 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:29.684223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "name": "network-vif-unplugged", "status": "completed", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:29.701829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.703469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.705661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.731790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] Creating event network-vif-unplugged:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h2-858495-2 Sep 23 03:44:29.740499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d85f89ed-1718-4007-be27-edba61d88715 req-34566e54-ecbd-421a-a8fd-4f400f096e45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061796 Sep 23 03:44:29.741551 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 797/1659] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:29.747498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:29.748139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:29.749806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:29.756470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.757053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.758151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.759137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:29.759815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:29.760495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:29.762722 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b64fa55-bee6-444c-85a0-b025315a7d17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.406530 Sep 23 03:44:29.763269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 863/1660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:29 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:29.849978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1932444776", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:29.947862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:44:30.005648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:30.028206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-767d8163-5490-4683-8fbd-720ccefa6a36 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1967 microversion: 2.25 time: 0.285322 Sep 23 03:44:30.029212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 798/1661] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:29 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1967 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:30.058426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:30.059856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:30.079755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.082310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.083428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.084982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.086271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.087415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.504517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:44:30.507048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:44:30.508415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:44:30.509817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:44:30.512937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:44:30.530144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.531144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.532093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.533441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.540816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.551144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.576303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:30.582763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:44:30.584592 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6aef44e0-cefe-4e39-bbe9-3f7ed4a32bff tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 200 len: 1512 microversion: 2.1 time: 0.537288 Sep 23 03:44:30.585253 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 799/1662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:30 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:30.590431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for user c8fdbb23e8ea41fb97c86ab993e2d07a and project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:44:30.590731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-587305155", "imageRef": "28fec3d1-d8fb-4eb9-9e0b-d171d70acb70", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:30.609697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.utils [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] cores quota exceeded for 4c136d968f2349ed81d55850b6a65528, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 03:44:30.611182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Request method failure captured: Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 145 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSucqsI0BqqwXDiGw6LIPbQQ4STRWOy-N1XtStpGgjy76MoVScv5XfLcpNg3hDiv6wYXGRvlaHfNKjQlRhKkxg6Qt2DtU0digRmS4p4IBdDKe7x6X06gAhfiZpDD3oRSRk44R7CM8EpxAWN8eZ3OZz-RASWAmpqDL9Xz4i395iPvqlQ Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:30.642674 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c136d968f2349ed81d55850b6a65528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c8fdbb23e8ea41fb97c86ab993e2d07a Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1932444776", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} Sep 23 03:44:30.644511 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1932444776', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452'}}} Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 03:44:30.645402 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:30.646640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.648029 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaaffc60-f430-4cf0-b724-3e86c8d5ee69 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.883708 Sep 23 03:44:30.657200 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 864/1663] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:44:29 2022] POST /compute/v2.1/servers => generated 111 bytes in 889 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:30.663995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:44:30.667056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:30.676281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.676281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.676281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.687408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.688650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.689515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.718308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9efeeb5f-6fce-4fd5-94da-490e05422797 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059780 Sep 23 03:44:30.719030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 865/1664] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Sep 23 03:44:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:44:30.724363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:30.724863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:30.731492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.731992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.732436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.733148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.733645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.734086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.824805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:30.835252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:30.836710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:30.842279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1cd9ae4-0609-43dc-8d2a-18b36db18e4b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1437 microversion: 2.75 time: 0.122216 Sep 23 03:44:30.843056 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 866/1665] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:30 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:30.848195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b0d6c10>, body: {"quota_set": {"cores": 20}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:30.935044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.935384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.935754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:30.937039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:30.937565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:30.938212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.024703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3823cea0-719c-4805-addb-3e765b47f8ed tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 329 microversion: 2.1 time: 0.180067 Sep 23 03:44:31.039778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 867/1666] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:30 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 329 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:31.039778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:31.039778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:31.047374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.047998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.048807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.061945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.062675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.063177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.087387 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] HTTP exception thrown: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Request method failure captured: Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 HTTP/1.1 Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqrPQi1vBLfCc8PFCR_Mmqe6WEjtoCbi2GdfJQBKBDV7Y6et_zv0GAqjdfeseWDdEI924E0PX20KLvelddfNqheEPOPlQxyuSXlgx0elo4HO_ZsGYwxZdxSaE0mIHLF1xh8a2e26JkTUEZkompiGD-Z4KciU7UyYO_JduwOQPL8Jok Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:31.089167 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa156d13dd41499d8ce020df00d215db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2b8b1d78e76e41c8976073fb052f2e43 Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:31.091863 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a94bb775-83ab-4924-89f9-8319ba8ef5a0'} Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:31.094059 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:31.098245 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.104614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Returning 404 to user: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:31.104614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b1bf861-9cde-4a7c-9ff2-0edb0303cbe2 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 404 len: 111 microversion: 2.1 time: 0.062553 Sep 23 03:44:31.104614 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 868/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:31 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:31.104614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858495-2", "block_migration": "auto"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:31.104614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:31.107573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.108213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.108502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.109251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.109775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.110234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.139517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'flavor' on Instance uuid d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:31.158943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Going to try to live migrate instance to n-h1-858495-2 {{(pid=128724) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:44:31.175931 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] Request method failure captured: Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 142 Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSucMlBR78UnEADnKMvjNOj8Vfn4Ow2xOElqLgFeo3V52KOAAw2qjGYHXuvSFyXqka7cOor0Y1oAC1VQ1tHmGYfDoCFwoTbZIw7olD6IjS55eOBUTN-u2LOypl67fUiFLKIYEVFUe9Z6Wztnm2wkG2GsNPck_skEeGINI2-3pFpc0Mw Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c37b56e904844efe84ee3ab924f9b4cb Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FlavorsV2NegativeTest-1427249289 Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:31.181471 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c37b56e904844efe84ee3ab924f9b4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c37b56e904844efe84ee3ab924f9b4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c37b56e904844efe84ee3ab924f9b4cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c37b56e904844efe84ee3ab924f9b4cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FlavorsV2NegativeTest-1427249289 Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c37b56e904844efe84ee3ab924f9b4cb Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1427249289 Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FlavorsV2NegativeTest-1427249289-project Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: a706bf5b04c54788b8afdb07d7cd9db9 Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FlavorsV2NegativeTest-1427249289-project Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-587305155", "imageRef": "28fec3d1-d8fb-4eb9-9e0b-d171d70acb70", "flavorRef": "452"}} Sep 23 03:44:31.182982 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: exception: Flavor's memory is too small for requested image. Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-587305155', 'imageRef': '28fec3d1-d8fb-4eb9-9e0b-d171d70acb70', 'flavorRef': '452'}}} Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:31.183913 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.185487 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:31.186939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:31.187774 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c3b458da-2516-48d1-a9dc-efbb042b0911 tempest-FlavorsV2NegativeTest-1427249289 tempest-FlavorsV2NegativeTest-1427249289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.600794 Sep 23 03:44:31.193053 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 800/1668] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:44:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 607 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:44:31.199707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:31.200419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:31.215661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.219183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.219838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.221267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.222178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.222989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.461809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:31.487374 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13136011-dd22-45ff-8f66-d2e2872a3fd8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.292827 Sep 23 03:44:31.488717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 801/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:31 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:31.692354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:31.695701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:31.703246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.703973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.704455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.705589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.707085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.707680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.840503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:44:31.841331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:44:31.842391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:44:31.843361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:44:31.844289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:44:31.935016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:31.952941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.953722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.954607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:31.955839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:31.957256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:31.957901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.105498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:32.129518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-029c295a-6f3f-417e-a161-04d40652b92b tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b/action" status: 202 len: 1940 microversion: 2.75 time: 0.639357 Sep 23 03:44:32.130528 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 802/1670] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:44:31 2022] POST /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b/action => generated 1940 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 03:44:32.135754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-445554eb-044c-40ee-8c61-864a40187698 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Calling method '.version_select at 0x7f0c8b259c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:32.488710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-445554eb-044c-40ee-8c61-864a40187698 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 371 microversion: 2.1 time: 0.355848 Sep 23 03:44:32.496417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 803/1671] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:44:32 2022] GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:32.503992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58743fc8-d5b3-49df-8028-3cd3704892c8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '.version_select at 0x7f0c935c2f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:32.529677 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58743fc8-d5b3-49df-8028-3cd3704892c8 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188317189" status: 202 len: 0 microversion: 2.1 time: 0.030085 Sep 23 03:44:32.530597 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 804/1672] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188317189 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:32.536066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233f0281-2871-478f-9f2d-150a7dbcaf2d", "name": "network-vif-deleted", "tag": "e888093c-917a-40f3-b417-a4c8300e7e30"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:32.553838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.554779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.555846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.576427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] Creating event network-vif-deleted:e888093c-917a-40f3-b417-a4c8300e7e30 for instance 233f0281-2871-478f-9f2d-150a7dbcaf2d on n-h2-858495-2 Sep 23 03:44:32.589040 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3a427e21-7d5d-42b6-b407-f8b9276e5d0b req-f2ce35d2-86aa-4b4c-8563-69b3ec0843d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056557 Sep 23 03:44:32.592293 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 805/1673] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:32.605991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:32.607330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 233f0281-2871-478f-9f2d-150a7dbcaf2d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:32.623047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.623349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.624117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.625377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.626437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.627387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.663156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] HTTP exception thrown: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Request method failure captured: Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d HTTP/1.1 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSr6BPSmQ_xrD4BH4yrRUsJR9vPSTx2jzx60rBKuqTKuo17RfZcIplCLw6STaD1XzSXoqnbtW95hLbRcXl5T4ipc6JLZfwR4MJln23VYSGajKPGW0ichykgCv2gIGkpRTgLrKCDMUdLYwH4OtKsbDBE3HAgNYtzKzk3HpLf36x9FP84 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 61037b48d36f46b48a8fb87dec8eeec0 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:32.667292 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 61037b48d36f46b48a8fb87dec8eeec0 Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesAdminNegativeTest-1052507141-project Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fc453bb00e54809ba847f3006c8aba2 Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesAdminNegativeTest-1052507141-project Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. Sep 23 03:44:32.668813 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '233f0281-2871-478f-9f2d-150a7dbcaf2d'} Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:32.669719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. Sep 23 03:44:32.672865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:32.676730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Returning 404 to user: Instance 233f0281-2871-478f-9f2d-150a7dbcaf2d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:32.676730 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84283ba0-80b4-4b3d-8d3f-1d5edb37b309 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d" status: 404 len: 111 microversion: 2.1 time: 0.076618 Sep 23 03:44:32.676730 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 806/1674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:32 2022] GET /compute/v2.1/servers/233f0281-2871-478f-9f2d-150a7dbcaf2d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:32.682407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:32.702673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.703851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.704825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.745025 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] Creating event network-changed:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h2-858495-2 Sep 23 03:44:32.771655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b5ad3bce-a71f-4cd9-bb03-08ea340bdeca req-69c5b544-114b-46f2-a9a0-4c7c1c1ebc42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094019 Sep 23 03:44:32.771655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 807/1675] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:32.790390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:32.791761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:32.820529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.821388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.822040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:32.823864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:32.824405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:32.824877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.068539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:33.117154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fd2088a-c745-4cb2-ab1e-c68e2740a65e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.343536 Sep 23 03:44:33.121497 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 808/1676] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:32 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:33.131233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c935b7040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:33.513124 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b05159ff-b51a-449b-9aa8-4403a224ad99 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e/action" status: 202 len: 0 microversion: 2.25 time: 2.418123 Sep 23 03:44:33.515351 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 869/1677] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:44:31 2022] POST /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e/action => generated 0 bytes in 2423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:33.541816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:33.544998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:33.565888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.578248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.578713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.579861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.580578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.581014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.826688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.829139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.829982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.831360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.834191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.835810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.942892 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74146f6c-7aea-4186-bfcf-0e1d65ef46b8 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 328 microversion: 2.1 time: 0.819409 Sep 23 03:44:33.944431 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 809/1678] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:33 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 328 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:33.950093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:33.951524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:33.960044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.960882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.961723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:33.962862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:33.963616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:33.964497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:34.391559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:34.407802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d74152a7-788c-4030-a12a-1b927def327e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.881593 Sep 23 03:44:34.408536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 870/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:33 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:34.424036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:34.430382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:34.439700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:34.440550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:34.441892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:34.442951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:34.443791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:34.444556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:34.647012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:34.654447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:34.667144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:34.669010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:34.670601 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6553492a-093d-45b0-9a58-8d3a869f0b45 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.724867 Sep 23 03:44:34.671274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 810/1680] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:33 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:34.685021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83a2f124-9372-489f-827f-d4bbdc04e851 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.274011 Sep 23 03:44:34.686820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 871/1681] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:34 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:34.688337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-805897345", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:34.797912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:44:35.033999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6cddfc7-5405-462e-b319-af6e0a52e186 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Calling method '.version_select at 0x7f0c8b0a5ee0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:35.060008 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a6cddfc7-5405-462e-b319-af6e0a52e186 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6cddfc7-5405-462e-b319-af6e0a52e186 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/images/c9d30b12-4bd4-4355-a396-041b254ed2d4/metadata/os_distro HTTP/1.1 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.114879 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': 'c9d30b12-4bd4-4355-a396-041b254ed2d4', 'id': 'os_distro'} Sep 23 03:44:35.116469 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.117411 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c9d30b12-4bd4-4355-a396-041b254ed2d4 Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.118645 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c9d30b12-4bd4-4355-a396-041b254ed2d4 could not be found. Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.121738 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.124229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6cddfc7-5405-462e-b319-af6e0a52e186 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.125917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6cddfc7-5405-462e-b319-af6e0a52e186 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "DELETE /compute/v2.1/images/c9d30b12-4bd4-4355-a396-041b254ed2d4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.432935 Sep 23 03:44:35.125917 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 872/1682] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Sep 23 03:44:34 2022] DELETE /compute/v2.1/images/c9d30b12-4bd4-4355-a396-041b254ed2d4/metadata/os_distro => generated 62 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:35.137999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84f52dc9-948b-4e7a-8ed6-2e4268784159 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Calling method '.version_select at 0x7f0c8b0d6670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:35.186414 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-84f52dc9-948b-4e7a-8ed6-2e4268784159 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84f52dc9-948b-4e7a-8ed6-2e4268784159 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/images/c285e113-a913-453e-8030-e7b9e8748242/metadata/os_version HTTP/1.1 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.189254 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': 'c285e113-a913-453e-8030-e7b9e8748242', 'id': 'os_version'} Sep 23 03:44:35.193108 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.194959 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c285e113-a913-453e-8030-e7b9e8748242 Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.197307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c285e113-a913-453e-8030-e7b9e8748242 could not be found. Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.205546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.209160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84f52dc9-948b-4e7a-8ed6-2e4268784159 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.212732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-84f52dc9-948b-4e7a-8ed6-2e4268784159 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "GET /compute/v2.1/images/c285e113-a913-453e-8030-e7b9e8748242/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.061713 Sep 23 03:44:35.212732 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 873/1683] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Sep 23 03:44:35 2022] GET /compute/v2.1/images/c285e113-a913-453e-8030-e7b9e8748242/metadata/os_version => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:44:35.212732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51aa547d-2437-4213-8bfc-7aa412594d05 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Calling method '.version_select at 0x7f0c8b0a5d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:35.263498 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-51aa547d-2437-4213-8bfc-7aa412594d05 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51aa547d-2437-4213-8bfc-7aa412594d05 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/images/f5d21048-a005-4de1-a97a-88ff5c85e230/metadata HTTP/1.1 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.265604 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': 'f5d21048-a005-4de1-a97a-88ff5c85e230'} Sep 23 03:44:35.267185 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.268219 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5d21048-a005-4de1-a97a-88ff5c85e230 Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.272803 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5d21048-a005-4de1-a97a-88ff5c85e230 could not be found. Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.274928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.280687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51aa547d-2437-4213-8bfc-7aa412594d05 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.284112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51aa547d-2437-4213-8bfc-7aa412594d05 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "GET /compute/v2.1/images/f5d21048-a005-4de1-a97a-88ff5c85e230/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065739 Sep 23 03:44:35.284112 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 874/1684] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:44:35 2022] GET /compute/v2.1/images/f5d21048-a005-4de1-a97a-88ff5c85e230/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:35.290669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53e2d40-0e9c-4ba4-a572-86e29dacc762 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Action: 'update_all', calling method: .version_select at 0x7f0c8b040670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:35.324854 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b53e2d40-0e9c-4ba4-a572-86e29dacc762 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53e2d40-0e9c-4ba4-a572-86e29dacc762 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/images/8cfda98d-d765-4a56-ba30-e49378bb7321/metadata HTTP/1.1 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 57 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.327790 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.329870 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': '8cfda98d-d765-4a56-ba30-e49378bb7321', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.330919 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cfda98d-d765-4a56-ba30-e49378bb7321 Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.332867 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cfda98d-d765-4a56-ba30-e49378bb7321 could not be found. Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.334259 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.338627 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.340196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53e2d40-0e9c-4ba4-a572-86e29dacc762 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.344349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b53e2d40-0e9c-4ba4-a572-86e29dacc762 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "PUT /compute/v2.1/images/8cfda98d-d765-4a56-ba30-e49378bb7321/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059922 Sep 23 03:44:35.345658 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 875/1685] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:44:35 2022] PUT /compute/v2.1/images/8cfda98d-d765-4a56-ba30-e49378bb7321/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:35.355434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f284f3e-2f6a-4b31-bcd1-efa08e59094d tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Action: 'update', calling method: .version_select at 0x7f0c8b64e310>, body: {"meta": {"os_distro": "alt"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:35.371599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:44:35.372125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:44:35.372653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:44:35.373079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:44:35.373594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:44:35.386892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.387445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.387942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:35.388884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.389424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.390038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:35.396721 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5f284f3e-2f6a-4b31-bcd1-efa08e59094d tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f284f3e-2f6a-4b31-bcd1-efa08e59094d tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/images/081b9d84-3327-4624-a7ff-6e8a68bc05bf/metadata/os_distro HTTP/1.1 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 30 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.400487 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: {"meta": {"os_distro": "alt"}} Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.403398 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': '081b9d84-3327-4624-a7ff-6e8a68bc05bf', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.404971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 081b9d84-3327-4624-a7ff-6e8a68bc05bf Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.407613 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 081b9d84-3327-4624-a7ff-6e8a68bc05bf could not be found. Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.409430 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.411267 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.412885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f284f3e-2f6a-4b31-bcd1-efa08e59094d tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.412885 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f284f3e-2f6a-4b31-bcd1-efa08e59094d tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "PUT /compute/v2.1/images/081b9d84-3327-4624-a7ff-6e8a68bc05bf/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055901 Sep 23 03:44:35.413911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 876/1686] 10.222.0.25 () {60 vars in 1310 bytes} [Fri Sep 23 03:44:35 2022] PUT /compute/v2.1/images/081b9d84-3327-4624-a7ff-6e8a68bc05bf/metadata/os_distro => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:44:35.425315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:44:35.427238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcaf1f24-0675-4bfa-8605-6ed418a2dda4 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Action: 'create', calling method: .version_select at 0x7f0c8b317e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:35.435455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for user c8fdbb23e8ea41fb97c86ab993e2d07a and project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:44:35.485747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.utils [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] instances quota exceeded for 4c136d968f2349ed81d55850b6a65528, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128723) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 03:44:35.486912 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 03:44:35.488213 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-dcaf1f24-0675-4bfa-8605-6ed418a2dda4 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] HTTP exception thrown: Image not found. Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcaf1f24-0675-4bfa-8605-6ed418a2dda4 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Request method failure captured: Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/images/940ed356-1d6e-46e4-926b-37839d8ac75f/metadata HTTP/1.1 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 57 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuiVJ2Hls_Fjccuqny01m5T2oZTZyORaHh9nZ2dt6t2oxEgRavMVYaVvzo5_EXP4UUvnAucasS2VvH8eGMvHodzND_zC8--IDXBN9lPsAzbmu9VVY-CRhhJdHIJrE5wqjlILTRwE1uQsmJRQMDxOXgFbcOeK11DA3IbgXdmr9I86e8 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:35.490500 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d7a34269b45444e9ed9eb7873863477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5d7a34269b45444e9ed9eb7873863477 Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344 Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 67ceb7bdaf274e158963d9736e2a256f Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1100223344-project Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:35.492122 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'image_id': '940ed356-1d6e-46e4-926b-37839d8ac75f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.493231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 940ed356-1d6e-46e4-926b-37839d8ac75f Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:44:35.496408 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 940ed356-1d6e-46e4-926b-37839d8ac75f could not be found. Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.497937 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:35.502347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.513820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcaf1f24-0675-4bfa-8605-6ed418a2dda4 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.513820 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dcaf1f24-0675-4bfa-8605-6ed418a2dda4 tempest-ImagesMetadataNegativeTestJSON-1100223344 tempest-ImagesMetadataNegativeTestJSON-1100223344-project] 10.222.0.25 "POST /compute/v2.1/images/940ed356-1d6e-46e4-926b-37839d8ac75f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072291 Sep 23 03:44:35.513820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 877/1687] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Sep 23 03:44:35 2022] POST /compute/v2.1/images/940ed356-1d6e-46e4-926b-37839d8ac75f/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Request method failure captured: Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 144 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSucqsI0BqqwXDiGw6LIPbQQ4STRWOy-N1XtStpGgjy76MoVScv5XfLcpNg3hDiv6wYXGRvlaHfNKjQlRhKkxg6Qt2DtU0digRmS4p4IBdDKe7x6X06gAhfiZpDD3oRSRk44R7CM8EpxAWN8eZ3OZz-RASWAmpqDL9Xz4i395iPvqlQ Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:35.516387 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c136d968f2349ed81d55850b6a65528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: c8fdbb23e8ea41fb97c86ab993e2d07a Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-805897345", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} Sep 23 03:44:35.518924 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-805897345', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452'}}} Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 03:44:35.521738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.523680 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.527464 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 03:44:35.529246 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:35.531280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:35.531280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:35.531508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:35.531508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-72554e95-2faf-4567-83e8-0ed47775c4ee tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.837483 Sep 23 03:44:35.531508 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 811/1688] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:44:34 2022] POST /compute/v2.1/servers => generated 119 bytes in 844 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:35.536324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b502ee0>, body: {"quota_set": {"instances": 10}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:35.537151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.548452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.549265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:35.551042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.558151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.558714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:35.569144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:35.899807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:35.909697 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-879d6c55-76c1-4651-8229-62f68e318b59 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.410355 Sep 23 03:44:35.911450 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 878/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:35 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:35.931975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:35.932722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:35.952081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.952726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.953376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:35.958556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:35.962147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:35.965341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.106126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.106989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.113143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.115551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.119577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.120583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.261049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b97fed9-9c9b-4dbd-8a4b-b27cfdff5953 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 329 microversion: 2.1 time: 0.735843 Sep 23 03:44:36.272527 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 812/1690] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:35 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 329 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:36.278182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:36.278861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:36.289325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.303085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.303931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.305252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.312513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.313471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.462170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:36.490381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:36.509002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:36.525695 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84aa0bba-be81-4e72-97fa-465734c41be9 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.251342 Sep 23 03:44:36.526874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 813/1691] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:36 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:36.532013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ab74815-90ba-4fea-a1d1-9364a10e4618 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Calling method '.version_select at 0x7f0c934878b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:36.545151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:36.554595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:36.556588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6ae861d-38c3-4118-84d5-d782252591eb tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.643452 Sep 23 03:44:36.557905 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 879/1692] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:35 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:36.918180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ab74815-90ba-4fea-a1d1-9364a10e4618 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 371 microversion: 2.1 time: 0.389675 Sep 23 03:44:36.933681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c9340a1f0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:36.941669 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 814/1693] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 03:44:36 2022] GET /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:36.946855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:36.947480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:36.958996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.959741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.964988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:36.966280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:36.966975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:36.967617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.090555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.091348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.092619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.093692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.094351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.094967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.205402 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-026df986-906c-4675-a4a6-c904c6ac62c4 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 325 microversion: 2.1 time: 0.277858 Sep 23 03:44:37.206965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:37.217929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 880/1694] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:36 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:44:37.237173 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f01874e8-6e64-40a9-a607-468b1d6da571 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.294142 Sep 23 03:44:37.239578 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 815/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:36 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:37.373361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1314170868", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:37.508757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:44:37.569215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:37.578619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:37.588290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:37.604618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.605653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.606118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.607193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.608011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.608545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.796300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:37.855801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02bc7739-423d-4919-be92-6446197cfa29 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.291977 Sep 23 03:44:37.871342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 816/1696] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:37 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:37.890169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:37.891181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:37.901736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.902725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.903459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:37.905286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:37.906493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:37.907303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.023097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:44:38.025559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:44:38.026843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:44:38.028501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:44:38.030478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:44:38.049386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.052557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.054808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.058921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.059775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.060550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.125933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:44:38.139284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Getting quotas for user c8fdbb23e8ea41fb97c86ab993e2d07a and project 4c136d968f2349ed81d55850b6a65528. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:44:38.171321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.utils [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] ram quota exceeded for 4c136d968f2349ed81d55850b6a65528, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 03:44:38.174093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Request method failure captured: Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 145 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSucqsI0BqqwXDiGw6LIPbQQ4STRWOy-N1XtStpGgjy76MoVScv5XfLcpNg3hDiv6wYXGRvlaHfNKjQlRhKkxg6Qt2DtU0digRmS4p4IBdDKe7x6X06gAhfiZpDD3oRSRk44R7CM8EpxAWN8eZ3OZz-RASWAmpqDL9Xz4i395iPvqlQ Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:38.176970 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c136d968f2349ed81d55850b6a65528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c8fdbb23e8ea41fb97c86ab993e2d07a Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1314170868", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} Sep 23 03:44:38.178831 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1314170868', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452'}}} Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 03:44:38.179860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:38.181589 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.185895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 03:44:38.193798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:38.196470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:38.198590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03d38b0a-f2f7-4772-9ff0-45881894d7d1 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.829726 Sep 23 03:44:38.201533 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 881/1697] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:44:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 833 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:38.208086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:38.221078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Action: 'update', calling method: .version_select at 0x7f0c93411d30>, body: {"quota_set": {"ram": 51200}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:38.225325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:38.227263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:38.228831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b303510-ee2f-4a3d-b776-1d22e097d709 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.355157 Sep 23 03:44:38.238298 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 817/1698] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:37 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:38.266157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:38.266859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:38.280769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.281303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.281843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.294192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.295183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.296909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.648161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:38.663693 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0256b404-bc0d-4a2b-92b0-228294999bb5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.401712 Sep 23 03:44:38.678760 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 818/1699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:38 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:38.693072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:38.693739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:38.713152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.713697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.714149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.714942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.715472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.715948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.756280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:44:38.864013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.865136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.866131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.868892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:38.869908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:38.870795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:38.893224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d062883d-3742-41f7-9b66-787286f07502 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 204 len: 0 microversion: 2.1 time: 0.210892 Sep 23 03:44:38.895156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:38.896588 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 819/1700] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:38 2022] DELETE /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:44:38.987217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c89913f-ffc6-4235-8339-d2c21facd9c3 tempest-QuotasAdminNegativeTest-553397926 tempest-QuotasAdminNegativeTest-553397926-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 200 len: 329 microversion: 2.1 time: 0.781353 Sep 23 03:44:38.989021 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 882/1701] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:38 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 329 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:38.996026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:38.997235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:39.023319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.029976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.031467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.032765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.033582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.036239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.143115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:39.147729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-913cdbb0-c2a6-4d2a-a726-310bd38e395c tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.244844 Sep 23 03:44:39.156083 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 820/1702] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Sep 23 03:44:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 03:44:39.167862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.168889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:39.180201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.181118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.182164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.183473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.184492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.185312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.192501 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1db7bb3-03ec-4b8c-afa6-0f2f0f73be7e tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.199361 Sep 23 03:44:39.194768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 883/1703] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:38 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:39.213826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccce7f58-297d-4a5e-828a-6df4a910e0c3 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Action: 'update', calling method: .version_select at 0x7f0c8b0fc8b0>, body: {"quota_set": {"ram": 0}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:39.228075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccce7f58-297d-4a5e-828a-6df4a910e0c3 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c8fdbb23e8ea41fb97c86ab993e2d07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c136d968f2349ed81d55850b6a65528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccce7f58-297d-4a5e-828a-6df4a910e0c3 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Request method failure captured: Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 HTTP/1.1 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 25 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSucqsI0BqqwXDiGw6LIPbQQ4STRWOy-N1XtStpGgjy76MoVScv5XfLcpNg3hDiv6wYXGRvlaHfNKjQlRhKkxg6Qt2DtU0digRmS4p4IBdDKe7x6X06gAhfiZpDD3oRSRk44R7CM8EpxAWN8eZ3OZz-RASWAmpqDL9Xz4i395iPvqlQ Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:39.243070 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c136d968f2349ed81d55850b6a65528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c136d968f2349ed81d55850b6a65528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4c136d968f2349ed81d55850b6a65528 Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-87039291 Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c8fdbb23e8ea41fb97c86ab993e2d07a Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-QuotasAdminNegativeTest-87039291-project Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: {"quota_set": {"ram": 0}} Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 03:44:39.247056 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '4c136d968f2349ed81d55850b6a65528', 'body': {'quota_set': {'ram': 0}}} Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:44:39.249282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.252544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 03:44:39.259980 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.263974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccce7f58-297d-4a5e-828a-6df4a910e0c3 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.266536 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccce7f58-297d-4a5e-828a-6df4a910e0c3 tempest-QuotasAdminNegativeTest-87039291 tempest-QuotasAdminNegativeTest-87039291-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528" status: 403 len: 116 microversion: 2.1 time: 0.068214 Sep 23 03:44:39.270411 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 884/1704] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 03:44:39 2022] PUT /compute/v2.1/os-quota-sets/4c136d968f2349ed81d55850b6a65528 => generated 116 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:39.283579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a4883f0-48dd-4e03-94eb-08ffe897e666 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Calling method '.version_select at 0x7f0c93424ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.384637 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0a4883f0-48dd-4e03-94eb-08ffe897e666 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] HTTP exception thrown: Image not found. Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a4883f0-48dd-4e03-94eb-08ffe897e666 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Request method failure captured: Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSumWfPylfOAO7gPNKf4mGpLPCwCGW37n5hJ2gRJimDBY_EwHakhsFy9arZr0Vyf4swqfXTqRx1sTRPQ6auhouj5XttgDNI5ix4_H7W-QEr3i9Mm8n5HVD1RTQP_90bG0cSJOr7GIyamKDJJWa6SgMNDxaX5NUi7mqfcyc1gSeHEEFo Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:39.395156 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bba033e4025434597dc65ff7aedd563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 98fe399255f1405ca43d7e440417e054 Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '-1'} Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.397428 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.399255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.402886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a4883f0-48dd-4e03-94eb-08ffe897e666 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a4883f0-48dd-4e03-94eb-08ffe897e666 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.123889 Sep 23 03:44:39.407208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 885/1705] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 23 03:44:39 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:39.411572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.411572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:39.421087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:39.426869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.427482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.427984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.430850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.432309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.432480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7aea848-2e19-4840-b008-3e9eddff6a13 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1681 microversion: 2.1 time: 0.274312 Sep 23 03:44:39.432874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.433454 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 821/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:39 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:39.449563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27781a5e-b1bb-48fd-a747-0e1b6ce9d652 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Calling method '.version_select at 0x7f0c934a9160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.516765 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-27781a5e-b1bb-48fd-a747-0e1b6ce9d652 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] HTTP exception thrown: Image not found. Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27781a5e-b1bb-48fd-a747-0e1b6ce9d652 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Request method failure captured: Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/2e1e03f5-08fa-4c3d-8117-dcddf59078bj HTTP/1.1 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSumWfPylfOAO7gPNKf4mGpLPCwCGW37n5hJ2gRJimDBY_EwHakhsFy9arZr0Vyf4swqfXTqRx1sTRPQ6auhouj5XttgDNI5ix4_H7W-QEr3i9Mm8n5HVD1RTQP_90bG0cSJOr7GIyamKDJJWa6SgMNDxaX5NUi7mqfcyc1gSeHEEFo Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:39.535521 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bba033e4025434597dc65ff7aedd563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 98fe399255f1405ca43d7e440417e054 Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2e1e03f5-08fa-4c3d-8117-dcddf59078bj'} Sep 23 03:44:39.538173 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e1e03f5-08fa-4c3d-8117-dcddf59078bj to delete Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.539545 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e1e03f5-08fa-4c3d-8117-dcddf59078bj could not be found. Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.541374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:39.543446 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.546430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27781a5e-b1bb-48fd-a747-0e1b6ce9d652 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.548843 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-27781a5e-b1bb-48fd-a747-0e1b6ce9d652 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/2e1e03f5-08fa-4c3d-8117-dcddf59078bj" status: 404 len: 62 microversion: 2.1 time: 0.114259 Sep 23 03:44:39.550903 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 822/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:39 2022] DELETE /compute/v2.1/images/2e1e03f5-08fa-4c3d-8117-dcddf59078bj => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:39.570320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05dd21ff-d8b2-4aa0-a389-bc54231a38a0 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Calling method '.version_select at 0x7f0c93487ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.613107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-05dd21ff-d8b2-4aa0-a389-bc54231a38a0 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] HTTP exception thrown: Image not found. Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05dd21ff-d8b2-4aa0-a389-bc54231a38a0 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Request method failure captured: Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1 HTTP/1.1 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSumWfPylfOAO7gPNKf4mGpLPCwCGW37n5hJ2gRJimDBY_EwHakhsFy9arZr0Vyf4swqfXTqRx1sTRPQ6auhouj5XttgDNI5ix4_H7W-QEr3i9Mm8n5HVD1RTQP_90bG0cSJOr7GIyamKDJJWa6SgMNDxaX5NUi7mqfcyc1gSeHEEFo Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:39.620615 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bba033e4025434597dc65ff7aedd563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 98fe399255f1405ca43d7e440417e054 Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1'} Sep 23 03:44:39.623605 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1 to delete Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.624920 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1 could not be found. Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.627103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:39.632392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.637066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05dd21ff-d8b2-4aa0-a389-bc54231a38a0 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.640823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05dd21ff-d8b2-4aa0-a389-bc54231a38a0 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1" status: 404 len: 62 microversion: 2.1 time: 0.081960 Sep 23 03:44:39.647762 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 823/1708] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:39 2022] DELETE /compute/v2.1/images/22a7fa49-10bb-4e99-af4d-d6bb8a0ad65a1 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:39.654494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82034b75-d0c2-4ae2-89da-cab4c302bad5 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Calling method '.version_select at 0x7f0c934a9790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.687153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-82034b75-d0c2-4ae2-89da-cab4c302bad5 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] HTTP exception thrown: Image not found. Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82034b75-d0c2-4ae2-89da-cab4c302bad5 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Request method failure captured: Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/tempest-invalid-1183585688 HTTP/1.1 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSumWfPylfOAO7gPNKf4mGpLPCwCGW37n5hJ2gRJimDBY_EwHakhsFy9arZr0Vyf4swqfXTqRx1sTRPQ6auhouj5XttgDNI5ix4_H7W-QEr3i9Mm8n5HVD1RTQP_90bG0cSJOr7GIyamKDJJWa6SgMNDxaX5NUi7mqfcyc1gSeHEEFo Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:39.691152 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bba033e4025434597dc65ff7aedd563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 98fe399255f1405ca43d7e440417e054 Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'tempest-invalid-1183585688'} Sep 23 03:44:39.695068 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1183585688 to delete Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.702032 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1183585688 could not be found. Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.703988 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82034b75-d0c2-4ae2-89da-cab4c302bad5 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.706666 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-82034b75-d0c2-4ae2-89da-cab4c302bad5 tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-1183585688" status: 404 len: 62 microversion: 2.1 time: 0.044203 Sep 23 03:44:39.709290 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 824/1709] 10.222.0.25 () {58 vars in 1206 bytes} [Fri Sep 23 03:44:39 2022] DELETE /compute/v2.1/images/tempest-invalid-1183585688 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:39.807994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:39.822007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:39.825739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:39.829876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3bd1dda5-bc12-4efb-8935-a6cd55a2eed3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.430763 Sep 23 03:44:39.831247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 886/1710] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:39 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:39.838226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a1603bd-8629-47d5-ac49-4ec73640cdfc tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Calling method '.version_select at 0x7f0c8b0d6160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.878052 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8a1603bd-8629-47d5-ac49-4ec73640cdfc tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] HTTP exception thrown: Image not found. Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a1603bd-8629-47d5-ac49-4ec73640cdfc tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Request method failure captured: Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/images/7c273182-9258-417a-88b3-67d79aa84776 HTTP/1.1 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSumWfPylfOAO7gPNKf4mGpLPCwCGW37n5hJ2gRJimDBY_EwHakhsFy9arZr0Vyf4swqfXTqRx1sTRPQ6auhouj5XttgDNI5ix4_H7W-QEr3i9Mm8n5HVD1RTQP_90bG0cSJOr7GIyamKDJJWa6SgMNDxaX5NUi7mqfcyc1gSeHEEFo Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:39.880958 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bba033e4025434597dc65ff7aedd563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bba033e4025434597dc65ff7aedd563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6bba033e4025434597dc65ff7aedd563 Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019 Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 98fe399255f1405ca43d7e440417e054 Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1833463019-project Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7c273182-9258-417a-88b3-67d79aa84776'} Sep 23 03:44:39.882805 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7c273182-9258-417a-88b3-67d79aa84776 to delete Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.884192 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c273182-9258-417a-88b3-67d79aa84776 could not be found. Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:39.886487 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:44:39.889726 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:39.900614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a1603bd-8629-47d5-ac49-4ec73640cdfc tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:39.902163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a1603bd-8629-47d5-ac49-4ec73640cdfc tempest-ImagesDeleteNegativeTestJSON-1833463019 tempest-ImagesDeleteNegativeTestJSON-1833463019-project] 10.222.0.25 "DELETE /compute/v2.1/images/7c273182-9258-417a-88b3-67d79aa84776" status: 404 len: 62 microversion: 2.1 time: 0.069468 Sep 23 03:44:39.903516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 887/1711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:39 2022] DELETE /compute/v2.1/images/7c273182-9258-417a-88b3-67d79aa84776 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:44:39.917705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:39.920031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:39.934602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.936510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.937625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:39.938615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:39.939207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:39.939731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.111094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:40.113094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:40.135528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.138602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.142315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.146740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.148503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.151123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.598035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:40.621105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:40.623498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:40.626045 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b782d76-1afb-4d96-a1d1-e813461d6e51 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2948 microversion: 2.32 time: 0.721163 Sep 23 03:44:40.628384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 888/1712] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:39 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2948 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:40.635071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:40.636143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:40.647181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:40.654076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.666120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.667943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.670886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.674086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.675857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d4a4ef7-606e-4156-b555-fc8e0a51639e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.969499 Sep 23 03:44:40.676725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.689688 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 825/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:39 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:40.698412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:40.700035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:40.722053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.724276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.726634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.727881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.729694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.730394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.825805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:40.870119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1496f9a-f201-4e73-8ede-13171c08321c tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.240191 Sep 23 03:44:40.871492 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 889/1714] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:40 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:40.878979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:40.879490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:40.885951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.886461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.886907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:40.887815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:40.888738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:40.888738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.100205 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8b803319-d143-48e8-a324-5f44111579f0 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.225044 Sep 23 03:44:41.100205 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 890/1715] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 03:44:40 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b/os-interface => generated 1833 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:41.111525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:41.111525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:41.119616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.120341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.121377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.123991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.125946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.126689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.271632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:41.286450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53c55232-0fa8-4dde-8e09-cb738bbf546a tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1681 microversion: 2.1 time: 0.594222 Sep 23 03:44:41.287938 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 826/1716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:40 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1681 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:41.495369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:41.532511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:41.534740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:41.536296 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e6be826-43f0-4397-9443-b4b041304a29 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.437670 Sep 23 03:44:41.537108 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 891/1717] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:41 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:41.718353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:41.724122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:41.761222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.761891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.763629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.766110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.768031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.772232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.904888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:41.906271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:41.921024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.925101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.926123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:41.931960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:41.932488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:41.933013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.125604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:42.175340 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aed4e908-624b-4d33-939d-e45a18e2adcc tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.269794 Sep 23 03:44:42.177325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:42.178800 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 892/1718] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:41 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:42.188228 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-034a8a96-692e-4453-aa90-612e9e68e624 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.484272 Sep 23 03:44:42.189390 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 827/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:41 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:42.319340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:42.320659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:42.333534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:42.337439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:42.341226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.343788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:42.351621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:42.352910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.568887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:42.569944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:42.580710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:42.586149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:42.586920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.587872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:42.588675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:42.589303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.610626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:42.625499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc246c33-ec9b-4b05-9201-c572d99f1ca2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1613 microversion: 2.1 time: 0.312754 Sep 23 03:44:42.634783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 893/1720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:42 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1613 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:42.718734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67627c3d-d16c-4926-a278-5d28cbaa59d8", "name": "network-vif-deleted", "tag": "d2956182-e36b-4f33-b9d8-bc6ef45bd0d0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:42.745457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:42.753269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:42.754247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:42.774677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] Creating event network-vif-deleted:d2956182-e36b-4f33-b9d8-bc6ef45bd0d0 for instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 on n-h1-858495-2 Sep 23 03:44:42.781220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-67a25d4a-eb1b-4095-9179-0ee8e2c0252e req-218f7250-b11a-41ac-be7e-5c5f6bdb5efd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067954 Sep 23 03:44:42.782874 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 894/1721] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:43.154169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:43.174969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:43.182285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:43.189139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23d806c0-53b6-4020-964c-b240dbf9e280 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.621724 Sep 23 03:44:43.190770 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 828/1722] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:42 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:43.217791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:43.219894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:43.229618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:43.235536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:43.245198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.250868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.252761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.257968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.258466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.259237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.260971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.261539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.262051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.265253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.267325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.269194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.609362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:43.683889 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b6871bb-fc16-4493-b808-db23feb5e236 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.473503 Sep 23 03:44:43.684496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 829/1723] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:43 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:43.698130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:43.698514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:43.719169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.722411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.725312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.728072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.730642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.740190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.828882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:43.829488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:43.830043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:43.832859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lazy-loading 'fault' on Instance uuid 67627c3d-d16c-4926-a278-5d28cbaa59d8 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:43.970482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:43.980709 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5ae2648-4d1e-4ee2-91d1-e21549bfa71c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1717 microversion: 2.1 time: 0.770983 Sep 23 03:44:43.993026 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 895/1724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:43 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1717 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:44.009448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc453bb00e54809ba847f3006c8aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61037b48d36f46b48a8fb87dec8eeec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:44.024011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0360dd68-de03-4f35-bafc-f29eff345e16 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 200 len: 1332 microversion: 2.1 time: 0.338122 Sep 23 03:44:44.037665 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 830/1725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:43 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 1332 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:44.225213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:44.226107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:44.234603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:44.235105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:44.235551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:44.239127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:44.239620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:44.240066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:44.335011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c0661ae-968d-43b4-b0e8-0f5f90f5553b tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] Calling method '.version_select at 0x7f0c8b0b3d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:44.405331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c0661ae-968d-43b4-b0e8-0f5f90f5553b tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] 10.222.0.25 "GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda" status: 200 len: 784 microversion: 2.1 time: 0.410889 Sep 23 03:44:44.406462 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 896/1726] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:44:43 2022] GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda => generated 784 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:44.427067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24d55210-1fff-48e4-b3a3-5fe41b51fe31 tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] Calling method '.version_select at 0x7f0c93424af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:44.573687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24d55210-1fff-48e4-b3a3-5fe41b51fe31 tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.151130 Sep 23 03:44:44.574179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:44.574322 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 897/1727] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 23 03:44:44 2022] GET /compute/v2.1/images => generated 445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:44.587925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:44.590036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a5e4af9-9e89-40f9-97f6-e8dbda1ccbee tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] Calling method '.version_select at 0x7f0c93411040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:44.592896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:44.596014 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e391d57f-c353-4459-b800-c983dcd04ee8 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.377392 Sep 23 03:44:44.603097 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 831/1728] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:44 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:44.702472 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9a5e4af9-9e89-40f9-97f6-e8dbda1ccbee tempest-ListImagesTestJSON-991367719 tempest-ListImagesTestJSON-991367719-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.116790 Sep 23 03:44:44.703644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 898/1729] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:44:44 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:44:44.721996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:44.722960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:44.730620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:44.732293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:44.733652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:44.735423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:44.736551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:44.737442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:44.860773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:44.870182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:44.891056 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-73eb6772-79a3-4e97-8407-31b6de17c493 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.174597 Sep 23 03:44:44.892262 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 832/1730] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:44 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:45.023122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.024314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:45.031937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.032677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.033297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.034154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.034824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.035418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.083975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.085952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] [instance: 67627c3d-d16c-4926-a278-5d28cbaa59d8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:45.102811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.103656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.104314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.105839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.109395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.111921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.155513 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] HTTP exception thrown: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Request method failure captured: Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 HTTP/1.1 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSr6BPSmQ_xrD4BH4yrRUsJR9vPSTx2jzx60rBKuqTKuo17RfZcIplCLw6STaD1XzSXoqnbtW95hLbRcXl5T4ipc6JLZfwR4MJln23VYSGajKPGW0ichykgCv2gIGkpRTgLrKCDMUdLYwH4OtKsbDBE3HAgNYtzKzk3HpLf36x9FP84 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 61037b48d36f46b48a8fb87dec8eeec0 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:44:45.157391 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61037b48d36f46b48a8fb87dec8eeec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 61037b48d36f46b48a8fb87dec8eeec0 Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1052507141 Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesAdminNegativeTest-1052507141-project Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fc453bb00e54809ba847f3006c8aba2 Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesAdminNegativeTest-1052507141-project Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. Sep 23 03:44:45.159196 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '67627c3d-d16c-4926-a278-5d28cbaa59d8'} Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:45.160192 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. Sep 23 03:44:45.161863 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:44:45.165339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Returning 404 to user: Instance 67627c3d-d16c-4926-a278-5d28cbaa59d8 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:45.166474 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc3f4b29-02b6-4834-b7b3-46b12510cac1 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8" status: 404 len: 111 microversion: 2.1 time: 0.096959 Sep 23 03:44:45.171134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 833/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/servers/67627c3d-d16c-4926-a278-5d28cbaa59d8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:45.180911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2983f96d-b789-4d2f-bdf7-8d7f1fce9db2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] Calling method '.version_select at 0x7f0c93410820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.221130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2983f96d-b789-4d2f-bdf7-8d7f1fce9db2 tempest-VolumesAdminNegativeTest-1052507141 tempest-VolumesAdminNegativeTest-1052507141-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033776381" status: 202 len: 0 microversion: 2.1 time: 0.046507 Sep 23 03:44:45.221958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 834/1732] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:44:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033776381 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:45.269846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:45.289405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54853c93-9e84-4d14-9ed9-fb08fe21ef42 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1707 microversion: 2.1 time: 0.272880 Sep 23 03:44:45.300895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 899/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1707 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:44:45.313504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dd2dd3d-c214-4249-a9ff-b1bc60681f53 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '.version_select at 0x7f0c934a9310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.318868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd3d-c214-4249-a9ff-b1bc60681f53 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.319334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd3d-c214-4249-a9ff-b1bc60681f53 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.320495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd3d-c214-4249-a9ff-b1bc60681f53 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.335388 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1dd2dd3d-c214-4249-a9ff-b1bc60681f53 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2701 microversion: 2.1 time: 0.026517 Sep 23 03:44:45.336631 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 835/1734] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/os-migrations => generated 2701 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:45.361123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.364463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:45.376177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.377334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.378588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.379565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.380319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.380978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.629100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.629829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:45.645117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.649170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e0e19e9-03cf-45e0-9e3f-18a89ed1f64e tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1858 microversion: 2.1 time: 0.294623 Sep 23 03:44:45.650798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.651260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.652017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.652484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.652921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.666889 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 900/1735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1858 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:45.682757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:45.683389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:45.698853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.699607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.700412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:45.701405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:45.702073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:45.702706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.014214 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8484389f-3a8c-40ef-8994-a47550750c04 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1858 microversion: 2.1 time: 0.335101 Sep 23 03:44:46.015260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 901/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1858 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:44:46.050456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:46.051527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:46.067878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:46.080070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:46.082786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:46.084124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.085926 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b11689e-ed8f-44d6-a9b2-4b532f0e46b5 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.461747 Sep 23 03:44:46.087225 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 836/1737] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:45 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:46.087475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.090328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.091346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.093785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:46.094607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:46.095320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.096449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.103234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.104138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.104775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.105704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.106334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.106936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.140214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=17 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:46.148131 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] HTTP exception thrown: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Request method failure captured: Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 HTTP/1.1 Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqrPQi1vBLfCc8PFCR_Mmqe6WEjtoCbi2GdfJQBKBDV7Y6et_zv0GAqjdfeseWDdEI924E0PX20KLvelddfNqheEPOPlQxyuSXlgx0elo4HO_ZsGYwxZdxSaE0mIHLF1xh8a2e26JkTUEZkompiGD-Z4KciU7UyYO_JduwOQPL8Jok Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:46.150684 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa156d13dd41499d8ce020df00d215db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2b8b1d78e76e41c8976073fb052f2e43 Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.152580 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a94bb775-83ab-4924-89f9-8319ba8ef5a0'} Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:46.153626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.155347 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.157856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Returning 404 to user: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:46.158329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07c4bd1e-a56c-4d7c-ac3d-e14912d8c14c tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 404 len: 111 microversion: 2.1 time: 0.117327 Sep 23 03:44:46.161907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 902/1738] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:44:46 2022] DELETE /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:46.173760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:46.175112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] [instance: a94bb775-83ab-4924-89f9-8319ba8ef5a0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:46.182938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.183538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.183993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.184711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.185171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.186000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.205565 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] HTTP exception thrown: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Request method failure captured: Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 HTTP/1.1 Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSqrPQi1vBLfCc8PFCR_Mmqe6WEjtoCbi2GdfJQBKBDV7Y6et_zv0GAqjdfeseWDdEI924E0PX20KLvelddfNqheEPOPlQxyuSXlgx0elo4HO_ZsGYwxZdxSaE0mIHLF1xh8a2e26JkTUEZkompiGD-Z4KciU7UyYO_JduwOQPL8Jok Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:44:46.209821 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fa156d13dd41499d8ce020df00d215db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fa156d13dd41499d8ce020df00d215db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: fa156d13dd41499d8ce020df00d215db Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-154711684 Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2b8b1d78e76e41c8976073fb052f2e43 Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-154711684-project Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.211674 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a94bb775-83ab-4924-89f9-8319ba8ef5a0'} Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:44:46.212662 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. Sep 23 03:44:46.214248 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:44:46.215470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] Returning 404 to user: Instance a94bb775-83ab-4924-89f9-8319ba8ef5a0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:44:46.215470 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c08a8f79-c200-4eb4-acf8-24e49a394ef3 tempest-AttachSCSIVolumeTestJSON-154711684 tempest-AttachSCSIVolumeTestJSON-154711684-project] 10.222.0.25 "GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0" status: 404 len: 111 microversion: 2.1 time: 0.047896 Sep 23 03:44:46.215470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 903/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:44:46 2022] GET /compute/v2.1/servers/a94bb775-83ab-4924-89f9-8319ba8ef5a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:46.218816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:46.219408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:46.228297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.229130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.229651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.230626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.231097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.231756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.239954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:46.270271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:46.303689 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-86831c3f-9b0b-4654-9119-6ab70ceb4750 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.214974 Sep 23 03:44:46.313160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 837/1740] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:46 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:46.432907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lazy-loading 'services' on Instance uuid 33d26f0f-b9a2-4263-a720-db922e1602a1 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:46.558612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa8d15ee-669f-48c7-b9af-e85d8bc1be1b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments/5fa3d534-f0e6-4a00-b5b4-4b36933d1f77" status: 202 len: 0 microversion: 2.1 time: 0.344036 Sep 23 03:44:46.559361 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 904/1741] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 03:44:46 2022] DELETE /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments/5fa3d534-f0e6-4a00-b5b4-4b36933d1f77 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:46.568960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:46.571591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:46.585458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.586711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.587713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.590037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:46.591168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:46.592142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:46.662780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f9c4bb5-598f-4fa2-bc2c-481345d716f6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098373 Sep 23 03:44:46.670308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 838/1742] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:46 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:44:47.121119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:47.124642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:47.137868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.138374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.141477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.143065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.144713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.145529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.336823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=62 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:47.341944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:47.342568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:47.353923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.354727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.355431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.356341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.356970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.357903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.528939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:47.542503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:47.544063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:47.545267 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1d6a408-6ec9-4f9f-9eb4-4bd6ccb47fac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.430912 Sep 23 03:44:47.545863 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 905/1743] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:47 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:47.571484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:47.597680 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6e800be-c273-4da0-8f00-8be4ec9243b3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.262168 Sep 23 03:44:47.599626 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 839/1744] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:47 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:47.678530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:47.680862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:47.693123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.703273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.704149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.707364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:47.712509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:47.714316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:47.784914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d839d966-b9b0-4a6b-a01e-7cc821d3d8db tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109446 Sep 23 03:44:47.786364 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 906/1745] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:47 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:48.573032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:48.574082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:48.592727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:48.593248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:48.593917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:48.594809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:48.595830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:48.596470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:48.629707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:48.631128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:48.646023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:48.650467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:48.651114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:48.654930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:48.656695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:48.660670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:48.884931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:48.979247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:49.021931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:49.068186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54c8aa63-5f6f-4333-a2e4-d12e0b530054 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.442771 Sep 23 03:44:49.071435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 907/1746] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:48 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:49.102991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:49.105424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:49.125988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:49.126722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:49.131764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:49.134244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:49.144374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:49.145458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:49.232352 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f36f6641-714e-4943-aa24-170150b4f9f1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159059 Sep 23 03:44:49.236546 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 908/1747] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:49 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:49.405999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:49.439573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:49.446573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:49.449675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be4eefc5-3362-4a07-b8e6-b8b33b5fbac3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.880233 Sep 23 03:44:49.475918 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 840/1748] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:48 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:50.110367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:50.110947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:50.131682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.132192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.132640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.133393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.138404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.138963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.273092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:50.280844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:50.306324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.314075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.317220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.325971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.326585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.328372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.376531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:50.438014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-74f85c92-2d6f-48d3-83d8-44ce54d8068a tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.336283 Sep 23 03:44:50.443657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 909/1749] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:50 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:50.469523 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1297fd6-c4f1-4afe-99ea-7a92fbf499fb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217152 Sep 23 03:44:50.476673 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 841/1750] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:50 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:50.483682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:50.484557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:50.496976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.497848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.498551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.499567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:50.500924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:50.501657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:50.849177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:50.860357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:50.867929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:50.870796 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccc5f9eb-6424-4f7b-8c2b-834d31b8e26d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.396432 Sep 23 03:44:50.874375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 910/1751] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:50 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:51.477158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:51.477158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:51.489537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:51.497504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:51.501278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.501825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.502290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:51.506476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.508735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.509387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.509549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:51.513159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.513738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:51.516785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.517302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.518788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:51.594759 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2925d2a-7bed-4d53-9837-070fb4b471b1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114915 Sep 23 03:44:51.601271 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 911/1752] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:51 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:51.728143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:51.787473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7171cfe-ead0-47b6-81d4-46bdd5dbc6ab tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.319626 Sep 23 03:44:51.789295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 842/1753] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:51 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:51.907886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:51.910015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:51.918252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.919067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.919767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:51.922981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:51.926207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:51.927085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:52.398337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:52.414103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:52.418819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:52.425564 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e84bcf4-ded7-4d48-ba3f-583215a1a529 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.524545 Sep 23 03:44:52.430901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 912/1754] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:51 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:52.612821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:52.615917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:52.630710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:52.631260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:52.633955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:52.634932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:52.639098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:52.639842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:52.722526 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3408c72-ce64-4c12-9e87-096b3523a58f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114143 Sep 23 03:44:52.726169 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 843/1755] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:52 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:52.821088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:52.822416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:52.836271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:52.837127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:52.837836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:52.838836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:52.840402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:52.842610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.091594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:53.149476 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fecdd1fb-c120-46d0-931c-da45679ebb8d tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.333012 Sep 23 03:44:53.150365 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 913/1756] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:52 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:53.472227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1137185561", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:44:53.475942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:53.477495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:53.494584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.496872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.499045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.500113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.500783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.501430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.582909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:44:53.583634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:44:53.584372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:44:53.585030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:44:53.586220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:44:53.602011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.602979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.603672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.604727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.607452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.608259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.642174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Getting quotas for project 9aaa78b545cf48d592c9a2ae2e8735ed. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:44:53.648396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Getting quotas for user 21741ad177fd4ab3ab24ec64fc6f3c04 and project 9aaa78b545cf48d592c9a2ae2e8735ed. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:44:53.672175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:44:53.675485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:44:53.753370 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47e2c536-5e5c-44db-8e5b-1a08dc7e88a5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.569575 Sep 23 03:44:53.754168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 844/1757] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:44:53.759569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:53.765888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:53.773289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.774018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.774492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.775303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:53.775928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:53.776390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:53.837372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:53.845114 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e857c49-acce-495b-b099-51a5b7293b8d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089726 Sep 23 03:44:53.847996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 845/1758] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:53 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:53.856394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:53.859880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:53.862817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:53.864487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:53.868187 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f4af732-d517-43b7-aeb3-de3a363e219f tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.406235 Sep 23 03:44:53.872541 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 914/1759] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:53 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:53.967754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:53.983834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:53.990547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:54.015495 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3d61bbc1-8ca5-4d31-a4a7-5b3cca8714db tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1454 microversion: 2.91 time: 0.152330 Sep 23 03:44:54.015937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 846/1760] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:53 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:54.189852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:54.190640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:54.202744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.204887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.205650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:54.208417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.212257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.213039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:54.439654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:54.537750 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a67b456-22f8-40c0-81e0-e0f654509f83 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.344680 Sep 23 03:44:54.545042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 915/1761] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:54 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:54.860893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:54.864690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:54.904882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:54.906516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:54.921778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.922346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.930005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:54.938464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.940057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.940877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.941594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.943880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:54.944573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:54.945547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:54.950595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:54.951270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:55.055681 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e391ec73-2c39-4054-b9f1-d2e51c544fc7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200378 Sep 23 03:44:55.063854 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 847/1762] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:54 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:55.071449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:55.084180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:55.106229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:55.106790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:55.107248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:55.107987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:55.118197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:55.123373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:55.354394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.374936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.376709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.396827 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-645a77aa-13f4-438c-a3e0-2f174028d951 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1450 microversion: 2.91 time: 0.331611 Sep 23 03:44:55.397807 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 848/1763] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:55 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1450 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:55.560572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:55.561975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:55.573730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:55.574225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:55.574700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:55.575492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:55.575907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:55.576348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:55.806386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.820855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.823992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:55.825764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46273c76-9686-447b-9833-1abb0638fce4 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.925671 Sep 23 03:44:55.843651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 916/1764] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:54 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:55.857851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:55.937056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:55.938930 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60f9d755-3a17-4101-a1cf-96b56ae5dcac tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.382601 Sep 23 03:44:55.951024 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 849/1765] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:55 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:56.068736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:56.071369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:56.090930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.098433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.098986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.099778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.113042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.113745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.235713 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb8587fe-6648-4edf-b01c-87642c3ca284 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163458 Sep 23 03:44:56.236837 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 917/1766] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:56 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:44:56.433761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:56.435148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:56.445986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.448236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.448709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.450965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.454655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.455733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.594916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:56.612269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:56.614939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:56.634567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e75c7951-1276-4dc0-bcd8-fe60b5bde908 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1524 microversion: 2.91 time: 0.205993 Sep 23 03:44:56.635498 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 850/1767] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:56 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1524 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:56.857646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:56.858268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:56.879114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.881655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.883467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.887171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.889027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.906308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.972658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:56.973963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:56.980335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.987717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.988440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:56.992304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:56.992998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:56.993653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:57.183532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:57.199676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:57.257723 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-180ab3f6-b2f7-47d0-9f0f-701da8d3316f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.289174 Sep 23 03:44:57.269407 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 851/1768] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:56 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:57.271071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:57.282054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:57.288787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:57.296383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:57.297020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:57.298077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:57.299176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:57.299863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:57.353157 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7598e109-bf3b-4398-81a5-aa41ade44073 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093215 Sep 23 03:44:57.354358 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 852/1769] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:44:57 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:44:57.669591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:57.670217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:57.682928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:57.683432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:57.683877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:57.684602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:57.685068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:57.691846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:57.891255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.904693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.919497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:44:57.927378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.930277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.934554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.937961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:57.944890 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e9f758f7-b096-4132-9243-97bfd9f92d2b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 1.090850 Sep 23 03:44:57.945548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 918/1770] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:56 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:57.951184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-918fdde8-d026-4656-9cde-f34d306c003d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1512 microversion: 2.91 time: 0.286631 Sep 23 03:44:57.951810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 853/1771] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:57 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:58.292980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:58.296547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:58.335694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:58.339401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:58.341599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:58.342622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:58.345303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:58.348565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:58.585190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:44:58.630505 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df553388-71a5-45cf-a279-a8b0abb4a3f3 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1927 microversion: 2.75 time: 0.345628 Sep 23 03:44:58.631116 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 919/1772] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:58 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1927 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:44:58.990855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:58.991733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:58.993162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:58.997234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:59.028599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.031601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.032128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.032880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.033431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.051791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.052343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.052847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.053212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.057664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.058246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.058714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.415241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:59.448651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:59.455047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:44:59.467884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b1b66493-5c4a-4071-8e27-83fa9f490c6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1512 microversion: 2.91 time: 0.484060 Sep 23 03:44:59.472107 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 920/1773] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:58 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:44:59.667723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:59.668391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:44:59.686588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.687089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.687596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.688325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:44:59.688814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:44:59.689286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:44:59.995933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.015728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.022315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.029413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97a8af9c-02e0-4b77-b04b-64bae8757aa3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 1.055031 Sep 23 03:45:00.054867 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 854/1774] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:58 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:00.061755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:00.125212 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-218a4762-6ad9-4657-9167-8e1ff34ae22f tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1933 microversion: 2.75 time: 0.454959 Sep 23 03:45:00.126405 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 921/1775] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:44:59 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1933 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:00.508180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:00.508956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:00.529917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:00.535749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:00.536359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:00.537154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:00.540643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:00.542253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:00.776806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.793209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.795047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:00.812870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06a4f7ed-cd8f-4278-9631-8e9b53d15186 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1533 microversion: 2.91 time: 0.308985 Sep 23 03:45:00.813999 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 855/1776] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:00 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1533 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:00.949968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:00.950700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:00.959193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:00.969139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:00.970555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:00.971289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:00.972436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:00.973120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:00.974345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.062621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:01.063947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:01.076268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.076779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.077415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.078138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.085582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.087805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.230065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lazy-loading 'services' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:01.300928 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7880b73c-7e97-47fb-84be-eb768d74a998 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1938 microversion: 2.91 time: 0.449335 Sep 23 03:45:01.303433 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 922/1777] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:00 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1938 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:01.308436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:01.309300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:01.317518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.318376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.319045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.320256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.321024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.322080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.598542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:01.645678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de6c0c44-5697-4516-92a6-0971c5470cf7 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1933 microversion: 2.75 time: 0.340417 Sep 23 03:45:01.648213 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 923/1778] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:01 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1933 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:01.656153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:01.657227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:01.667802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.668840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.669878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.671458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.672231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.673780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.718058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:01.741570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:01.764157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:01.765480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-032b8f5f-f06d-4c60-bb7e-4a81871b88c7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.709119 Sep 23 03:45:01.771673 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 856/1779] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:01 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:01.904412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lazy-loading 'services' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:01.949768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6a19280-eed9-4f3b-a9dc-68f654307c79 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1938 microversion: 2.91 time: 0.299390 Sep 23 03:45:01.951269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 924/1780] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:01 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1938 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:01.986926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:01.991021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.992379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.993221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:01.994244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:01.994879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:01.995483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.025754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2dc94cfc-6d0c-47c6-aa2b-11c48fbd44d7 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.042681 Sep 23 03:45:02.041885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:02.042824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:02.047869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 857/1781] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Sep 23 03:45:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:45:02.051007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.051751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.052441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.053422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.054102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.054751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.087186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lazy-loading 'flavor' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:02.578201 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ca92fe8-1399-40ff-a4c3-a76043c7f38d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action" status: 202 len: 0 microversion: 2.91 time: 0.540316 Sep 23 03:45:02.591308 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 925/1782] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:45:02 2022] POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:45:02.597198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:02.598012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:02.611935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.622343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.626313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.627646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.628385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.630653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.688559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:02.690735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:02.716928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.739220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.739890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.740680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.741166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.752509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.808473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:02.821916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:02.827482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:02.839497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f767fe5-6d8d-4952-b8dd-714607ec5ebf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.246477 Sep 23 03:45:02.849872 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 858/1783] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:02 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:02.881227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:02.888977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:02.907519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.909011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.909594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.913338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:02.914994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:02.916611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:02.961610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:03.034155 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fd1cf26-4287-4232-98ba-6ef20afec9eb tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1933 microversion: 2.75 time: 0.351913 Sep 23 03:45:03.037536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 926/1784] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:02 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1933 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:03.566840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:03.582278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:03.584481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:03.594436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad4b9043-3f22-49dc-b513-b3288d1d7943 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.727046 Sep 23 03:45:03.600565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 859/1785] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:02 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:03.888083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:03.888713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:03.901502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:03.904884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:03.905904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:03.909433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:03.914357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:03.927360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:04.072702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:04.073673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:04.084074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:04.092791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:04.093280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:04.093801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:04.094501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:04.095133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:04.096216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:04.096947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:04.115460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:04.122042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:04.146586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fb4e3d83-379b-44a1-9fa3-b5ea971131ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.264094 Sep 23 03:45:04.153312 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 927/1786] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:03 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:04.627213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:04.627749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:04.660350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:04.661897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:04.663174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:04.665550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:04.667153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:04.668379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:05.095554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:05.164704 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf3605fd-e53d-434b-9447-08e5af917584 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1933 microversion: 2.75 time: 1.096731 Sep 23 03:45:05.175477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 860/1787] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:04 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1933 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:05.187767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:05.188781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:05.215938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:05.223212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:05.226980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:05.230704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:05.231209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:05.239054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:05.423721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.442529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.450749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.458245 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3dc457bd-8bc5-4e5f-9eda-3df602ec1d57 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.274518 Sep 23 03:45:05.484618 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 861/1788] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:05 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:05.516465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.539071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.549552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:05.550864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd309e5e-b392-4357-a40d-a610bb69873b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.928523 Sep 23 03:45:05.588889 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 928/1789] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:04 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:06.214630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:06.215341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:06.229223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.229839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.230591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.233415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.234132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.234593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.434271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] Lazy-loading 'services' on Instance uuid 26a56987-ecff-43e1-88a6-f5a8a5788b1b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:06.456476 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30bf1495-4ea4-4872-88f6-3fc3a5970ed8 tempest-ServersAdmin275Test-1192433844 tempest-ServersAdmin275Test-1192433844-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1918 microversion: 2.75 time: 0.246619 Sep 23 03:45:06.473028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 862/1790] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:06 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1918 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:06.493272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:06.493960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:06.506502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.508071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.509379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.510955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.512511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.520766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:06.521713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:06.524966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.541702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.542887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.544411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.546922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.548804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.550129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.612450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:45:06.694159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:06.715165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:06.718441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:06.733038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a9381ef-5181-4c5a-9d67-8e44e78b616f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.244485 Sep 23 03:45:06.734933 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 929/1791] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:06 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:06.740425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:06.741399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:06.768485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.770220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.770987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.772022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:06.773462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:06.776374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:06.891205 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-651d6249-ee3c-4b55-94d3-332b2dd66438 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "DELETE /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 204 len: 0 microversion: 2.75 time: 0.373774 Sep 23 03:45:06.895734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 863/1792] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:45:06 2022] DELETE /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:45:06.910392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-102502534", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a9656976-8d77-4279-8610-e55efa6ecb74"}, {"uuid": "acd589aa-44b6-4837-9d0c-607a4776d7a5"}, {"uuid": "a9656976-8d77-4279-8610-e55efa6ecb74"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:06.999808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] validate_networks() for [('a9656976-8d77-4279-8610-e55efa6ecb74', None, None, None, None, None), ('acd589aa-44b6-4837-9d0c-607a4776d7a5', None, None, None, None, None), ('a9656976-8d77-4279-8610-e55efa6ecb74', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:45:07.498701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.510539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.523050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.524723 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0aec704a-6fd2-440d-b059-91544134f7ca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.788294 Sep 23 03:45:07.525584 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 930/1793] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:06 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:07.531347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:07.531974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:07.564410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:07.565885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:07.570380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:07.574974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:07.575921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:07.578182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:07.612252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:07.812695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.834142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.836187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:07.857872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d21bddde-121a-49c8-9b5f-a427e12b5f07 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1443 microversion: 2.75 time: 0.329992 Sep 23 03:45:07.859728 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 931/1794] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:07 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1443 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:07.868563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:07.869408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:07.879350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:07.880270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:07.881286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:07.883346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:07.884715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:07.887037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:08.028147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:08.076947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:08.078204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:08.102633 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8b21cc5a-14a9-4f0d-a850-bb36cf7ab1f4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.239309 Sep 23 03:45:08.103752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 932/1795] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:07 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:08.559885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:08.561534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:08.586709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:08.587786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:08.587993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:08.588763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:08.589255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:08.598088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:09.172447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.182177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.189765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.193629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0029d1f4-7e29-4f04-9f03-f6a31089d885 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.642284 Sep 23 03:45:09.202527 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 933/1796] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:08 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:09.210355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:09.212192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:09.236776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:09.237641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:09.238217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:09.238809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:09.241445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:09.241988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:09.477473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.500348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.505617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352b37d7c729462ea9bc9a6689e9f4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4a0449c7b043fc9890906ccd51a550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:09.521687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be432f66-c9e7-4a57-992e-3c89b84429d6 tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 200 len: 1443 microversion: 2.75 time: 0.309022 Sep 23 03:45:09.529574 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 934/1797] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:09 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 1443 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:09.541526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:09.542477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:09.562773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:09.570982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:09.572192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:09.573541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:09.574279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:09.575102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:10.402235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:10.412732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:10.417032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:10.424867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee717dea-7748-4e65-9403-a9976b875f08 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.893069 Sep 23 03:45:10.426533 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 935/1798] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:09 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:10.442282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:10.443288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:10.452416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:10.454010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:10.472719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:10.474447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:10.480198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:10.487642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.355843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:45:11.356244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:45:11.356658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:45:11.357251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:45:11.357987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:45:11.389271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.391169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.391592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.397289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.402537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.403025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.458786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Getting quotas for project 2678db4b110743488fc73b3aa6b2f436. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:45:11.476270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Getting quotas for user 1d5dafda6670418da408ba0a18e567ba and project 2678db4b110743488fc73b3aa6b2f436. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:45:11.505051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:11.521764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:11.522142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:45:11.524822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:11.529898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19228c49-dd7f-4332-b76d-2fc5763ce1f0 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 1.100263 Sep 23 03:45:11.530649 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 936/1799] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:10 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:11.531670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:45:11.541432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:11.542227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] [instance: 26a56987-ecff-43e1-88a6-f5a8a5788b1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:11.562211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.564982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.566665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.568874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.572146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.573771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.621115 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] HTTP exception thrown: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Request method failure captured: Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b HTTP/1.1 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLStie_vYbWGFCbVrXRlcLoYmvnm1lspadEao8O4st5Y59WLZ8dGJYsqKrB82dA2PCcJ_yh-pXPJ-Zu-kAFlU3Uc3Ke3zAvWsa7ivsl4KTzJ7g8HyLhN56YhHyfX-GKPw8qkXXUAguaScn1lD3zs5XBmqQvpWIMnKNJ_A8JMSJMRxJSc Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.75 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2e4a0449c7b043fc9890906ccd51a550 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersAdmin275Test-86673169 Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:45:11.633293 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e4a0449c7b043fc9890906ccd51a550"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e4a0449c7b043fc9890906ccd51a550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e4a0449c7b043fc9890906ccd51a550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e4a0449c7b043fc9890906ccd51a550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersAdmin275Test-86673169 Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2e4a0449c7b043fc9890906ccd51a550 Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersAdmin275Test-86673169 Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersAdmin275Test-86673169-project Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 352b37d7c729462ea9bc9a6689e9f4c5 Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersAdmin275Test-86673169-project Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. Sep 23 03:45:11.635493 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '26a56987-ecff-43e1-88a6-f5a8a5788b1b'} Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:11.636423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. Sep 23 03:45:11.639492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:11.646634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] Returning 404 to user: Instance 26a56987-ecff-43e1-88a6-f5a8a5788b1b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:11.648877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c273b46d-1440-4229-b336-8ad91548311b tempest-ServersAdmin275Test-86673169 tempest-ServersAdmin275Test-86673169-project] 10.222.0.25 "GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b" status: 404 len: 111 microversion: 2.75 time: 0.116167 Sep 23 03:45:11.650912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 937/1800] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:11 2022] GET /compute/v2.1/servers/26a56987-ecff-43e1-88a6-f5a8a5788b1b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:11.665726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:11.667887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:11.677663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85390289-dd96-4a09-9862-68ad9959c9c0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.778612 Sep 23 03:45:11.686925 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 864/1801] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:45:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:45:11.694984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e16d3f6a-056b-455f-bc51-000f403802ba tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:11.695627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e16d3f6a-056b-455f-bc51-000f403802ba tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:11.700633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.701148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.701629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:11.702391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:11.702854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:11.703285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:12.280134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e16d3f6a-056b-455f-bc51-000f403802ba tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:12.292332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:12.303529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:12.307651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e16d3f6a-056b-455f-bc51-000f403802ba tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1212 microversion: 2.1 time: 0.617803 Sep 23 03:45:12.311834 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 865/1802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:11 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1212 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:12.317283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:12.347995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c576bb77-6b73-4655-af7e-426ae7b50841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.695713 Sep 23 03:45:12.350562 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 938/1803] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:11 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:12.566437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:12.567885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:12.590717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:12.591497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:12.592263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:12.594357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:12.595668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:12.597884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.281554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.303626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.317577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.319260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-805ed424-7848-49f4-926c-2bba4b817348 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.758701 Sep 23 03:45:13.320103 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 866/1804] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:12 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:13.345619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:13.346883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:13.361099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:13.364154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:13.365268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.368935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:13.371917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:13.380494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:13.382311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:13.389548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.397575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:13.412598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:13.413395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.414404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:13.415059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:13.415689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.660950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.675100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.681065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.693942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-359bcf7d-6021-4727-8990-a42e9aa38e6c tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.317934 Sep 23 03:45:13.698480 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 867/1805] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:13 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:13.718290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e", "name": "network-vif-unplugged", "status": "completed", "tag": "9730b0c2-cb90-4b63-8ff8-66652f9cec25"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:13.718645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:13.733684 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a43dfee-a886-4146-8307-d6192be9bc01 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1208 microversion: 2.1 time: 0.393158 Sep 23 03:45:13.737702 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 939/1806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:13 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1208 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:13.746402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:13.749144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:13.750121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:13.769123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:13.772715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] Creating event network-vif-unplugged:9730b0c2-cb90-4b63-8ff8-66652f9cec25 for instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e on n-h2-858495-2 Sep 23 03:45:13.780603 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bdecbcdc-8c47-4158-992a-9c6502a71e0e req-12b3f57c-73fc-4508-912c-4cc8aef067eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080572 Sep 23 03:45:13.782096 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 868/1807] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:14.353278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:14.354662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:14.373330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:14.376781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:14.378294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:14.381056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:14.382187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:14.385205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:14.737149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:14.737897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:14.765727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:14.769405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:14.769913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:14.772503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:14.773011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:14.773520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:15.063367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.063575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.091383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.093297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.098480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.100229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.102219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f84410e-59b1-419d-94c1-4b127542adac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.753453 Sep 23 03:45:15.106608 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 940/1808] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:14 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:15.128712 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f56fff9-d7ec-4743-9598-9e5534e5afbd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.400289 Sep 23 03:45:15.133310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:15.136773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:15.146280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 869/1809] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:14 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:15.162242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:15.165158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:15.166578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:15.168188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:15.170780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:15.175072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:15.416758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:15.429143 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f1eb821-4572-4073-94a3-89446c36cdc7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1270 microversion: 2.1 time: 0.318559 Sep 23 03:45:15.437567 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 941/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:15 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:15.820831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e", "tag": "9730b0c2-cb90-4b63-8ff8-66652f9cec25"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:15.836308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:15.837516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:15.838941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:15.864148 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] Creating event network-changed:9730b0c2-cb90-4b63-8ff8-66652f9cec25 for instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e on n-h2-858495-2 Sep 23 03:45:15.874515 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-97952421-a477-4e3b-b4da-1b3a1fbbbecd req-4281343a-471a-4a7d-9067-05b70ab179e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057357 Sep 23 03:45:15.877284 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 870/1811] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:16.133395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:16.134016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:16.157098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:16.165718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:16.166944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:16.175545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:16.180848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:16.182001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:16.183049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:16.186806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:16.187868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:16.191191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:16.196479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:16.197603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:16.199691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:16.205450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:16.928641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:16.962719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:16.970971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:16.996426 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c04706b-1f98-4961-a09c-0feeffa2e7bd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.832592 Sep 23 03:45:17.001145 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 871/1812] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:16 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:17.026451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:17.045461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:17.080708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:17.083109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:17.086306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:17.106674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:17.107984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:17.111931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:17.302696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:17.330850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:17.335402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:17.339961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9044d7a6-b91d-4a5d-928f-b8ecb5986555 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 1.209772 Sep 23 03:45:17.345986 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 942/1813] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:16 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:17.670367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:17.690827 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c219fe9-d405-412e-b0cd-1531771c7786 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1312 microversion: 2.1 time: 0.686724 Sep 23 03:45:17.691896 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 872/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:17 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:18.034064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:18.035112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:18.065439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.066173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.069465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:18.072887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.073739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.077391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:18.295723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:18.331039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:18.345790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:18.365246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5ebca76-f215-49ff-8d8a-47e55f86516f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.338872 Sep 23 03:45:18.378147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:18.379779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:18.388114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 943/1815] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:18 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:18.401979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.405991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.406710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:18.407703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.409940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.411034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:18.719021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:18.720636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:18.733050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.736500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.737725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:18.741946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:18.742681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:18.743321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:19.172431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.184041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.188526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.190414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bda389e9-69af-45ee-b47a-cbe43d3ef670 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.818117 Sep 23 03:45:19.208179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 873/1816] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:18 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:19.427488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:19.429968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:19.443449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:19.446774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:19.447548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:19.453542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:19.456347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:19.457906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:19.482060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.493158 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fe83c52-884d-4f1f-b6a1-cbdc6014e8da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1333 microversion: 2.1 time: 0.778500 Sep 23 03:45:19.521692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 944/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:18 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1333 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:45:19.654412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.688014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.690427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:19.717135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24a11258-1b8f-4b88-822a-b2d614c7f0e1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.302057 Sep 23 03:45:19.721966 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 874/1818] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:19 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:20.225787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:20.226642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:20.239460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:20.245663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:20.246491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:20.254478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:20.255802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:20.274685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:20.527225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:20.527904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:20.575004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:20.606670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:20.607706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:20.608800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:20.614062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:20.621165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:20.626192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:20.910263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:20.921805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:20.923329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:20.941795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c882f12d-22fa-434b-95d7-f9b83214f0f7 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.720905 Sep 23 03:45:20.946197 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 945/1819] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:20 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:20.951779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:20.958001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:20.999131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.002793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.003861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.006200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.008496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.010568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.326041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:21.339636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:21.351776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:21.373526 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51c80976-a6a0-49e9-ac10-9ab34b483a07 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.425822 Sep 23 03:45:21.374129 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 946/1820] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:20 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:21.435436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:21.664670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Action: 'update', calling method: .version_select at 0x7f0c933584c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:21.671843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.672564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.673193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.698532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.699017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.701527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.722778 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] HTTP exception thrown: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Request method failure captured: Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 HTTP/1.1 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 56 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvQT_HNSBkXsgo56ndBZYLUcIjVuYaCLGjxnP3xyRmenSBozkzp0MRTP61inN_xr5o6SRKNZnrIl-BC_AVp0IJkDmOq-ETN_ksMSJtf9HIo3yhcMt2viq-NjwsukSn3s4rMWx29Au62ewMwubkDPJFYbtu3d5M6cnShQKAj4Pda5To Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:45:21.724701 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23aedecec5f450a9b01840dbd295959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2ea604bcc1fd4b0d8066ca10b9b07be6 Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:45:21.726499 n-d-858495-2 devstack@n-api.service[128724]: exception: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'bd503ad1-26f9-4c9e-b39e-a694456b67a9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.727488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.728971 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:21.730417 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:21.730417 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.730417 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.735168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Returning 404 to user: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:21.736353 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4547fee3-6d92-435a-b9d1-67c1b1734349 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9" status: 404 len: 110 microversion: 2.53 time: 0.359533 Sep 23 03:45:21.738171 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 947/1821] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Sep 23 03:45:21 2022] PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 => generated 110 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:21.755494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Action: 'update', calling method: .version_select at 0x7f0c934243a0>, body: {"status": "disabled"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:21.760675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.771447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.772403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.785988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.786663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.787281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.802872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] HTTP exception thrown: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Request method failure captured: Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 HTTP/1.1 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 22 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvQT_HNSBkXsgo56ndBZYLUcIjVuYaCLGjxnP3xyRmenSBozkzp0MRTP61inN_xr5o6SRKNZnrIl-BC_AVp0IJkDmOq-ETN_ksMSJtf9HIo3yhcMt2viq-NjwsukSn3s4rMWx29Au62ewMwubkDPJFYbtu3d5M6cnShQKAj4Pda5To Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:45:21.806508 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23aedecec5f450a9b01840dbd295959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2ea604bcc1fd4b0d8066ca10b9b07be6 Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: {"status": "disabled"} Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: exception: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.808375 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'bd503ad1-26f9-4c9e-b39e-a694456b67a9', 'body': {'status': 'disabled'}} Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.809562 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:21.815786 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:21.817524 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.817524 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.817524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Returning 404 to user: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:21.817524 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-477138b1-c234-4c50-be1e-92e4e8d47432 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9" status: 404 len: 110 microversion: 2.53 time: 0.066537 Sep 23 03:45:21.817524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 948/1822] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Sep 23 03:45:21 2022] PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:21.823661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8aa3fd30>, body: {"status": "enabled"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:21.830510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.834391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.834859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.847503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.850146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.850628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.858397 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] HTTP exception thrown: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Request method failure captured: Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 HTTP/1.1 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 21 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvQT_HNSBkXsgo56ndBZYLUcIjVuYaCLGjxnP3xyRmenSBozkzp0MRTP61inN_xr5o6SRKNZnrIl-BC_AVp0IJkDmOq-ETN_ksMSJtf9HIo3yhcMt2viq-NjwsukSn3s4rMWx29Au62ewMwubkDPJFYbtu3d5M6cnShQKAj4Pda5To Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 03:45:21.860486 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d23aedecec5f450a9b01840dbd295959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d23aedecec5f450a9b01840dbd295959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d23aedecec5f450a9b01840dbd295959 Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858 Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 2ea604bcc1fd4b0d8066ca10b9b07be6 Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: {"status": "enabled"} Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: exception: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.862089 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'bd503ad1-26f9-4c9e-b39e-a694456b67a9', 'body': {'status': 'enabled'}} Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.863055 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:21.864997 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:21.868530 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. Sep 23 03:45:21.868530 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:21.868530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Returning 404 to user: Service bd503ad1-26f9-4c9e-b39e-a694456b67a9 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:21.868993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8894f018-1f96-4b60-a7f6-8f9236438b9c tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9" status: 404 len: 110 microversion: 2.53 time: 0.052077 Sep 23 03:45:21.869470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 949/1823] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Sep 23 03:45:21 2022] PUT /compute/v2.1/os-services/bd503ad1-26f9-4c9e-b39e-a694456b67a9 => generated 110 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:21.879204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:21.883828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.884792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.885556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.886575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.887274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.887950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.921250 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfbd446b-a304-4b4f-924e-2fe34185e79e tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046473 Sep 23 03:45:21.922770 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 950/1824] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Sep 23 03:45:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:21.936530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:21.943735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.947916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.948380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:21.952645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:21.953175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:21.953736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.045823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c625199f-0784-43d7-895e-ceb77d5e296b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.113786 Sep 23 03:45:22.046819 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 951/1825] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Sep 23 03:45:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:45:22.063859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.064977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:22.082404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.082933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.085385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.086932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.087422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.091581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.098079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:22.316564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:22.354536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.382753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-077a376e-8f84-4655-8b5c-442a8d9046ad tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1333 microversion: 2.1 time: 1.869566 Sep 23 03:45:22.387883 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 875/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:20 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1333 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:22.419720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.428020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.431051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.431711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.433891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.434591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.435395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.509380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11996a1a-b747-4e6e-a848-1eb7d5bbde7b tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.101625 Sep 23 03:45:22.521454 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 876/1827] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:22.530805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.535598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:22.550888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.553403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.554241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.556352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.557068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.558812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.597886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.608840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.614208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.615437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b986c15-54ed-4447-8c61-90ac78e8b53b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.567458 Sep 23 03:45:22.619906 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 952/1828] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:22.629701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.655184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.655693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.656139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.658622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.659100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.659534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.754529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83757bbe-8a06-442f-b2b3-b079bb36a114 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858495-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.132208 Sep 23 03:45:22.756038 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 953/1829] 10.222.0.25 () {60 vars in 1235 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/os-services?host=n-d-858495-2&binary=xxx => generated 16 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:22.768368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.781795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.782448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.782897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.783647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.786410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.787197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.808551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.826563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.829837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:22.843532 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e82a2502-6f9d-4527-b68d-63da373e09c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.320456 Sep 23 03:45:22.846093 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 877/1830] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:22.856199 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e4543bf-479b-4270-988e-c5898306200f tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.091785 Sep 23 03:45:22.860781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 954/1831] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:22.872026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:22.880392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.883272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.883965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.884991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:22.885870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:22.889101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:22.962464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f96e7467-08d4-43ba-ba14-afd9ab2c4f92 tempest-ServicesAdminNegativeV253TestJSON-408393858 tempest-ServicesAdminNegativeV253TestJSON-408393858-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.095291 Sep 23 03:45:22.963064 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 878/1832] 10.222.0.25 () {60 vars in 1239 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:23.244584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5183b525-f29d-416f-af36-ac84fa493cf8 tempest-ServicesAdminNegativeV253TestJSON-2099865796 tempest-ServicesAdminNegativeV253TestJSON-2099865796-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:23.255963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5183b525-f29d-416f-af36-ac84fa493cf8 tempest-ServicesAdminNegativeV253TestJSON-2099865796 tempest-ServicesAdminNegativeV253TestJSON-2099865796-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a3b1298648ed42558fd755dbbaebf1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d15752f236b4f76ab0819a412944cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5183b525-f29d-416f-af36-ac84fa493cf8 tempest-ServicesAdminNegativeV253TestJSON-2099865796 tempest-ServicesAdminNegativeV253TestJSON-2099865796-project] Request method failure captured: Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvP9CzaTAzMxzgnS5csy5sJ_kEwrvEoq4p8e-no9tckya0dCGcwqCXyFkBrCTluLHdi7ZZQG19eHCcCFlN-9S_KlFbGl5zMPlhjP2N169XWVqMweNsa2Bu8nCSd8qK41NJRAljHmZkdsFyd4tK-qTEqnRUL7EWFE73tJx4CZfZRE9M Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0d15752f236b4f76ab0819a412944cd9 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2099865796 Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:45:23.268647 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d15752f236b4f76ab0819a412944cd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d15752f236b4f76ab0819a412944cd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d15752f236b4f76ab0819a412944cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d15752f236b4f76ab0819a412944cd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2099865796 Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0d15752f236b4f76ab0819a412944cd9 Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2099865796 Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2099865796-project Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a3b1298648ed42558fd755dbbaebf1bf Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2099865796-project Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:45:23.270370 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 03:45:23.271632 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 03:45:23.272990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:23.276787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5183b525-f29d-416f-af36-ac84fa493cf8 tempest-ServicesAdminNegativeV253TestJSON-2099865796 tempest-ServicesAdminNegativeV253TestJSON-2099865796-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:23.276787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5183b525-f29d-416f-af36-ac84fa493cf8 tempest-ServicesAdminNegativeV253TestJSON-2099865796 tempest-ServicesAdminNegativeV253TestJSON-2099865796-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.298387 Sep 23 03:45:23.276787 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 955/1833] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Sep 23 03:45:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 300 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:23.420424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:23.421794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:23.438839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:23.440671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:23.441194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:23.442291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:23.445997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:23.446795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:23.651326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:23.651948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:23.670904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:23.671416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:23.677493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:23.681879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:23.683821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:23.684577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:24.453484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.461810 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d0fa2ea-667d-49f7-b2ef-abb044f4a888 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 1.049533 Sep 23 03:45:24.462394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 879/1834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:23 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:24.491687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:24.492307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:24.510887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:24.511409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:24.511853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:24.512565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:24.513229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:24.513728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:24.611677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.637461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.639008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.640225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-883ca28c-a081-4f6b-9ace-17bbd6f3fe91 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.995646 Sep 23 03:45:24.640767 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 956/1835] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:23 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:24.752496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.769110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.770978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:24.783856 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-318994ab-3b01-4fad-b1f5-af363907dce0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.301471 Sep 23 03:45:24.788504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 880/1836] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:24 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:24.942795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46587cf4-7cec-4e1b-9628-d871fb18d976 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Action: 'create', calling method: .version_select at 0x7f0c8b0b3790>, body: {"pool": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:25.487516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:25.488321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:25.498596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:25.501105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:25.502055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:25.503095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:25.504343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:25.505039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:25.978372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:25.989509 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b52637c-b69a-4ea7-9024-ea0d4b79de95 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.508578 Sep 23 03:45:25.993824 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 881/1837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:25 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:45:26.005138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:26.007405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:26.026916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:26.028148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:26.028901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:26.032102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:26.032858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:26.033583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:26.491507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.501742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.508633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.513808 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14f74f0e-8621-4280-ab68-70b9d34b9b08 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1485 microversion: 2.25 time: 0.518508 Sep 23 03:45:26.514654 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 882/1838] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:25 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1485 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:26.529546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:26.530399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:26.542057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:26.542976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:26.543657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:26.544761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:26.548204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:26.548930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:26.721987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.743006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.747555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:26.754257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1efa4cde-78e7-4ca5-b0cf-89359b906b45 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.237863 Sep 23 03:45:26.756208 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 883/1839] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:26 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:27.016977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "tag": "9c42b5a2-79b6-49ec-92e8-f17429e4c06c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:27.070554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:27.073424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:27.079777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:27.126315 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] Creating event network-changed:9c42b5a2-79b6-49ec-92e8-f17429e4c06c for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:45:27.144267 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d0fa46a1-4a1f-4939-9522-9807f430ab9c req-e53b81d2-ec94-4f70-a1bd-6b0ffdfd8a5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130787 Sep 23 03:45:27.159302 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 884/1840] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:27.190235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:27.197018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:27.234504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:27.239450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:27.240876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:27.242150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:27.249696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:27.251277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:29.624802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:29.639168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37cbf6af-ee4e-4583-84bd-41606f716f65 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 2.475721 Sep 23 03:45:29.641654 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 885/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:27 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:29.671410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:29.672315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:29.696079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:29.698903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:29.699802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:29.702945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:29.703986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:29.709615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:30.637515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:30.661757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:30.663653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:30.668476 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38919a1c-6475-46e1-8458-db34f8a01c86 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1475 microversion: 2.25 time: 1.024763 Sep 23 03:45:30.669340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 886/1842] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:29 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1475 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:30.687181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:30.690869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:30.714704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:30.715643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:30.716294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:30.717627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:30.718323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:30.719522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:31.034641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:31.055949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:31.067118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:31.087292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2239009-f91a-4b97-862c-a2328e0a0cae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1560 microversion: 2.91 time: 0.414501 Sep 23 03:45:31.112299 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 887/1843] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:30 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1560 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:31.117496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:31.123033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:31.138906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:31.140282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:31.141614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:31.144764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:31.149056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:31.151164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:31.176670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:31.942379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46587cf4-7cec-4e1b-9628-d871fb18d976 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.294456 Sep 23 03:45:31.943783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 957/1844] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:45:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:31.949486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d71437d8-6455-485b-9a0c-39038cfdc3d2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '.version_select at 0x7f0c93378940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:31.993539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71437d8-6455-485b-9a0c-39038cfdc3d2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:31.994090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71437d8-6455-485b-9a0c-39038cfdc3d2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:31.997988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71437d8-6455-485b-9a0c-39038cfdc3d2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:31.999624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:32.013446 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d42e3670-d90d-41c9-a926-c58d9115c5b5 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.898234 Sep 23 03:45:32.029416 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 888/1845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:31 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:32.038855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b503df5c-f403-41cf-ae51-0321354eea81 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c934a9430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:32.043089 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d71437d8-6455-485b-9a0c-39038cfdc3d2 tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2958 microversion: 2.25 time: 0.098132 Sep 23 03:45:32.053895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 958/1846] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Sep 23 03:45:31 2022] GET /compute/v2.1/os-migrations => generated 2958 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:32.073058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:32.075300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:32.094887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:32.101534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:32.102608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:32.106999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:32.108336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:32.110826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:32.111546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:32.671159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b503df5c-f403-41cf-ae51-0321354eea81 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/7af2ad4e-4c23-4f27-ab27-3e91daa23ead" status: 200 len: 141 microversion: 2.1 time: 0.649558 Sep 23 03:45:32.671800 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 889/1847] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:45:32 2022] GET /compute/v2.1/os-floating-ips/7af2ad4e-4c23-4f27-ab27-3e91daa23ead => generated 141 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:32.676862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:32.677812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:32.696070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:32.714444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:32.715324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:32.716507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:32.717217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:32.717926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:32.812593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:32.904550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] Lazy-loading 'services' on Instance uuid d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:45:32.919841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:32.930243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a414b2ba-7a02-4bb7-ac65-a3e3f80aedef tempest-LiveAutoBlockMigrationV225Test-1044630973 tempest-LiveAutoBlockMigrationV225Test-1044630973-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1967 microversion: 2.25 time: 0.863694 Sep 23 03:45:32.940729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 959/1848] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:32 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1967 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:32.955724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "tag": "462decee-948f-465e-bff4-c6cb3db808fa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:32.998510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:32.999310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:33.000738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:33.039447 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] Creating event network-changed:462decee-948f-465e-bff4-c6cb3db808fa for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:45:33.055873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-af6d775d-2c14-4007-97d7-66a64e7c1092 req-333c341c-c71a-404d-b63f-458dca6b3dc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108345 Sep 23 03:45:33.066541 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 960/1849] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:33.088539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a354d338-125d-4397-999b-ebc0c8497ade tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c934015e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:33.338388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:33.359178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:33.365864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:33.379127 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bcadd2b9-f925-4a90-840a-74d0b6a1c0c3 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.706014 Sep 23 03:45:33.381922 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 890/1850] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:32 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:33.394905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:33.397420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:33.411544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:33.413442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:33.414647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:33.416804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:33.418162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:33.420818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:33.522200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:45:33.690728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1c92beb-62c6-4b4a-a654-2c5d4020e2f2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 204 len: 0 microversion: 2.25 time: 0.307086 Sep 23 03:45:33.692280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 891/1851] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:45:33 2022] DELETE /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:45:33.701426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:33.702735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:33.726325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:33.727700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:33.728807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:33.731283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:33.732417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:33.734470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:34.869946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:34.885095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0971f9e2-a803-4e32-81b0-fc7b4d7d20b3 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 1.186485 Sep 23 03:45:34.901199 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 892/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:33 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:34.967642 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a354d338-125d-4397-999b-ebc0c8497ade tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.899435 Sep 23 03:45:34.968856 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 961/1853] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:45:33 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:34.973730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:34.974698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:34.993444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:34.994188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:34.994920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:34.995839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:34.997783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:34.999164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:35.207727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1936668583", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "408d828c-53fb-45a4-8e7a-9fdf28c75147"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:35.335185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] validate_networks() for [('408d828c-53fb-45a4-8e7a-9fdf28c75147', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:45:35.403135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:35.420961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:35.425997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:35.427989 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-11742b55-b2cc-405a-9018-2e675f5a5e2e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1481 microversion: 2.25 time: 0.457994 Sep 23 03:45:35.431520 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 962/1854] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:34 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1481 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:35.483039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1081694706", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a1aece03-8cc5-4dd7-a1d8-55f60f30a37a"}], "block_device_mapping_v2": [{"uuid": "165481a7-27f6-47da-bdc6-2de5e7cdbd47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:35.655676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] validate_networks() for [('a1aece03-8cc5-4dd7-a1d8-55f60f30a37a', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:45:37.180044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:45:37.185437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:45:37.186206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:45:37.186856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:45:37.188110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:45:37.207581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.212144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.212737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.214882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.216237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.220381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.248777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Getting quotas for project b485f12af57540f1a70b1e77abb43552. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:45:37.260258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Getting quotas for user 199e61a016b843f59b611324801381c6 and project b485f12af57540f1a70b1e77abb43552. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:45:37.288321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:45:37.299292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:45:37.392783 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48038eae-6a80-4a73-959c-1596da46778c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.500252 Sep 23 03:45:37.393980 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 893/1855] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:45:37.401547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:37.402754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:37.414296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.415494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.416086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.416975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.417913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.418761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.594058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:45:37.594586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:45:37.595841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:45:37.595841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:45:37.596582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:45:37.636692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.644236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.650808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.658252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:37.660672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:37.665015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:37.671155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:37.695993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:37.710771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:37.740813 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95e8fe44-619c-4fdb-882c-66c356267731 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.345338 Sep 23 03:45:37.745744 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 894/1856] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:37 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:37.758109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a78670bf-1bd2-4500-b88a-86be8e16180c tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c934a90d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:37.828844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:45:37.855709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Getting quotas for user 27045855dd484c7fbcbb75721afdcc9a and project ff4213ec46984d8fa9da47e40ede88ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:45:38.234076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:45:38.237881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='165481a7-27f6-47da-bdc6-2de5e7cdbd47',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:45:38.689001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc8c7736-713c-46c7-9f15-da097dfe703e tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.222894 Sep 23 03:45:38.691814 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 963/1857] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:45:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:45:38.707861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:38.708968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:38.717057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:38.718205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:38.718970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:38.721378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:38.722361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:38.723068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:40.135210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:40.161443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-394779e5-03b9-4500-8f21-87f2a151b94a tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 1.459589 Sep 23 03:45:40.165859 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 964/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:38 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:40.223137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "tag": "2d71d408-980a-4f99-9697-1eedcf7c3430"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:40.302220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:40.302972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:40.303522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:40.319231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] Creating event network-changed:2d71d408-980a-4f99-9697-1eedcf7c3430 for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:45:40.337104 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6451b5c3-5ead-454c-81a6-058be8cc8c8b req-5eee2949-6e64-43e9-bc21-b0b9fb0acdcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164846 Sep 23 03:45:40.338602 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 965/1859] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:40.350976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:40.355675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:40.397816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:40.399449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:40.401171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:40.406479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:40.410022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:40.417639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:40.690224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:40.722350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:40.726304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:40.736473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-326b77be-a7b4-432f-acd6-213ad7b3ebec tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1265 microversion: 2.25 time: 0.394292 Sep 23 03:45:40.737820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 966/1860] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:40 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:40.747212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:40.748315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:40.762327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:40.765717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:40.766585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:40.768031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:40.769896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:40.772873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:41.070091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:41.081664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07711cf5-af9d-4272-a8da-d496eca3089e tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1276 microversion: 2.1 time: 0.342334 Sep 23 03:45:41.082944 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 967/1861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:40 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:41.106251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e", "name": "network-vif-deleted", "tag": "9730b0c2-cb90-4b63-8ff8-66652f9cec25"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:41.150740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:41.151480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:41.151734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:41.220140 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] Creating event network-vif-deleted:9730b0c2-cb90-4b63-8ff8-66652f9cec25 for instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e on n-h1-858495-2 Sep 23 03:45:41.250958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6ddba60b-cded-4c5b-95f8-a1d07f00f3a7 req-ed095986-3d3f-4b6a-b2ae-bd95b6ed0210 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165166 Sep 23 03:45:41.255099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 968/1862] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:41.273578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:41.286452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:41.314199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:41.314725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:41.315191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:41.315942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:41.326058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:41.328182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:41.971060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:41.987908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-065c7c96-8962-4b1d-9bd0-8f90c6b578a4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1151 microversion: 2.1 time: 0.730661 Sep 23 03:45:41.988561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 969/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:41 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1151 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:42.006467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:42.007394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:42.035752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.040758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.040758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:42.046626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.048012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.051650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:42.236349 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a78670bf-1bd2-4500-b88a-86be8e16180c tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/7af2ad4e-4c23-4f27-ab27-3e91daa23ead" status: 202 len: 0 microversion: 2.1 time: 4.488935 Sep 23 03:45:42.241786 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 895/1864] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:45:37 2022] DELETE /compute/v2.1/os-floating-ips/7af2ad4e-4c23-4f27-ab27-3e91daa23ead => generated 0 bytes in 4495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:45:42.253676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:42.254313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:42.300066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.303705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.304452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:42.305511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.306170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.306812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:42.363522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:42.382149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:42.391411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:42.422335 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5e3e269-38c8-4f02-aca8-363fce5dab8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.423939 Sep 23 03:45:42.425754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 970/1865] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:41 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:42.466838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:42.470981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:42.506466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.510281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.514600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:42.519878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:42.534851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:42.537979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:43.423573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:43.432995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:43.439804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:43.442582 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5dad2ec7-bf75-47da-9e41-7df495481c4c tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1265 microversion: 2.25 time: 1.014651 Sep 23 03:45:43.444451 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 971/1866] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:42 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1265 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:43.453555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:43.461511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:43.481798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:43.483225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:43.483985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:43.485023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:43.487010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:43.489773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:44.404457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:44.417225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8cc58d2-0381-4dc8-898d-b94057b0d448 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1282 microversion: 2.1 time: 0.967962 Sep 23 03:45:44.426046 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 972/1867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:43 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1282 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:44.431599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98de73ae-2fc3-4d39-973a-e3e63c3874a1 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Action: 'create', calling method: .version_select at 0x7f0c93378ca0>, body: {"pool": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:45.023920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:45.048188 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbc96a5b-3531-4eef-8d6f-8067f5e25f1d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 2.804646 Sep 23 03:45:45.049084 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 896/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:42 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 2807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:45.054511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:45.055464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:45.062984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:45.063817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:45.064502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:45.065621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:45.066956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:45.067643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.365945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.390905 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ee04ba2d-1827-4279-ade1-b19ba407f244 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 1.339919 Sep 23 03:45:46.391529 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 897/1869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:45 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:46.410116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:46.410990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:46.448370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.450002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.452523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.453534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.455219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.459542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.612256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.621728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.633704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.651655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d3ab0fa-9272-49d6-9109-c2c769d177c2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.258999 Sep 23 03:45:46.657492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 898/1870] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:46 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:46.679671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:46.680317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:46.692628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.693135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.693598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.698930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.702055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.702643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.850746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.871505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.874024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:46.875545 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54dc5de0-641f-4d8b-acd7-d932827f35b2 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 200 len: 1265 microversion: 2.25 time: 0.215507 Sep 23 03:45:46.878642 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 899/1871] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:46 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:46.884224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:46.885176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:46.892701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.893884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.894532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:46.895443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:46.896095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:46.896720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:47.017061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:47.083482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-92bf99b5-697c-47b2-8a79-2ae54395fb1c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1282 microversion: 2.1 time: 0.193414 Sep 23 03:45:47.086875 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 900/1872] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:46 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:47.233790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:47.239457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1988631566", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1896f5f0-54eb-42f5-b3a9-0accb590ad4a"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:47.302522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:47.399988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] validate_networks() for [('1896f5f0-54eb-42f5-b3a9-0accb590ad4a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:45:47.754904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:47.890584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:48.635751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:45:48.636254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:45:48.636679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:45:48.637105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:45:48.637573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:45:48.660033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:48.661251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:48.662498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:48.663661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:48.667100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:48.667850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:48.717777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:45:48.733070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for user 20166e829a544516a4adcdd3e0a4945e and project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:45:48.768576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:45:48.772790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:45:48.807757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:48.868176 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe624813-4f84-4424-9502-e3a56689f97c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779165 Sep 23 03:45:48.869441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 901/1873] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:45:48.878478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:48.881774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:48.898954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:48.899761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:48.900394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:48.901309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:48.901977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:48.902736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:49.439758 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98de73ae-2fc3-4d39-973a-e3e63c3874a1 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.011708 Sep 23 03:45:49.440477 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 973/1874] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:45:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:49.448055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:49.449854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:49.478676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:49.507882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:49.508795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:49.510638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:49.513766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:49.514567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:49.742954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:49.760027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4cf9721b-b1e4-468e-834d-5cdb4975004d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.889230 Sep 23 03:45:49.767450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 902/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:48 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:49.772769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:49.786642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:49.797468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:49.804977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:49.809791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:49.810652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:49.811146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:49.811632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.341707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:50.361395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:50.366525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:50.382531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ac0e8c2-63a5-470f-8c6f-0b7d2a5594a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.605746 Sep 23 03:45:50.393386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 903/1876] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:49 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:50.393386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:50.393386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:50.412202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.413465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.415622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.416616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.419463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.424979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.457643 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] HTTP exception thrown: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Request method failure captured: Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e HTTP/1.1 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSo55tvbDpBvXzkjb2kSzAIbus30A_U8vz3l1hkvXEtPBT0PX1Drx5gK6G9wSn8ZrfBTYzpAlDMJRYaPElfdd8Q33iKRv_03hHMhbD7PHVLlqzDKvkpdDCYVErkbIwh4nuOM777IrH_cUayDGDta4o3ERALPL9Z0BNlh5EDpk0ma634 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:45:50.470480 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28c366e7ad9146d09218783c948d17db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28c366e7ad9146d09218783c948d17db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9855cf6129a34302a7e3e39d6a15a345 Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. Sep 23 03:45:50.472516 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd9d198aa-ead9-4ee6-a86a-93b8cc3bae3e'} Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:50.473618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. Sep 23 03:45:50.475335 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:50.477038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Returning 404 to user: Instance d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:50.477673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49b6d622-a17e-4a04-814b-3f6882bc5e4d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e" status: 404 len: 111 microversion: 2.25 time: 0.092835 Sep 23 03:45:50.481512 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 904/1877] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:50 2022] GET /compute/v2.1/servers/d9d198aa-ead9-4ee6-a86a-93b8cc3bae3e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:45:50.492716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:50.493856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:50.507255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.507871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.509723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.511348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.512907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.514195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.851209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:50.868273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5434294f-cabd-4a13-93ff-b027cc39fcf7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 1.425371 Sep 23 03:45:50.870241 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 974/1878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:49 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:50.915956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:50.918867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:50.939791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.942792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.944774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:50.945863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:50.948965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:50.949656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:51.708722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:51.729026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e2d4979-1db0-4aad-b292-7aa84c40a9f9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1260 microversion: 2.1 time: 0.822539 Sep 23 03:45:51.747356 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 975/1879] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:50 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1260 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:51.759858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ad6fab8-a20c-4908-88be-40cb214fd483 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c8b0a5b80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:51.997818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:52.050836 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec5b640e-6c19-47b6-9012-82aaaa8ea5d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 1.565115 Sep 23 03:45:52.072753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 905/1880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:50 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:52.080658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:52.082274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:52.124615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:52.125804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:52.126622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:52.128125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:52.128843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:52.129837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:53.141818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:53.177286 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb6b126c-c741-4abc-a270-ab99e4a3588e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 1.103136 Sep 23 03:45:53.201697 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 906/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:52 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:53.219490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:53.220262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:53.237867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:53.238699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:53.239349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:53.241000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:53.242220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:53.243959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:53.341372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:54.234358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:54.264284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:54.264284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:54.288703 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e960978a-b0e8-4018-92a5-6224e52cb763 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 1.073128 Sep 23 03:45:54.292189 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 907/1882] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:53 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:54.297724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:54.305451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:54.325810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:54.326313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:54.326762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:54.328172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:54.328649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:54.329088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:55.706795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:55.720973 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e40ac5c5-e0c1-47b5-bcca-89d9d1b7e318 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 1.421400 Sep 23 03:45:55.721765 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 908/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:54 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:55.735738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:55.736385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:55.747393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:55.747905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:55.748361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:55.749162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:55.755214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:55.756047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.062917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:57.075557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b9c5878-df81-44e3-b47a-33c957036a3e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 1.352451 Sep 23 03:45:57.078060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 909/1884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:55 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:57.094318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:57.095289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:57.122655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.124944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.130124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.131402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.132159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.142374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.494433 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ad6fab8-a20c-4908-88be-40cb214fd483 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d" status: 202 len: 0 microversion: 2.1 time: 5.745486 Sep 23 03:45:57.495599 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 976/1885] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:45:51 2022] DELETE /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d => generated 0 bytes in 5748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:45:57.501864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:57.503089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:57.524026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.525137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.525567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.526541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.528560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.529106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.597646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:57.828461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:57.853390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9759193-3cc0-443b-b9c6-1d93a696b8bc tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.755718 Sep 23 03:45:57.854689 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 910/1886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:57 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:57.861463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4", "tag": "c5dc7bef-67db-4b67-ab56-93b1b29bff29"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:57.874707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.875693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.876292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.894660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] Creating event network-changed:c5dc7bef-67db-4b67-ab56-93b1b29bff29 for instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 on n-h2-858495-2 Sep 23 03:45:57.902731 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fdb231b1-fe24-4bee-a162-29a7ba9acc6b req-f7062e76-1353-41f8-8a46-a744a563f957 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046157 Sep 23 03:45:57.904151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 911/1887] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:57.917125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:57.927802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:57.962936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.964489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.964942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:57.966871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:57.969848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:57.970321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.146794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:58.158825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:58.182368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:58.207987 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb44c9b8-20f5-484a-9f25-da856d211afd tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.300707 Sep 23 03:45:58.211174 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 912/1888] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:45:57 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:45:58.234350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef044de7-c729-4644-a0b4-0ebfb0984540", "tag": "d36ea68f-9979-486c-b11c-592454e1f695"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:45:58.263355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:58.279455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:58.284649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:58.285619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17995570-d481-4c54-9718-9a08e377f9aa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.785722 Sep 23 03:45:58.286374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.305882 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 977/1889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:57 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:58.319884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:58.320628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:58.367077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:58.367717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:58.372715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.378947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:58.379586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:58.380054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.383517 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] Creating event network-changed:d36ea68f-9979-486c-b11c-592454e1f695 for instance ef044de7-c729-4644-a0b4-0ebfb0984540 on n-h1-858495-2 Sep 23 03:45:58.405882 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f9602aaa-3c74-4fea-ae3c-6e5ee15edcc2 req-abd1d9c9-2ceb-4d25-9b56-7a4bbddf168b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191312 Sep 23 03:45:58.440955 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 913/1890] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:45:58.501380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c933a65e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:58.687949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:58.704194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ea8d5c1b-28b5-41d2-bd18-c3805a4a920d could not be found", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:45:58.705498 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] HTTP exception thrown: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Request method failure captured: Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d HTTP/1.1 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvTdGaVOamgzng5lnBLeZhqL_SVNc-ZDq9dqXASPnbQHAm1hGW4Uer4lvfC60w9NKlLZVg1_NkxHJcnQj4oBbYhl-so9k9eh93vQ4KCjPKbG2VCHyWW5zJu7wCPQyURUWZ9WmpvFAYyQS-PTQCuIGZ3uFIArkceHBJKgZf84g37k2Y Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0bd1357d8c2d453d9ca1abc5767feaa6 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:45:58.711352 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0bd1357d8c2d453d9ca1abc5767feaa6 Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsTestJSON-1966005031-project Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5b818a44d1b843d6b10f48d89c0dd419 Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsTestJSON-1966005031-project Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: exception: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'ea8d5c1b-28b5-41d2-bd18-c3805a4a920d'} Sep 23 03:45:58.713257 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:45:58.714402 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ea8d5c1b-28b5-41d2-bd18-c3805a4a920d could not be found Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a79565ed-14b8-43d9-be9a-9025f4e5480c'] Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d. Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:58.716182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:45:58.717777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:45:58.719501 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:58.719501 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:45:58.719501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Returning 404 to user: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:45:58.719501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0fb29510-1ad6-4280-9014-03ca1deaf708 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d" status: 404 len: 111 microversion: 2.1 time: 0.268036 Sep 23 03:45:58.719501 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 914/1891] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:45:58 2022] GET /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d => generated 111 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:45:58.738321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:58.739377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:45:58.746883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:58.747522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:58.748093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.750047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:45:58.750047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:45:58.750615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:45:58.760281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:45:59.659534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:45:59.670835 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa47181c-fa91-4db8-9bc5-a4e887876a40 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 1.362113 Sep 23 03:45:59.676676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 978/1892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:58 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:45:59.710352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Calling method '.version_select at 0x7f0c8aa7c700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:45:59.973329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ea8d5c1b-28b5-41d2-bd18-c3805a4a920d could not be found", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:45:59.975628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] HTTP exception thrown: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Request method failure captured: Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d HTTP/1.1 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvTdGaVOamgzng5lnBLeZhqL_SVNc-ZDq9dqXASPnbQHAm1hGW4Uer4lvfC60w9NKlLZVg1_NkxHJcnQj4oBbYhl-so9k9eh93vQ4KCjPKbG2VCHyWW5zJu7wCPQyURUWZ9WmpvFAYyQS-PTQCuIGZ3uFIArkceHBJKgZf84g37k2Y Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0bd1357d8c2d453d9ca1abc5767feaa6 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:45:59.987426 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bd1357d8c2d453d9ca1abc5767feaa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0bd1357d8c2d453d9ca1abc5767feaa6 Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1966005031 Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsTestJSON-1966005031-project Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5b818a44d1b843d6b10f48d89c0dd419 Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsTestJSON-1966005031-project Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: exception: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'ea8d5c1b-28b5-41d2-bd18-c3805a4a920d'} Sep 23 03:45:59.991071 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:45:59.992882 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ea8d5c1b-28b5-41d2-bd18-c3805a4a920d could not be found Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5a74989-6963-4b27-9d4f-43dfcd78c213'] Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d. Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:45:59.996748 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:00.003420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:00.008000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d Sep 23 03:46:00.008000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:00.008000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] Returning 404 to user: Floating IP not found for ID ea8d5c1b-28b5-41d2-bd18-c3805a4a920d {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:00.010802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c864d5d-38a5-4ff3-b777-93c2bfd1c360 tempest-FloatingIPsTestJSON-1966005031 tempest-FloatingIPsTestJSON-1966005031-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d" status: 404 len: 111 microversion: 2.1 time: 0.332216 Sep 23 03:46:00.018169 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 979/1893] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:45:59 2022] DELETE /compute/v2.1/os-floating-ips/ea8d5c1b-28b5-41d2-bd18-c3805a4a920d => generated 111 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:46:00.029201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:00.030524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:00.050204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:00.052875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.053696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.054366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.055367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.057787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.059107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.063343 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-621681dc-df57-4322-8de4-6ba4cd931088 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 1.343447 Sep 23 03:46:00.071135 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 915/1894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:45:58 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:00.081227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-plugged", "status": "completed", "tag": "9c42b5a2-79b6-49ec-92e8-f17429e4c06c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:00.126919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.128093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.134762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.206316 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] Creating event network-vif-plugged:9c42b5a2-79b6-49ec-92e8-f17429e4c06c for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:00.215057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-654ee956-8b39-4215-a5ba-1ba33fb5b516 req-bf3866d6-3cf4-4d28-8ce4-2dbcc15248aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140685 Sep 23 03:46:00.221331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 916/1895] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:00.229512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:00.236693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:00.247615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.249774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.250493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.258386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.259233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.259945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.466206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:00.476893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:00.487346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:00.493599 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c4fb09c-1cf2-4af1-8514-9d9655d02b25 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.270633 Sep 23 03:46:00.506169 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 917/1896] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:00 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:00.511501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:00.512457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:00.539061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.546664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.558197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:00.563251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:00.566488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:00.567530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:01.145982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:01.160038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a22a9ecf-d649-4732-ba27-268e2f04e163 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 1.140378 Sep 23 03:46:01.160923 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 980/1897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:00 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:01.182674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:01.222783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:01.223878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:01.224935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:01.261600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] Creating event network-changed:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:46:01.279497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8c17f729-adb8-42f6-b8ef-ac8fc2e74f7b req-340c0aae-490f-44ad-a7a9-3b1af1969dcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116789 Sep 23 03:46:01.285847 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 981/1898] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:01.299430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:01.302367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:01.309380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:01.310174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:01.310852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:01.311861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:01.313493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:01.314161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:01.420413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:01.432116 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c78e6df6-5f01-4e25-87df-700531f054fa tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.924301 Sep 23 03:46:01.438757 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 918/1899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:00 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:01.466159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:01.466886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:01.500741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:01.501888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:01.502610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:01.506929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:01.507529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:01.508075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.028225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.042859 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca9c404b-a7f8-43e7-9a33-71377e412c0f tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 0.754555 Sep 23 03:46:02.047452 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 982/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:01 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:02.060801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:02.064243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:02.083674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.087224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.090822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.092564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.093330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.097182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.097787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.112322 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b99cb0e2-c9a1-4d14-b00b-ccf66d5d7105 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 0.671334 Sep 23 03:46:02.126962 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 919/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:01 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:02.202266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:02.203515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:02.221655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.230178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.230645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.231391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.232051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.232482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.270801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.286485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.290542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.303342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:02.307970 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adab4968-6a8b-4e0a-967f-3f378a867595 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.258836 Sep 23 03:46:02.310345 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 983/1902] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:02 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:02.339856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-plugged", "status": "completed", "tag": "462decee-948f-465e-bff4-c6cb3db808fa"}, {"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-plugged", "status": "completed", "tag": "2d71d408-980a-4f99-9697-1eedcf7c3430"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:02.368759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.369377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.370023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.411289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Creating event network-vif-plugged:462decee-948f-465e-bff4-c6cb3db808fa for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:02.412201 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] Creating event network-vif-plugged:2d71d408-980a-4f99-9697-1eedcf7c3430 for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:02.419192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-96c2975c-60ca-4f22-9478-2eb1308573fb req-442aeeb8-cea4-4736-a179-ed43e5d55718 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088799 Sep 23 03:46:02.421307 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 984/1903] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:46:02.435514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:02.436763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:02.450310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.451111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.452059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.453028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.458453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.459261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.524136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:02.526743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.535650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ad567e4-df10-44cf-b022-0959e011dfbe tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.337589 Sep 23 03:46:02.536241 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 920/1904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:02 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:46:02.541785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:02.546826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:02.561502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.562720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.563393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.564368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.564930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.565503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.722214 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ae6ea97-490b-43b7-a52f-35243b5a6b46 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 204 len: 0 microversion: 2.25 time: 0.299001 Sep 23 03:46:02.726057 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 985/1905] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:46:02 2022] DELETE /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:46:02.734607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:02.737484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:02.751177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.751695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.752138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.752857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:02.753315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:02.753776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:02.785284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.793206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84389237-8bf0-4eb5-b204-fedce12c0733 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.255677 Sep 23 03:46:02.799526 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 921/1906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:02 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:02.935245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.947710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.951283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:02.953954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e225492-19a7-412a-a6a6-5729fb671b00 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1730 microversion: 2.25 time: 0.225821 Sep 23 03:46:02.966497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 986/1907] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:02 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:03.077075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:03.077876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:03.091326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.092051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.092966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.094327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.095132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.095781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.145922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:03.146710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:03.157532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.158270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.158876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.159749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.160837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.161455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.311539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:03.319980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43611fcb-4271-44fa-abcc-f7b913e6dae7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1211 microversion: 2.1 time: 0.247293 Sep 23 03:46:03.322850 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 922/1908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:03 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1211 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:03.349239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:03.351631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:03.364589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.369270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.369990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.371244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.371905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.372466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.377737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:03.388133 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a96301f-ac4f-4724-929b-bbc776ae8ea9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 0.247164 Sep 23 03:46:03.389084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 987/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:03 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:03.460909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:03.474202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:03.476009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:03.484616 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ce19cd7-2b16-468c-8546-9aadafeffc60 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.138546 Sep 23 03:46:03.485621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 923/1910] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:03 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:03.566922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:03.567592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:03.577317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.577840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.578277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.579411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.579886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.580302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.822539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:03.823973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:03.831220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.832099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.832798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:03.833835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:03.834572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:03.836136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.088954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.108193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a82f5d3-47e8-40eb-84c7-ab4419a336da tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.549490 Sep 23 03:46:04.112208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 988/1911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:03 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:04.130848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:04.133962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:04.146458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.147160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.148284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.149200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.149857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.150462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.349265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.358032 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ebb97189-00c2-4cfb-aa09-5c4772668df8 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.539262 Sep 23 03:46:04.365787 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 924/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:03 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:46:04.370735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:04.371580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:04.392706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.393191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.393858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.394773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.395406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.396027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.550149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.563327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.569255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.570734 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a752ae04-aa68-4604-bed8-5e47d23175a1 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1730 microversion: 2.25 time: 0.454366 Sep 23 03:46:04.589932 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 989/1913] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:04 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1730 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:04.600693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:04.602315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:04.610269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.611057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.611671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.612599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.613241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.613895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.645736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.664189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ebebc999-66ab-47e1-8729-d06355f0fca1 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.293752 Sep 23 03:46:04.664829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 925/1914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:04 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:04.682179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef044de7-c729-4644-a0b4-0ebfb0984540", "name": "network-vif-plugged", "status": "completed", "tag": "d36ea68f-9979-486c-b11c-592454e1f695"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:04.699680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.704277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.704743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.719895 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] Creating event network-vif-plugged:d36ea68f-9979-486c-b11c-592454e1f695 for instance ef044de7-c729-4644-a0b4-0ebfb0984540 on n-h1-858495-2 Sep 23 03:46:04.726957 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2d119f85-c2bf-4205-bbd9-08364ca30396 req-f7f04c89-3c7f-4419-aca4-38a8a71fef09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060632 Sep 23 03:46:04.727946 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 926/1915] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:04.735746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:04.736606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:04.752225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.753820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.754633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.755815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:04.756410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:04.756938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:04.778665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:04.810272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.818364 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d31e9c8-2fa7-4f8a-a115-4110cad743a8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 0.227033 Sep 23 03:46:04.833392 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 990/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:04 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:04.844151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.853763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.855978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:04.862184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca88285c-7800-4202-821e-9cfc111b4a49 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1537 microversion: 2.91 time: 0.133001 Sep 23 03:46:04.863418 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 927/1917] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:04 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1537 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:05.139472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:05.140036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:05.147212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.147863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.148536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.149589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.150251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.150829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.372207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:05.392473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:05.393297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:05.394300 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-148496e2-70bc-4175-93bb-4b81a1826316 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.258623 Sep 23 03:46:05.395301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 991/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:05 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:05.412188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.413016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.415029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.416109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.418747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.421520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.610478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:05.613634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:05.623072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.624468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.625001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.627153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.628004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.628819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.784549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:05.795653 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45ff5e43-dac9-42f4-a190-9724fe2aca84 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.416609 Sep 23 03:46:05.800427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 928/1919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:05 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:05.827961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:05.828601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:05.848459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.850707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.852577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:05.853378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:05.853848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:05.854347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.110133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.127237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.128995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.130439 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03602a55-0639-499c-8449-16b3b87d917b tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1730 microversion: 2.25 time: 0.530693 Sep 23 03:46:06.131508 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 992/1920] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:05 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1730 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:46:06.137879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:06.138487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:06.145426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.146111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.146804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.147689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.148306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.148893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.378558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.394284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd8c583d-e94e-4ad3-8c92-3973f6ce5a69 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.576586 Sep 23 03:46:06.395565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 929/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:05 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:06.409964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:06.412434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:06.424190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.424691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.425139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.428223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.428711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.429159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.532798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.542068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0a5b3a6-1189-422c-86c8-d2b83f153010 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1308 microversion: 2.1 time: 0.409289 Sep 23 03:46:06.561899 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 993/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:06 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:06.571592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:06.571592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:06.590901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.591439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.591867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.593124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.593634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.594063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.613124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:06.645841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.655260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.657093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.674727 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b373daf3-e461-4bb1-8bb1-e061ffdc102b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1540 microversion: 2.91 time: 0.276446 Sep 23 03:46:06.691359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 930/1923] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:06 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1540 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:06.716913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:06.727297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:06.738159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.738925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.739583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.740631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:06.741263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:06.741939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:06.896345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858495-2". {{(pid=128723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 03:46:06.986640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:06.988726 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07482a01-3443-4024-add5-7b120d585ca3 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action" status: 202 len: 0 microversion: 2.91 time: 0.285946 Sep 23 03:46:06.994468 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 931/1924] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:46:06 2022] POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:46:07.007392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-963268a3-d138-42a0-b3e9-fa566ff46364 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.444192 Sep 23 03:46:07.007656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "name": "network-vif-plugged", "status": "completed", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:07.009240 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 994/1925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:06 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:07.014952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:07.015819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:07.023131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.024909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.025574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.027326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.027944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.028689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.064001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.065699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.066400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.082959 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] Creating event network-vif-plugged:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:46:07.088530 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e589f8a5-2e3b-403a-8c01-1b803ff6f2bb req-0b1ca6d6-5e12-4503-8e13-2fd444e0b475 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095016 Sep 23 03:46:07.091865 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 932/1926] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:07.099695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:07.100742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:07.111891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.112684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.113128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.113901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.114491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.114923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.240997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.249836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.251449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.257120 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-25e3339c-8c4a-4a45-91ea-b4964ea2e0ec tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1488 microversion: 2.91 time: 0.163239 Sep 23 03:46:07.258208 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 933/1927] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:07 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1488 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:07.263415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:07.264085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:07.270583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.271319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.271949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.272833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.273781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.274372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.602711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.612373 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75f7f168-0497-4dd5-9290-78ee61f77f43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1354 microversion: 2.1 time: 0.601741 Sep 23 03:46:07.638116 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 995/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:07 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1354 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:07.651327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:07.653012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:07.666017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.666554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.666981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.667812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:07.668460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:07.669063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:07.975243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.990457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.993782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:07.995873 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff4bec2f-cf68-4a0a-bc2b-24245068c704 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1730 microversion: 2.25 time: 0.736466 Sep 23 03:46:07.997143 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 934/1929] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:07 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1730 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:08.003591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:08.004226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.010904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.011615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.012219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.014126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.015278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.015881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.268708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.281167 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79c600fa-5350-4760-913d-d9f2c1ea34b9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.641706 Sep 23 03:46:08.283332 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 996/1930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:07 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:08.290753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:08.292456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.302154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.302647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.303084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.303790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.304298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.304730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.399520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.408673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5358d630-4ddd-40c6-b08e-66046e9e531b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1489 microversion: 2.1 time: 0.409241 Sep 23 03:46:08.422274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 935/1931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:07 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1489 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:08.433894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:08.435122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.444196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.454285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.455454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.456840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.457552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.458165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.549672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.557879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.559338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.564906 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd315eb4-5f38-47dd-aa7a-230c4144fe8e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.141402 Sep 23 03:46:08.565518 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 936/1932] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:08 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:08.570125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:08.570691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.576448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.576941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.577412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.578119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.578574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.579008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.602408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.612687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-477eadb9-e33b-4bbb-9534-d7eef8f4fcee tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1324 microversion: 2.1 time: 0.326840 Sep 23 03:46:08.613334 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 997/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:08 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:08.641436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:08.643038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.649665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.650199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.650836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.651739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.652376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.653006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.661919 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e03f9993-a88b-4176-aa77-5872012147c6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540/action" status: 202 len: 0 microversion: 2.1 time: 0.094942 Sep 23 03:46:08.663069 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 937/1934] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:08 2022] POST /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:46:08.672100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:08.673163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:08.681742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.682406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.682961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.683758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:08.684335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:08.684933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:08.962370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:08.973594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88e8658b-2682-43bb-97fc-03a81ace7db7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1805 microversion: 2.1 time: 0.335980 Sep 23 03:46:08.985778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 998/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:08 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1805 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:46:08.997893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc7b429-3990-4b0b-a7f6-770340caee55", "name": "network-vif-deleted", "tag": "53cfc8d9-8e57-4e12-9e32-cb9215e05d70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:09.008297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.009047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.009703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.016117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.026269 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] Creating event network-vif-deleted:53cfc8d9-8e57-4e12-9e32-cb9215e05d70 for instance efc7b429-3990-4b0b-a7f6-770340caee55 on n-h2-858495-2 Sep 23 03:46:09.028972 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-347da151-b240-4a7d-bf95-e68915266351 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1494 microversion: 2.1 time: 0.361861 Sep 23 03:46:09.030681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 938/1936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:08 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1494 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:09.043786 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72ed7795-704f-4ec0-b989-90179286911a req-642d9352-388f-4d08-90d2-493c539860cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056529 Sep 23 03:46:09.050973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 999/1937] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:09.058736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.059861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.068289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.069186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.069884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.070637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.071178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.071392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.072021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.072963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.088691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.089842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.091402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.092723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.093203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.096847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.148970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.160305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.162227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.163807 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7847ea7c-f44b-4003-9e16-e2a881d3cf49 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1369 microversion: 2.25 time: 0.111129 Sep 23 03:46:09.164871 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1000/1938] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:09.177562 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-468b512d-f10a-4641-b97a-32007caedab2 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075/ips" status: 200 len: 219 microversion: 2.1 time: 0.129412 Sep 23 03:46:09.180308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 939/1939] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075/ips => generated 219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:09.192199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.193243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.212337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.212842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.213405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.214270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.214735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.215166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.254877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:09.309541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.310216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.316824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:09.327648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.328343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.330162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.333343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.335568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.336406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.357374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d1c02d8-316d-4698-a295-523e44bd9cdb tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 204 len: 0 microversion: 2.1 time: 0.168819 Sep 23 03:46:09.359300 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1001/1940] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:46:09 2022] DELETE /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:46:09.372605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.373435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.382039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.382874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.384338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.385299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.386146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.386751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.680871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.692194 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a113557d-e792-44d8-b652-68303a32381c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.387329 Sep 23 03:46:09.692660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 940/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:09.725997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.726794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.727447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.738001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-970b419f-412a-40f5-bf38-5a5e8928df3f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1811 microversion: 2.1 time: 0.371269 Sep 23 03:46:09.740256 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1002/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1811 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:09.752909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.753546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.754353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.755155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.755709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.756046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:09.756208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.757071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:09.768645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.770416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.771083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.772152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:09.773711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:09.774396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:09.968621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.980002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.984946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:09.999491 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45f511b0-955b-4e11-a6c0-aab3f02fafc9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.282347 Sep 23 03:46:10.005952 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 941/1943] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:10.018923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab767d5e-dbb2-4597-8831-24e6afcba117 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c933c2040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:10.076110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab767d5e-dbb2-4597-8831-24e6afcba117 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81" status: 200 len: 662 microversion: 2.1 time: 0.068817 Sep 23 03:46:10.077111 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 942/1944] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:10 2022] GET /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:10.089275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:10.089993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:10.103903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.106453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.107162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.108659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.109135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.113763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.129371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:10.137154 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-34219558-c131-4927-8a96-74ab848cfe90 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1520 microversion: 2.1 time: 0.395561 Sep 23 03:46:10.139888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1003/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:09 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:10.144771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72c24520-e69d-4db3-be11-96860a4e8d5a tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93358430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:10.221802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72c24520-e69d-4db3-be11-96860a4e8d5a tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81" status: 200 len: 662 microversion: 2.1 time: 0.080787 Sep 23 03:46:10.222400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1004/1946] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:10 2022] GET /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81 => generated 662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:10.230931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d93dfaf6-1d85-4dc4-95e5-6b45dce6271f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'create', calling method: .version_select at 0x7f0c8a947430>, body: {"pool": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:10.426100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:10.429089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:10.440451 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dce8dd33-2e49-413a-8662-13ffafdc0535 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 200 len: 1474 microversion: 2.1 time: 0.362116 Sep 23 03:46:10.442699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 943/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:10 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:10.472672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:10.474620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:10.505399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.514541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.515447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.518609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.520222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.522878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.606843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.608323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.608998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.609605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lazy-loading 'fault' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:10.849401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:10.861077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:10.864903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:10.871505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28d06f16-4049-4a35-b839-a4019e0e094d tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1374 microversion: 2.25 time: 0.406144 Sep 23 03:46:10.872248 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 944/1948] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:10 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1374 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:10.881927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-367241231"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:10.892091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:10.902901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.903170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.905702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:10.906532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:10.907024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:10.907472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.217692 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c5a7d66-94af-4170-a4e8-0ce3c869a3bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540/action" status: 202 len: 0 microversion: 2.1 time: 0.343542 Sep 23 03:46:11.226659 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 945/1949] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:10 2022] POST /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:46:11.233051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:11.234205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:11.244729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.245778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.247078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.249738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.250535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.251306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.499384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:11.514338 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95ce1148-fa38-4dfd-ab89-465c40daf1c8 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.284847 Sep 23 03:46:11.530480 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 946/1950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:11 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:11.559438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:11.561121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:11.580946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.583128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.585125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.587475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.588556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.589888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.898148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:11.914365 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d042610-4224-48f5-b87f-48b065a6cc1e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1811 microversion: 2.1 time: 0.374978 Sep 23 03:46:11.930030 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 947/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:11 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1811 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:11.939080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:11.939697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:11.946168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.946657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.947105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:11.947809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:11.948266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:11.948712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.169152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.186777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.189969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.199928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b402912b-b141-48ef-bd86-ee81232f6a8d tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.267708 Sep 23 03:46:12.212451 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 948/1952] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:11 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:12.212451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f26bbd5-3a23-4e73-907e-7a89366f96d8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c933a38b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:12.273235 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f26bbd5-3a23-4e73-907e-7a89366f96d8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.065487 Sep 23 03:46:12.277801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 949/1953] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:12 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:12.288387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:12.289041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:12.319175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:12.323405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:12.324131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.328031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:12.330096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:12.330997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.381682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:12.382192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:12.382640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.383110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lazy-loading 'fault' on Instance uuid efc7b429-3990-4b0b-a7f6-770340caee55 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:12.468839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.481778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.484024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:12.485473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83ffbafa-60a8-4f8b-9324-c9b19b3cd562 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 200 len: 1374 microversion: 2.25 time: 0.204844 Sep 23 03:46:12.485632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d93dfaf6-1d85-4dc4-95e5-6b45dce6271f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.262019 Sep 23 03:46:12.497525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 950/1954] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:12 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 1374 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:12.499758 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1005/1955] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:46:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:12.504202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-adbed0dd-75f7-41e2-b71b-061f9b6d5007 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8ab1a280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:12.555448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-adbed0dd-75f7-41e2-b71b-061f9b6d5007 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6" status: 200 len: 662 microversion: 2.1 time: 0.055575 Sep 23 03:46:12.556477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 951/1956] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:12 2022] GET /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6 => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:12.562475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:12.563200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:12.570514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:12.571419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:12.572034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.572926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:12.573592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:12.574199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:12.582945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4f5a5930-c188-4792-bd27-7b9212304ff6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93387670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:12.680531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4f5a5930-c188-4792-bd27-7b9212304ff6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6" status: 200 len: 662 microversion: 2.1 time: 0.110925 Sep 23 03:46:12.681371 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 952/1957] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:12 2022] GET /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6 => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:12.728355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1205553407", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "408d828c-53fb-45a4-8e7a-9fdf28c75147"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:12.949014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] validate_networks() for [('408d828c-53fb-45a4-8e7a-9fdf28c75147', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:46:13.081842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:13.093909 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28b0c676-8ca8-4a35-8f73-8645b1d5f4e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.536837 Sep 23 03:46:13.097507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1006/1958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:12 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:46:13.103164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:13.104297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:13.131497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:13.132296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:13.132926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:13.142854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:13.143661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:13.144529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:13.615467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:13.641948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1edacc42-ebcf-4154-8628-b377592a8a97 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1811 microversion: 2.1 time: 0.539585 Sep 23 03:46:13.643014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1007/1959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:13 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1811 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:13.665808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:13.666798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:13.674269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:13.674918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:13.675459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:13.676296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:13.676929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:13.677492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:13.811846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:13.829050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:13.833683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:13.841427 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a030f0ff-0884-49ab-b090-6ab05d7e98f8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.191734 Sep 23 03:46:13.842978 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1008/1960] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:13 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:13.848498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06e29bf2-f12a-4c00-b9ba-c1086d76d88b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8a947160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:14.083577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:46:14.084094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:46:14.084493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:46:14.084917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:46:14.085381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:46:14.101565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.102099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.102554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.103337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.103818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.104265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.160959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Getting quotas for project b485f12af57540f1a70b1e77abb43552. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:46:14.166294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Getting quotas for user 199e61a016b843f59b611324801381c6 and project b485f12af57540f1a70b1e77abb43552. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:46:14.202640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:46:14.205088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:46:14.312401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34472ae9-ba72-4457-aa8a-4f0c91f55d66 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588617 Sep 23 03:46:14.318458 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 953/1961] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:46:14.326797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:14.327685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: efc7b429-3990-4b0b-a7f6-770340caee55] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:14.335814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.336504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.337139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.338096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.338826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.339463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.371001 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] HTTP exception thrown: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Request method failure captured: Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 HTTP/1.1 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSo55tvbDpBvXzkjb2kSzAIbus30A_U8vz3l1hkvXEtPBT0PX1Drx5gK6G9wSn8ZrfBTYzpAlDMJRYaPElfdd8Q33iKRv_03hHMhbD7PHVLlqzDKvkpdDCYVErkbIwh4nuOM777IrH_cUayDGDta4o3ERALPL9Z0BNlh5EDpk0ma634 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:46:14.372831 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28c366e7ad9146d09218783c948d17db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28c366e7ad9146d09218783c948d17db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9855cf6129a34302a7e3e39d6a15a345 Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. Sep 23 03:46:14.374883 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'efc7b429-3990-4b0b-a7f6-770340caee55'} Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:14.376082 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. Sep 23 03:46:14.378853 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:14.388971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Returning 404 to user: Instance efc7b429-3990-4b0b-a7f6-770340caee55 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:14.390492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2d89f30-e9ea-41ea-932f-ec82ec7cac16 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55" status: 404 len: 111 microversion: 2.25 time: 0.070347 Sep 23 03:46:14.390960 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 954/1962] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:14 2022] GET /compute/v2.1/servers/efc7b429-3990-4b0b-a7f6-770340caee55 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:46:14.396725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:14.397393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:14.417453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.417981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.418470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.419198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.420221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.420670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.502046 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06e29bf2-f12a-4c00-b9ba-c1086d76d88b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.657558 Sep 23 03:46:14.503066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1009/1963] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:13 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:14.510495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-deleted", "tag": "2d71d408-980a-4f99-9697-1eedcf7c3430"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:14.570948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:14.573718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:14.575740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:14.592822 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] Creating event network-vif-deleted:2d71d408-980a-4f99-9697-1eedcf7c3430 for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:14.601814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ea7a5101-0498-4dd7-a26c-6b800a0e9acd req-ae9b4a66-b80c-41de-80fe-e6ef7a98a0d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096903 Sep 23 03:46:14.603549 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1010/1964] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:14.610308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b84c93c8-5d73-4c3c-b711-a98d162a9c33 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:14.611607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b84c93c8-5d73-4c3c-b711-a98d162a9c33 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:15.251467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b84c93c8-5d73-4c3c-b711-a98d162a9c33 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:15.267694 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b84c93c8-5d73-4c3c-b711-a98d162a9c33 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1224 microversion: 2.1 time: 0.660400 Sep 23 03:46:15.269587 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1011/1965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:14 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1224 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:15.283340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7dd97cc-727d-47c1-b984-3b4aa7ec0404 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '.version_select at 0x7f0c8aa26790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:15.335569 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7dd97cc-727d-47c1-b984-3b4aa7ec0404 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402870577" status: 204 len: 0 microversion: 2.25 time: 0.063571 Sep 23 03:46:15.336483 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1012/1966] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 23 03:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402870577 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:46:15.355075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f01d2b8-e926-478f-81d9-88b9b09d1dc2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93424940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:15.449080 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f01d2b8-e926-478f-81d9-88b9b09d1dc2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5" status: 200 len: 661 microversion: 2.1 time: 0.111133 Sep 23 03:46:15.450255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1013/1967] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:15 2022] GET /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:15.457301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:15.458819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:15.468126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:15.474631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:15.475477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:15.484450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:15.486416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:15.488936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:15.884321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:15.900024 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b7b21f2-0d8c-4bec-aa76-817b8760a708 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 1.507412 Sep 23 03:46:15.905513 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 955/1968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:14 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:15.917407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:15.925050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:15.958166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:15.963874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:15.964441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:15.967811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:15.980086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:15.980834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.057574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:16.068981 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0db511fb-5777-4ab1-811b-6f6e6d977982 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1654 microversion: 2.1 time: 0.616204 Sep 23 03:46:16.091057 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1014/1969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:15 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1654 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:16.111110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-unplugged", "status": "completed", "tag": "9c42b5a2-79b6-49ec-92e8-f17429e4c06c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:16.157223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:16.158626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:16.161306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.216139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] Creating event network-vif-unplugged:9c42b5a2-79b6-49ec-92e8-f17429e4c06c for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:16.238063 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3b327443-2331-4de0-9c12-57d37d4b320e req-736b6eed-6521-4ea3-b24e-690bbe7fccff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142624 Sep 23 03:46:16.241888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1015/1970] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:16.263972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d81c9c0-55db-4a21-a176-3fc02f684e26 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8a941c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:16.310555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:16.322848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:16.328309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:16.339336 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bcdfcbbe-4805-469b-9e3b-c9399078ac56 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.425812 Sep 23 03:46:16.355458 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 956/1971] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:15 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:16.379180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be0f1d73-33da-42a0-9662-93c7b28247f7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93387f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:16.414029 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d81c9c0-55db-4a21-a176-3fc02f684e26 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5" status: 200 len: 661 microversion: 2.1 time: 0.167116 Sep 23 03:46:16.416344 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1016/1972] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:16 2022] GET /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5 => generated 661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:16.435256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:16.437160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:16.512990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:16.515213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:16.517257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.518930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:16.519877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:16.521913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.525954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be0f1d73-33da-42a0-9662-93c7b28247f7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.169277 Sep 23 03:46:16.534053 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 957/1973] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:16 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:16.615693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1726671174", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:16.724183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:16.773935 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9e913a9-b175-43f4-b7da-e4131dbfb2f3 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1276 microversion: 2.1 time: 0.353523 Sep 23 03:46:16.777530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1017/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:16 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:16.809995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:46:16.929307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:16.930530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:16.941874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:16.942677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:16.944417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.945411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:16.950975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:16.951730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:16.986899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:17.368691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:17.381653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8f329d7-cfb4-4157-8f74-e75279b42226 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.455866 Sep 23 03:46:17.383221 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1018/1975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:16 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:17.390193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:17.392040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:17.399453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.408666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:46:17.409331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:46:17.409737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:46:17.410189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:46:17.410677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:46:17.414338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.414933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.415731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.416216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.416767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.421389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.422321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.423087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.423862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.424331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.424765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.460861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Getting quotas for project 9269b2c0a2fc44c78435abd417ec74e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:46:17.465132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:17.471775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Getting quotas for user 0208ba9f3caa4e7aa45fd433061d2ce5 and project 9269b2c0a2fc44c78435abd417ec74e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:46:17.488040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:46:17.490392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:46:17.548124 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d38a3b3c-cccf-4b5f-8e9a-fd7feb87a0a9 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949161 Sep 23 03:46:17.563794 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 958/1976] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:46:17.570880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:17.572063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:17.582480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.584828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.586507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.587849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.589244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.590372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.835320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:17.849191 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d2695ab-34c8-443e-a475-b144366cfe09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1612 microversion: 2.1 time: 0.283094 Sep 23 03:46:17.851878 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 959/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:17 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1612 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:17.867299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-deleted", "tag": "9c42b5a2-79b6-49ec-92e8-f17429e4c06c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:17.893132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.895965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.896557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.921040 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] Creating event network-vif-deleted:9c42b5a2-79b6-49ec-92e8-f17429e4c06c for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:17.927692 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a100977b-d864-45af-b5e9-d9d48c1e8f3a req-96667162-bca3-4f84-b704-b00ce2bb5c83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069391 Sep 23 03:46:17.933200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 960/1978] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:17.940142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:17.941344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:17.949632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.950519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.951258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:17.952266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:17.953267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:17.953960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.088273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.100092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.101863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.110492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f415371-73d6-409e-a070-7d73ea421e0e tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.175287 Sep 23 03:46:18.111876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 961/1979] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:17 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:18.117696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f452fe8-f1cb-429a-b4a9-0f50fb6b9f39 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c933a35e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:18.217851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f452fe8-f1cb-429a-b4a9-0f50fb6b9f39 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.102984 Sep 23 03:46:18.220043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 962/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:18 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:18.229133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1738732886", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:18.319440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:46:18.319753 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e55fdef0-3f3e-4f7d-95fd-e203c5b73bca tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 204 len: 0 microversion: 2.25 time: 0.928895 Sep 23 03:46:18.320206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1019/1981] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:46:17 2022] DELETE /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:46:18.328538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:18.330986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:18.346694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.348944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.349985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.351946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.352776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.353531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.468005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.490440 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09f7dae3-c6dd-45ca-bb67-7de100ce83c2 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1284 microversion: 2.1 time: 0.166455 Sep 23 03:46:18.505376 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1020/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:18 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:18.505376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-unplugged", "status": "completed", "tag": "462decee-948f-465e-bff4-c6cb3db808fa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:18.525106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.525797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.526258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.550186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] Creating event network-vif-unplugged:462decee-948f-465e-bff4-c6cb3db808fa for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:18.570035 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9eb7a41f-0de9-4067-82ce-b7b24a0ca96c req-b469cc93-9cd7-4292-859d-993f12dc18e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074238 Sep 23 03:46:18.573532 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1021/1983] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:18.581609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:18.582316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:18.602499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.603331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.605670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.607274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.611345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.611802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.739474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:46:18.740315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:46:18.740594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:46:18.740933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:46:18.741883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:46:18.767586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.768298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.768935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.770894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.773681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.774372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.827251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Getting quotas for project 9269b2c0a2fc44c78435abd417ec74e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:46:18.833450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Getting quotas for user 0208ba9f3caa4e7aa45fd433061d2ce5 and project 9269b2c0a2fc44c78435abd417ec74e4. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:46:18.848079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:46:18.853326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:46:18.917935 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18319f13-30c6-4e1d-be1e-0e9e771093bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696034 Sep 23 03:46:18.919143 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 963/1984] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:46:18.927281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:18.928756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:18.945756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.948065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.949217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.950244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:18.951055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:18.951677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:18.970161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.983919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.988714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:18.990196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3680523e-8854-4e4c-9031-dc296ae74500 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1548 microversion: 2.25 time: 0.415469 Sep 23 03:46:18.993763 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1022/1985] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:18 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1548 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:19.009718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:19.020378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:19.030986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.032998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.033684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.034612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.046151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.047624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.140763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.141390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.142110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.142580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lazy-loading 'fault' on Instance uuid bde2c78e-cdd1-4b75-8a65-667bf8d47075 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:19.214768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.223688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.235536 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c444d09-7920-494a-bfac-c90dc311e2da tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.314156 Sep 23 03:46:19.236473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d371fb3-1ba1-411a-9fcd-9730a58edeaf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 200 len: 1302 microversion: 2.1 time: 0.241343 Sep 23 03:46:19.238185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1023/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:18 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 1302 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:19.252089 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 964/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:18 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:19.254602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-887ff5c2-1f32-4dc2-b534-980175c73d60 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:19.255456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-887ff5c2-1f32-4dc2-b534-980175c73d60 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:19.258081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:19.258876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:19.265661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.266251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.267032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.267930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.268558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.269005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.283244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:19.423449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-887ff5c2-1f32-4dc2-b534-980175c73d60 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.437628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-887ff5c2-1f32-4dc2-b534-980175c73d60 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1218 microversion: 2.1 time: 0.192701 Sep 23 03:46:19.438521 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1024/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:19 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:19.453189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11178143-a4c8-4bf4-bbdb-a1bc91e4057d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8a94d670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:19.526837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.545121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.546677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.554533 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d921a749-baad-4c83-a994-ff78ca7d9fae tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.300615 Sep 23 03:46:19.565743 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 965/1989] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:19 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:19.586841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:19.588290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:19.596328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.597276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.598098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.599106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.600008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.600990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:19.720880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:19.736124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:19.743861 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e3fff55-d7b1-49dc-93ea-41529dd3ba13 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1282 microversion: 2.1 time: 0.174903 Sep 23 03:46:19.756730 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-11178143-a4c8-4bf4-bbdb-a1bc91e4057d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.316527 Sep 23 03:46:19.769309 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 966/1990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:19 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:19.769920 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1025/1991] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:19 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:19.948802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde2c78e-cdd1-4b75-8a65-667bf8d47075", "name": "network-vif-deleted", "tag": "462decee-948f-465e-bff4-c6cb3db808fa"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:19.979074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:19.979571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:19.983556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.002420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] Creating event network-vif-deleted:462decee-948f-465e-bff4-c6cb3db808fa for instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 on n-h2-858495-2 Sep 23 03:46:20.030480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:20.031615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:20.042176 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b097e77c-0674-4de6-85b5-ca3ff0171bd6 req-a029acf3-9c53-4789-bce3-0c9d6b99828d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095211 Sep 23 03:46:20.043714 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 967/1992] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:20.059632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.063249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.065037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.066108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.070525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.071292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.266244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:20.267846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:20.280295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:20.286318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.286925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.288912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.289776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.294047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.295671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.323788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:20.335001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:20.338156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:20.354381 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9684972-f299-4949-8a59-629c214451ac tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1548 microversion: 2.25 time: 0.338017 Sep 23 03:46:20.357607 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1026/1993] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:20 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1548 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:46:20.377071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:20.378083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:20.391914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.396742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.397500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.398446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.399081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.400062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.432463 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 HTTP/1.1 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:46:20.434374 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:46:20.436869 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'bde2c78e-cdd1-4b75-8a65-667bf8d47075'} Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:20.438082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:46:20.439850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:20.455057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:20.458088 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e16c7b6-75e2-4ef8-a7ab-277f08282e09 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 404 len: 111 microversion: 2.1 time: 0.099061 Sep 23 03:46:20.465126 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1027/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:20 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:46:20.480124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:20.482428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:20.489870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.500888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.501828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.502848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.503483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.504971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.839815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:20.857862 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67c8d828-eb3c-4d52-8ddb-585eff39026e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1214 microversion: 2.1 time: 0.381048 Sep 23 03:46:20.876476 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1028/1995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:20 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1214 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:20.893324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:20.894080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:20.917543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.918440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.919006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:20.922098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:20.923052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:20.925760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.121668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.133943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5cbef33c-1bed-48c5-9dde-99f4b2e908bc tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 0.873410 Sep 23 03:46:21.146398 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 968/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:20 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:46:21.156398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4", "name": "network-vif-plugged", "status": "completed", "tag": "c5dc7bef-67db-4b67-ab56-93b1b29bff29"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:21.168408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.169883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.170774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.189876 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] Creating event network-vif-plugged:c5dc7bef-67db-4b67-ab56-93b1b29bff29 for instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 on n-h2-858495-2 Sep 23 03:46:21.201753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9cf30a0a-52ce-4f28-8442-f74002d29e2d req-0b8a4978-e640-4cab-9367-aea630421a75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052483 Sep 23 03:46:21.203095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 969/1997] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:21.221627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-869ec8b5-392c-4c93-b0f6-e5f5f595e6c5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93387f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:21.340537 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-869ec8b5-392c-4c93-b0f6-e5f5f595e6c5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.135777 Sep 23 03:46:21.344223 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 970/1998] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:21 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:21.349628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:21.350704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:21.371127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.374320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.375850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.376894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.377914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.378946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.379627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.388320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.389808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.407266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-329f58a0-bb41-4ab2-818c-9a1a3df170d0 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.526769 Sep 23 03:46:21.411119 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1029/1999] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:20 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:21.416126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:21.424212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:21.437756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.452147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.452985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.454150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.454798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.456490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.786343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.797107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.801900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:21.803339 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ffa1ca96-c8ba-422c-a314-80162fd3783e tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 200 len: 1506 microversion: 2.25 time: 0.391020 Sep 23 03:46:21.805991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1030/2000] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:21 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:21.826350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277ec34b-5e32-4cb8-9bf6-415e69c91490", "name": "network-vif-deleted", "tag": "4e104d32-d7cc-479a-aa07-77c2ae6fba1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:21.869826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.871033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.871641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.902976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] Creating event network-vif-deleted:4e104d32-d7cc-479a-aa07-77c2ae6fba1d for instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 on n-h1-858495-2 Sep 23 03:46:21.910671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-60bddeaa-7832-48fc-b999-f6eb0551a45d req-de185b54-a4f4-4cdf-9218-b25ff8fc9e33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101065 Sep 23 03:46:21.911934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1031/2001] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:21.917718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:21.919960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:21.927192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.928029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.929054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:21.930476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:21.931789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:21.932480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:22.195584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:22.208582 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba4824a9-f786-4307-af40-54c7f4127039 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1288 microversion: 2.1 time: 0.295187 Sep 23 03:46:22.211246 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1032/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:21 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1288 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:22.226998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:22.228238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:22.244129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:22.244631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:22.245073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:22.245826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:22.246282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:22.246711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.064293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:23.083330 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ccce9649-ae89-497e-b10b-6a104eee4f68 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1324 microversion: 2.1 time: 1.737623 Sep 23 03:46:23.097775 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 971/2003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:21 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1324 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:23.107585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-028067f2-da23-4c75-91f1-851ec2797597 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8ab3a8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:23.280330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:23.303945 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-feaa8aea-c04d-4bb0-b785-734cc87df17d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1199 microversion: 2.1 time: 1.081301 Sep 23 03:46:23.305170 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1033/2004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:22 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1199 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:23.316457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:23.319265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:23.342586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.344112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.345298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.346363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.347057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.347723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.564508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:23.576545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:23.580427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:23.605508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-792223c3-4fb6-45b2-865b-5190a0179967 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.298315 Sep 23 03:46:23.610503 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1034/2005] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:23 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:23.624497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:23.627625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 277ec34b-5e32-4cb8-9bf6-415e69c91490] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:23.650864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.652506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.654449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.658557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.661412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.662114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.714828 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] HTTP exception thrown: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Request method failure captured: Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 HTTP/1.1 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSo55tvbDpBvXzkjb2kSzAIbus30A_U8vz3l1hkvXEtPBT0PX1Drx5gK6G9wSn8ZrfBTYzpAlDMJRYaPElfdd8Q33iKRv_03hHMhbD7PHVLlqzDKvkpdDCYVErkbIwh4nuOM777IrH_cUayDGDta4o3ERALPL9Z0BNlh5EDpk0ma634 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:46:23.718760 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28c366e7ad9146d09218783c948d17db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28c366e7ad9146d09218783c948d17db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9855cf6129a34302a7e3e39d6a15a345 Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. Sep 23 03:46:23.720525 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '277ec34b-5e32-4cb8-9bf6-415e69c91490'} Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:23.722636 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. Sep 23 03:46:23.724088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:23.726367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Returning 404 to user: Instance 277ec34b-5e32-4cb8-9bf6-415e69c91490 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:23.726367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-907b1649-0d5d-4069-b21b-a79f4f9b3044 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490" status: 404 len: 111 microversion: 2.25 time: 0.111739 Sep 23 03:46:23.727493 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1035/2006] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:23 2022] GET /compute/v2.1/servers/277ec34b-5e32-4cb8-9bf6-415e69c91490 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:46:23.743898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef044de7-c729-4644-a0b4-0ebfb0984540", "name": "network-vif-plugged", "status": "completed", "tag": "d36ea68f-9979-486c-b11c-592454e1f695"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:23.760222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.761332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.761964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.780598 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] Creating event network-vif-plugged:d36ea68f-9979-486c-b11c-592454e1f695 for instance ef044de7-c729-4644-a0b4-0ebfb0984540 on n-h1-858495-2 Sep 23 03:46:23.790239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c0c12934-e8c0-4b96-b323-ef5e14b6cb35 req-4c6d27d9-bfe0-4d5d-b264-d5ff1a210d25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061106 Sep 23 03:46:23.791282 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1036/2007] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:23.799884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:23.800786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:23.809316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.810248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.811251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.812154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.812867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.813497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.838407 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-028067f2-da23-4c75-91f1-851ec2797597 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.742412 Sep 23 03:46:23.839747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 972/2008] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:23 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:23.857624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:23.858467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:23.870996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.871506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.871954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.872713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:23.873176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:23.873647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:23.909859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:24.002902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.029230 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b02e28f7-4d89-480e-820b-ac40fb39a1a4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1276 microversion: 2.1 time: 0.235119 Sep 23 03:46:24.032103 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1037/2009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:23 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:24.043658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7557276a-ed65-4364-8394-3d6a7d33ac1b", "tag": "99f80216-be02-4464-b052-3232c405ca92"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:24.072271 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96ddd118-dc6d-43ca-bc3d-80038813b5ed tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 204 len: 0 microversion: 2.25 time: 0.229780 Sep 23 03:46:24.077021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 973/2010] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:46:23 2022] DELETE /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:46:24.079329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.079329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.079329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.090281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:24.091100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:24.105889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] Creating event network-changed:99f80216-be02-4464-b052-3232c405ca92 for instance 7557276a-ed65-4364-8394-3d6a7d33ac1b on n-h1-858495-2 Sep 23 03:46:24.119083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5d7111ac-36bd-4217-9e32-ed40ac17ebbd req-21dc7f47-5e04-477f-9011-4c263c1ce05e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082477 Sep 23 03:46:24.119865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.121171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.127313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1038/2011] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:24.129326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.130204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.130696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.135559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.146329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:24.150867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:24.173314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.177503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.180354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.181175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.182613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.183066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.225492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:24.691878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.702377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.704347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.705814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62051f3e-afda-4f7b-a9fc-828b5e3d1114 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1563 microversion: 2.25 time: 0.622497 Sep 23 03:46:24.722700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 974/2012] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:24 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1563 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:24.731890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:24.732904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:24.741219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.743254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.744042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.745184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.745999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.746751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.759844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.781884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f4b6f969-c834-4366-b49b-0c1b8547603a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1324 microversion: 2.1 time: 0.651342 Sep 23 03:46:24.784184 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1039/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:24 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:24.800835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:24.801519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:24.813700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.814217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.814946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.815726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:24.816110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:24.817904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:24.973642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.988752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:24.992764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:25.003029 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f39b8bcf-a1ff-415a-b87e-6917e3886e98 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.215603 Sep 23 03:46:25.026188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1040/2014] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:24 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:25.039453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ece0cf38-93ee-4882-8cfe-430d79ed02cb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aa3f4c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:25.118169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ece0cf38-93ee-4882-8cfe-430d79ed02cb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.082454 Sep 23 03:46:25.119101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1041/2015] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:25 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:25.134832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:25.135919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:25.147647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.148143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.148582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:25.149295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.149859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.150434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:25.394287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:25.404002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a54586a8-6847-4b64-badd-230fda655c17 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1381 microversion: 2.1 time: 0.679187 Sep 23 03:46:25.406232 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 975/2016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:24 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1381 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:25.480332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:25.504774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4002aa43-cc3a-4aff-ae94-bfd2edb4af08 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1276 microversion: 2.1 time: 0.384243 Sep 23 03:46:25.507868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1042/2017] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:25 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:25.736718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:25.737369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:25.743537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.744032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.748745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:25.749984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.750637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.751255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:25.782542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:25.783793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:25.791833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.792335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.793589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:25.794961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:25.795309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:25.795861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:26.357232 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-629dbd4b-129c-47f8-b21b-68b81ee132e4 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1532 microversion: 2.1 time: 0.929516 Sep 23 03:46:26.366864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 976/2018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:25 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1532 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:26.373295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:26.374284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:26.387918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:26.389907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:26.391157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:26.393324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:26.394048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:26.395640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:26.421485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:26.438195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:26.443175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:26.444761 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f943132-3c65-40da-9c8f-690c0cbe33a3 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1563 microversion: 2.25 time: 0.711968 Sep 23 03:46:26.445603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1043/2019] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:25 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1563 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:46:26.462574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:26.463616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:26.475650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:26.476569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:26.477266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:26.478305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:26.478990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:26.479653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:26.990075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:26.999599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:27.010792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:27.024566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62824ad1-a66d-4d28-9021-665b95c83fa5 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1533 microversion: 2.91 time: 0.565881 Sep 23 03:46:27.025878 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1044/2020] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:26 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1533 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:27.033454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-105cddc7-4077-4f30-8281-0785f7b47dd8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93401ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:27.105070 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-105cddc7-4077-4f30-8281-0785f7b47dd8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.076511 Sep 23 03:46:27.105070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1045/2021] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:27 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:27.110345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:27.110969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:27.137324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:27.137896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:27.138334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:27.139051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:27.139508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:27.139934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:27.521006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:27.536284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7af04873-cb4b-49a1-b153-e660260aa95a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1324 microversion: 2.1 time: 1.167829 Sep 23 03:46:27.537038 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 977/2022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:26 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1324 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:27.545614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:27.547221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:27.559150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:27.560017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:27.560633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:27.563007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:27.563934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:27.564586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:27.982094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fe2229df-2278-4c11-b69d-2ffb53075fff tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1532 microversion: 2.1 time: 0.872358 Sep 23 03:46:27.983454 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1046/2023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:27 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1532 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:27.996281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:27.997883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:28.017426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.022352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.022978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.024602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.027106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.027639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.281506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lazy-loading 'services' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:28.282240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:28.291823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-19f4fbf5-be6a-4661-84da-cccb56968fe2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.753636 Sep 23 03:46:28.298140 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 978/2024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:27 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:28.331394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:28.333390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:28.335101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aef27e4b-626d-41e1-b648-b9aa8fa9a335 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1938 microversion: 2.91 time: 0.344580 Sep 23 03:46:28.338045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1047/2025] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:27 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1938 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:28.357394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80824846-9527-4e64-a5af-ca2581e87502", "name": "network-vif-deleted", "tag": "c85a94f1-4c3c-434e-bf3f-f49d96102895"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:28.367942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.368309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.368757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.369549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.369975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.370690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.386378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.386860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.387289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.400835 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] Creating event network-vif-deleted:c85a94f1-4c3c-434e-bf3f-f49d96102895 for instance 80824846-9527-4e64-a5af-ca2581e87502 on n-h2-858495-2 Sep 23 03:46:28.407505 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-389b213d-edfc-48ee-b90f-4f437e9ea731 req-279fbbf7-0bb7-41b0-ad1e-93fd8b6920f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067844 Sep 23 03:46:28.408705 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1048/2026] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:28.414353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:28.418426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.419708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.420308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.421247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.422155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.422752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.431963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.432835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.433668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.434341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lazy-loading 'fault' on Instance uuid 80824846-9527-4e64-a5af-ca2581e87502 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:28.460090 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-15d7e1af-d43e-4592-967a-12b78fe024c7 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049791 Sep 23 03:46:28.469096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1049/2027] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 03:46:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:28.479137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bdb8473-70a4-412a-b75a-3d162aac4951 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93357940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:28.541925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6bdb8473-70a4-412a-b75a-3d162aac4951 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.070477 Sep 23 03:46:28.543165 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1050/2028] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:28 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:28.548960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:28.550545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:28.560863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.561621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.562266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.563150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.563776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.565036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.592094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lazy-loading 'flavor' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:28.669745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:28.682773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:28.690966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9855cf6129a34302a7e3e39d6a15a345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c366e7ad9146d09218783c948d17db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:28.692814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ecc7d62d-c4a0-43b1-966c-1b21f3ecf872 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 200 len: 1352 microversion: 2.25 time: 0.367765 Sep 23 03:46:28.693841 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 979/2029] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:28 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 1352 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:28.698626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858495-2", "block_migration": false, "disk_over_commit": false}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:28.711016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:28.723151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.728145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.728824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.729966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.733275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.733860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.793547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lazy-loading 'flavor' on Instance uuid 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:46:28.821443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:28.841837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Going to try to live migrate instance to n-h1-858495-2 {{(pid=128723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 03:46:28.875229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:28.882479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5704537-814e-4fc2-b03a-9ba5225110cc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action" status: 202 len: 0 microversion: 2.91 time: 0.331997 Sep 23 03:46:28.883163 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1051/2030] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:46:28 2022] POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:46:28.938433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:28.945712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:28.972404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.975973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.979681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:28.984909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:28.986326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:28.989602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:29.430170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:29.804584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:29.830147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d475871-b0d1-4b75-aa40-7077ea1ae9c7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1324 microversion: 2.1 time: 0.933952 Sep 23 03:46:29.836698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1052/2031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:28 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1324 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:29.842648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:29.843270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:29.870313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:29.870797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:29.872209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:29.878314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:29.887473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:29.888282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:30.088766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:30.120821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:30.122478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:30.148683 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de3ea85a-db87-411f-998f-8251a651fb95 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.310280 Sep 23 03:46:30.152096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1053/2032] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:29 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:30.163172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:30.163810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:30.179722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:30.180852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:30.181234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:30.183906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:30.185951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:30.186460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:30.952331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:30.967358 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a0d6fe2-44b3-45cc-8b79-5ab0480f04b1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.813899 Sep 23 03:46:30.969744 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1054/2033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:30 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:30.977838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4781b7e1-a1d6-45c4-b93f-5145d189ff76 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c933783a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:31.054077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4781b7e1-a1d6-45c4-b93f-5145d189ff76 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.081407 Sep 23 03:46:31.055301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1055/2034] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:30 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:31.063031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:31.063843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] [instance: 80824846-9527-4e64-a5af-ca2581e87502] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:31.071161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.072020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.072698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.074258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.076661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.076661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.095995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] HTTP exception thrown: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Request method failure captured: Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 HTTP/1.1 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSo55tvbDpBvXzkjb2kSzAIbus30A_U8vz3l1hkvXEtPBT0PX1Drx5gK6G9wSn8ZrfBTYzpAlDMJRYaPElfdd8Q33iKRv_03hHMhbD7PHVLlqzDKvkpdDCYVErkbIwh4nuOM777IrH_cUayDGDta4o3ERALPL9Z0BNlh5EDpk0ma634 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:46:31.099153 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28c366e7ad9146d09218783c948d17db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28c366e7ad9146d09218783c948d17db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28c366e7ad9146d09218783c948d17db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 28c366e7ad9146d09218783c948d17db Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-61985118 Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9855cf6129a34302a7e3e39d6a15a345 Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-61985118-project Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. Sep 23 03:46:31.100748 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '80824846-9527-4e64-a5af-ca2581e87502'} Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:31.101863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. Sep 23 03:46:31.103938 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:46:31.106251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] Returning 404 to user: Instance 80824846-9527-4e64-a5af-ca2581e87502 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:31.106251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56ad311b-4d59-4160-bf70-c5b32e057819 tempest-LiveAutoBlockMigrationV225Test-61985118 tempest-LiveAutoBlockMigrationV225Test-61985118-project] 10.222.0.25 "GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502" status: 404 len: 111 microversion: 2.25 time: 0.044166 Sep 23 03:46:31.106644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1056/2035] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:31 2022] GET /compute/v2.1/servers/80824846-9527-4e64-a5af-ca2581e87502 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:46:31.113388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7557276a-ed65-4364-8394-3d6a7d33ac1b", "name": "network-vif-plugged", "status": "completed", "tag": "99f80216-be02-4464-b052-3232c405ca92"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:31.126748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.127243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.127689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.147211 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] Creating event network-vif-plugged:99f80216-be02-4464-b052-3232c405ca92 for instance 7557276a-ed65-4364-8394-3d6a7d33ac1b on n-h1-858495-2 Sep 23 03:46:31.154358 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ce7061f9-1f1d-41b8-928e-43af99f017e3 req-731b520f-8b5d-43b8-8496-175fddce8e9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Sep 23 03:46:31.155414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1057/2036] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:31.161626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:31.226410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.227133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.232236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.260815 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] Creating event network-changed:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:46:31.268400 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-07a7c55c-4b6e-4169-a784-55fe2f17e85c req-c2eca163-f662-4a2e-aa8e-07b63190c5db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111463 Sep 23 03:46:31.269730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1058/2037] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:31.276724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:31.277502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:31.288486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.288992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.289491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.290212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.290678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.291689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.382673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a689196f-1985-4ee6-b0d3-3da4b8db7fce tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4/action" status: 202 len: 0 microversion: 2.1 time: 2.687045 Sep 23 03:46:31.385338 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 980/2038] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:28 2022] POST /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4/action => generated 0 bytes in 2691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:46:31.396972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:31.398730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:31.447529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.448162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.455579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:31.456469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:31.473237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:31.473806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:32.276911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:32.293364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:32.297107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:32.305037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-928819d5-1e4c-4aac-ad6e-56d3a0045a94 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.917948 Sep 23 03:46:32.306436 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 981/2039] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:31 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:32.312184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:32.313027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:32.320075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:32.320784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:32.321421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:32.322311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:32.322944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:32.323637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:32.894247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:32.908134 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0436a3e7-21ce-421f-9124-0583f4d354f8 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1324 microversion: 2.1 time: 1.636489 Sep 23 03:46:32.908881 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1059/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:31 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1324 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:32.914862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1802347863", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "20fc79b7-beed-490e-98d7-ed69678651ff"}, {"uuid": "5e770110-b4e9-4203-ad35-4d08b8e23d78"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:33.053996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] validate_networks() for [('20fc79b7-beed-490e-98d7-ed69678651ff', None, None, None, None, None), ('5e770110-b4e9-4203-ad35-4d08b8e23d78', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:46:33.426546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:33.431758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:33.473032 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eaf30e6e-e860-47e1-90df-9d2d4efda21c tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 1.162757 Sep 23 03:46:33.478982 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 982/2041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:32 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:33.485751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:33.487057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:33.502948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:33.503607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:33.504235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:33.506776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:33.508281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:33.508988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:34.114853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:34.124799 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1a6fd5d-3b70-44a2-8c5e-1abb81911c64 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.644579 Sep 23 03:46:34.130890 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 983/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:33 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:34.138699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56668c65-94fb-4def-afdc-02b85749df35 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c9338e790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:34.231625 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56668c65-94fb-4def-afdc-02b85749df35 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.098848 Sep 23 03:46:34.232538 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 984/2043] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:34 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:34.241406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2", "tag": "9f0a6a9c-6365-4ab4-9b28-20d1213adb91"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:34.283608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:34.284196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:34.290005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:34.313710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] Creating event network-changed:9f0a6a9c-6365-4ab4-9b28-20d1213adb91 for instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 on n-h2-858495-2 Sep 23 03:46:34.327670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d2dfd65d-c10d-4b65-af00-3c162dbd54fc req-daabbc1f-81f0-4a84-b936-e21a7d6f8bf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093649 Sep 23 03:46:34.355415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 985/2044] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:34.368665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:34.369517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:34.395677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:34.396597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:34.398042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:34.405338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:34.405926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:34.407413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:34.842968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:34.852659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:34.859822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:34.872923 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b38e6a9-0084-4084-a009-d970c6bc4d4f tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.515860 Sep 23 03:46:34.877044 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 986/2045] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:34 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:34.884988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:34.885897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:34.911382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:34.915174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:34.918912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:34.920008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:34.922055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:34.925493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.290680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:46:35.292303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:46:35.293005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:46:35.294194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:46:35.294790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:46:35.319960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.320782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.325026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.326211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.326914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.327569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.374323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Getting quotas for project 2678db4b110743488fc73b3aa6b2f436. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:46:35.386991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Getting quotas for user 1d5dafda6670418da408ba0a18e567ba and project 2678db4b110743488fc73b3aa6b2f436. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:46:35.414788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:46:35.423865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:46:35.561823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7867befc-7490-4691-8fdb-715a2a89b7b1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.650580 Sep 23 03:46:35.564337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1060/2046] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:46:35.576751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:35.577998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:35.605022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.608367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.609087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.610065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.610543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.611524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.685982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:35.748829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:35.789773 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec0239a4-f90f-44fc-9390-f7e4e6e2cda6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 200 len: 1520 microversion: 2.1 time: 0.901795 Sep 23 03:46:35.794746 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 987/2047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:34 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 1520 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:35.814351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:35.818179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:35.846160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.850004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.851755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:35.856342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:35.859134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:35.861782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:36.219655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:36.232268 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d60f79b-68d4-4ac7-81f4-51efd2d56848 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.666811 Sep 23 03:46:36.236265 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1061/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:35 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:36.244257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30f31cfd-ed6f-411b-9c8b-149367515877 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8a94ddc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:36.356234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30f31cfd-ed6f-411b-9c8b-149367515877 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.117500 Sep 23 03:46:36.357639 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1062/2049] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:36 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:36.367203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-630da525-2de0-4968-97cb-ca2959e53595 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:36.387059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-630da525-2de0-4968-97cb-ca2959e53595 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:36.916865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-630da525-2de0-4968-97cb-ca2959e53595 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:36.933341 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-630da525-2de0-4968-97cb-ca2959e53595 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1213 microversion: 2.1 time: 0.571610 Sep 23 03:46:36.935020 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1063/2050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:36 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1213 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:36.955076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: .version_select at 0x7f0c918b69d0>, body: {"addFloatingIp": {"address": "172.25.2.49"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:36.960970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:36.991683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:36.998077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:36.998911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:36.999940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:37.001740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:37.004476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:37.210461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:37.213442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:46:37.213899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquired lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:46:37.235307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a00d61c-342b-4802-bf86-aae5b9c57789 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 1.435511 Sep 23 03:46:37.257925 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 988/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:35 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:37.300286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:37.300933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:37.327525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:37.332528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:37.335286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:37.337439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:37.340859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:37.344971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:38.134675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:38.158499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:38.171883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:38.182800 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-646d61f7-57ac-4c05-8caf-8b20bb252b38 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.917430 Sep 23 03:46:38.186355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 989/2052] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:37 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:38.204602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:38.205256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:38.214967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:38.216254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:38.216886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:38.217820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:38.222491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:38.223498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:38.876998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:38.887900 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1dd8eb8-6642-457d-a261-14161102d013 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.699290 Sep 23 03:46:38.889364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 990/2053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:38 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:38.896986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bd7bffa-919c-46e8-b8b5-7c134fc2f9ae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c933c2a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:38.975002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0bd7bffa-919c-46e8-b8b5-7c134fc2f9ae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1411 microversion: 2.1 time: 0.083525 Sep 23 03:46:38.976254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 991/2054] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:38 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:38.981483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:38.982337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:38.989766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:38.990520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:38.991170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:38.991889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:38.992345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:38.992773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:39.110604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:39.123549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e18e755e-3376-44a0-8d0c-00b48bb327db tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1271 microversion: 2.1 time: 0.143001 Sep 23 03:46:39.124194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 992/2055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:38 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:39.140758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:39.141957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:39.159286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:39.160169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:39.160846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:39.162008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:39.163718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:39.171537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:39.807077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:39.826647 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3553749-2274-4dff-95ac-8f08eba0ff95 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.698364 Sep 23 03:46:39.827406 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 993/2056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:39 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:39.832915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:39.833860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:39.842831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:39.843549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:39.844205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:39.845544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:39.846720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:39.848745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:40.126957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:40.142392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:40.143978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:40.178667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8db6af4d-7223-44e5-a98e-67ba91552c33 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.348897 Sep 23 03:46:40.196604 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 994/2057] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:39 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:40.209535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:40.220279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:40.221064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:40.221704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:40.240620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] Creating event network-vif-plugged:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:46:40.249147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ab36c14d-14fa-437b-a0b4-7315691bc19d req-88d0f9a6-cc83-4e5f-abf4-f52ab328831d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050648 Sep 23 03:46:40.250358 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 995/2058] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:40.255990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:40.257002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:40.264904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:40.265851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:40.266795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:40.268089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:40.269015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:40.269821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:41.486128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:41.497538 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7691f1f2-bb1f-41a0-8d6e-e05640566f63 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 1.245698 Sep 23 03:46:41.517714 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 996/2059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:40 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:41.524753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-73ab6396-e9da-45ac-9b2e-bb0f122aeefc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aa92790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:41.603168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-73ab6396-e9da-45ac-9b2e-bb0f122aeefc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1420 microversion: 2.1 time: 0.083841 Sep 23 03:46:41.610070 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 997/2060] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:41 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:41.626533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:41.627485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:41.649868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:41.651530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:41.652882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:41.654283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:41.657895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:41.659869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:41.966520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:41.985456 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4bd533d0-40b2-4aba-9151-5e04fbcc1eb0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.373866 Sep 23 03:46:41.991495 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 998/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:41 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:42.007255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:42.009213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:42.030334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:42.030334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:42.038573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:42.039727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:42.040420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:42.041095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:42.721335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:42.730230 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18a2c4be-2412-44b6-ad01-6cfd44b17f4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.737583 Sep 23 03:46:42.746059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 999/2062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:41 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:42.752638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:42.753834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:42.763957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:42.765878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:42.766802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:42.767733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:42.768369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:42.768981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:42.893805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:42.904543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:42.906491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:42.915440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1356fbd-0674-44f8-8cd5-2fe62a88a264 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.166919 Sep 23 03:46:42.916481 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1000/2063] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:42 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:42.922044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe991e8e-2b39-4a16-bf58-a101ddfef9bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aae8430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:42.983353 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe991e8e-2b39-4a16-bf58-a101ddfef9bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 200 len: 1420 microversion: 2.1 time: 0.065738 Sep 23 03:46:42.984282 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1001/2064] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:42 2022] GET /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:42.990012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "tag": "f0def56d-d025-4858-9783-f2d04ff4a1ae"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:43.001234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:43.002461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:43.003462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:43.019518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] Creating event network-changed:f0def56d-d025-4858-9783-f2d04ff4a1ae for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:46:43.026037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a812d2f9-cf8c-4c6a-82de-6219da8ea86b req-479e15c7-d4d7-469f-be1c-106d29725f30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040210 Sep 23 03:46:43.026753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1002/2065] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:43.033948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:43.034873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:43.042236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:43.042811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:43.043654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:43.044369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:43.044830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:43.045258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:43.493925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Building network info cache for instance {{(pid=128724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:46:43.517110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:43.529373 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56eb7b3b-5445-42a3-863c-60c92acab651 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.499970 Sep 23 03:46:43.545146 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1003/2066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:43 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:43.551206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6808d0dc-369d-4fd8-b3ee-e19473a75c65 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aae8430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:44.184991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6808d0dc-369d-4fd8-b3ee-e19473a75c65 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 204 len: 0 microversion: 2.1 time: 0.645153 Sep 23 03:46:44.185685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1004/2067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:43 2022] DELETE /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:46:44.191583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:44.192340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:44.207370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:44.210361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:44.211995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:44.212974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:44.215629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:44.218344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:44.737996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:44.750762 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff301149-779f-4c54-9887-3fcf864b9df1 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.558789 Sep 23 03:46:44.766938 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1005/2068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:44 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:44.766938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:44.780802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:44.781292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:44.781809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:44.795285 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] Creating event network-changed:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:46:44.802480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3f688616-65ed-436b-8534-a4dd6e7e1900 req-2176b014-beaa-42ff-b03e-3b1d7d608410 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047787 Sep 23 03:46:44.804787 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1006/2069] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:44.814392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:44.816169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:44.825863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:44.826915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:44.827538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:44.828801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:44.829269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:44.829784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:44.834696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:44.981625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Updating instance_info_cache with network_info: [{"id": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210", "address": "fa:16:3e:65:2c:99", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d3cbd9f-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:46:45.006777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Releasing lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:46:45.008792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f10a15cf-28c5-4e19-992b-aca2d7f2bad7 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action" status: 202 len: 0 microversion: 2.1 time: 8.068566 Sep 23 03:46:45.009887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1064/2070] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:36 2022] POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action => generated 0 bytes in 8074 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:46:45.015207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:45.016318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:45.025408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:45.028590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.029575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.030547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.031491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.032144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.032775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.128728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:45.149416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:45.166193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:45.170856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:45.172190 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f410cbba-023a-4670-96a9-71bf8dbac764 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.365855 Sep 23 03:46:45.173750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1007/2071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:44 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:45.191952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2fe64bf-85db-4a35-a7e1-ea936142c40a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.178063 Sep 23 03:46:45.194097 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1065/2072] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:45 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:45.195008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:45.197418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:45.211218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:45.217194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:45.221009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.221555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.223627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.225213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.225713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.226146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.232212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.232872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.233958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.234999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.239986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.240967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.287728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:45.348415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:45.426042 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3c667aa-6305-4a0c-b8d5-6049d4e36b13 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 204 len: 0 microversion: 2.1 time: 0.245085 Sep 23 03:46:45.427770 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1008/2073] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:46:45 2022] DELETE /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:46:45.438552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: .version_select at 0x7f0c918b49d0>, body: {"addFloatingIp": {"address": "172.25.2.49"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:45.453176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:45.481540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.482403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.483302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.484579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.485370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.486003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.591553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:46:45.592232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquired lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:46:45.627004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:45.638923 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fdc030cf-f23a-4938-a118-8811515b39a6 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.440675 Sep 23 03:46:45.640366 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1066/2074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:45 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:45.647361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "tag": "5ce48b43-d62e-42ae-adea-57b3136325b7"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:45.659713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.660206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.661332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.683458 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] Creating event network-changed:5ce48b43-d62e-42ae-adea-57b3136325b7 for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:46:45.692020 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-44c35c24-cf62-4a8b-ae4a-8a80bb85a5f2 req-d812a743-daf6-484c-bc3c-5b36bf4ee600 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049654 Sep 23 03:46:45.692578 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1067/2075] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:45.701573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2", "name": "network-vif-plugged", "status": "completed", "tag": "9f0a6a9c-6365-4ab4-9b28-20d1213adb91"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:45.713577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:45.714073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:45.714586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:45.728061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] Creating event network-vif-plugged:9f0a6a9c-6365-4ab4-9b28-20d1213adb91 for instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 on n-h2-858495-2 Sep 23 03:46:45.733509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72c5b655-3f5b-4459-abb4-072f91d2b702 req-030de03f-c880-4eb9-aa73-1360abe36ddf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039048 Sep 23 03:46:45.737330 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1068/2076] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:45.742766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2036726075", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1896f5f0-54eb-42f5-b3a9-0accb590ad4a"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:45.825859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] validate_networks() for [('1896f5f0-54eb-42f5-b3a9-0accb590ad4a', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:46:46.930509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:47.012753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:46:47.013185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:46:47.013681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:46:47.014091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:46:47.015107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:46:47.026396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.027631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.028082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.028879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.029387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.029814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.047663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:46:47.052210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for user 20166e829a544516a4adcdd3e0a4945e and project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:46:47.064309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:46:47.066800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:46:47.121876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51086b12-657d-4a30-a089-3170fcf64f1a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382412 Sep 23 03:46:47.122962 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1069/2077] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:46:47.131863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:47.132816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:47.142003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.142910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.143525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.144429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.145997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.147092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.435221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:47.448967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75b5689c-4686-46d4-b659-3b5c1e442e43 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.324248 Sep 23 03:46:47.450502 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1070/2078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:47 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:47.622201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:47.622607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:47.631177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.632146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.632788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.633716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.634447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.635055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.670378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:46:47.777864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-472d11b7-a4b5-459d-8d31-f065867d64e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 204 len: 0 microversion: 2.32 time: 0.325392 Sep 23 03:46:47.778833 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1071/2079] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:46:47 2022] DELETE /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:46:47.788595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:47.789621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:47.796647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.797144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.797614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:47.799912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:47.800452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:47.801440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:48.192170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:48.204542 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62674caa-58b2-4370-816b-654dbf4c96bd tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1318 microversion: 2.1 time: 0.421486 Sep 23 03:46:48.218178 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1072/2080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:47 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:48.223950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:48.224952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:48.231407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:48.232097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:48.242253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:48.243350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:48.243835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:48.244392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:48.381143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:48.391554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:48.393024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:48.407324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa7534a8-417a-4aaa-b818-39c8b7c8d373 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.187589 Sep 23 03:46:48.414271 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1073/2081] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:48 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:48.419487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:48.420009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:48.438903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:48.439449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:48.439822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:48.440546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:48.441006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:48.441461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.222334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:49.232783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9de41a3c-4c15-4a42-b032-c3066d5b49a7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.817319 Sep 23 03:46:49.237158 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1074/2082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:48 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:49.242469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:49.248107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:49.260922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.262242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.263858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.265651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.266653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.267564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.409400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:49.421324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ce49e89-43e2-4f3c-b379-0a5aebd88445 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1212 microversion: 2.1 time: 0.182398 Sep 23 03:46:49.423221 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1075/2083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:49 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1212 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:49.429626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef044de7-c729-4644-a0b4-0ebfb0984540", "name": "network-vif-unplugged", "status": "completed", "tag": "d36ea68f-9979-486c-b11c-592454e1f695"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:49.451750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.453223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.454384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.470046 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] Creating event network-vif-unplugged:d36ea68f-9979-486c-b11c-592454e1f695 for instance ef044de7-c729-4644-a0b4-0ebfb0984540 on n-h1-858495-2 Sep 23 03:46:49.480034 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5a225edd-8d09-4d44-8d44-ad56ea567153 req-e5fb960b-36ac-43c9-bfc6-18bd0fc347af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053846 Sep 23 03:46:49.482186 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1076/2084] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:49.488757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:49.489580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:49.491218 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.neutron [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] re-assign floating IP 172.25.2.49 from instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 Sep 23 03:46:49.497606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.498362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.511354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.513529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.514511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.515466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.599857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:46:49.962315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:49.973680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:49.979703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:49.981423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8167d71a-432d-4acd-94c1-21bf8d3082a9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2954 microversion: 2.32 time: 0.497715 Sep 23 03:46:49.983137 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1077/2085] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:49 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2954 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:49.988141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:49.988794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:49.995725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.997146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:49.997971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:49.998980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:49.999833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.000470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.548802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:50.561925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c868423-832d-4903-97ab-a2a092c05e0e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.574049 Sep 23 03:46:50.562576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1078/2086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:49 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:50.578884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef044de7-c729-4644-a0b4-0ebfb0984540", "name": "network-vif-deleted", "tag": "d36ea68f-9979-486c-b11c-592454e1f695"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:50.602767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.603518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.604178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.629531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] Creating event network-vif-deleted:d36ea68f-9979-486c-b11c-592454e1f695 for instance ef044de7-c729-4644-a0b4-0ebfb0984540 on n-h1-858495-2 Sep 23 03:46:50.638496 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8fa17f08-1743-4bd1-aa50-0540f1a17dd1 req-3836fc23-f3fa-4a07-88b0-d3170d64ea05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065165 Sep 23 03:46:50.639332 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1079/2087] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:50.645179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:50.646406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:50.655298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.656065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.656689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.657777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.658445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.659092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.846818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Updating instance_info_cache with network_info: [{"id": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210", "address": "fa:16:3e:65:2c:99", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d3cbd9f-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:46:50.882017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:46:50.901686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:50.905637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:50.911604 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-374e6390-2422-4461-b707-67065729e18f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1468 microversion: 2.1 time: 0.270659 Sep 23 03:46:50.912196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1080/2088] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:50 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:50.917214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:50.935587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.936005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.938274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.954475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] Creating event network-changed:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:46:50.970216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-711dd9c8-af11-4c04-9f88-1e6054b557c6 req-e8873c98-1040-4bc5-967c-aac885adf986 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049823 Sep 23 03:46:50.971470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1081/2089] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:50.977746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:50.979243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:50.989534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.990276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.990915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:50.992139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:50.993236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:50.995053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:51.208455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:51.226398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:51.228141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:51.244573 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc312ae1-9e0a-40ea-900c-f29162dfa2ed tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.271353 Sep 23 03:46:51.246538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1082/2090] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:50 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:51.253220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:51.254649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:51.267910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:51.269041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:51.269830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:51.271397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:51.272450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:51.273150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:51.780187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:51.788840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad120234-fc0f-4511-a8c2-095b3805d507 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.540728 Sep 23 03:46:51.789607 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1083/2091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:51 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:51.795886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:51.796856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:51.804245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:51.805124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:51.805798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:51.806771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:51.807630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:51.808313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:52.311507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:52.337220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9eb3faa-4ff4-4645-8ba4-e86816b03ec9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1260 microversion: 2.1 time: 0.545236 Sep 23 03:46:52.356843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1084/2092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:51 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1260 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:52.378399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:52.380342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:52.402116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:52.402795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:52.403350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:52.404435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:52.405112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:52.405737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.139885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Updating instance_info_cache with network_info: [{"id": "99f80216-be02-4464-b052-3232c405ca92", "address": "fa:16:3e:61:88:16", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99f80216-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:46:53.153622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.157584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Releasing lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:46:53.158991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-72392949-4206-45e5-9c59-de046503c612 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b/action" status: 202 len: 0 microversion: 2.1 time: 7.729865 Sep 23 03:46:53.164952 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1009/2093] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:45 2022] POST /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b/action => generated 0 bytes in 7736 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:46:53.172228 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7ea4805-ffb8-4b71-9ef1-9194586cc23f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1467 microversion: 2.1 time: 0.813020 Sep 23 03:46:53.173332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:53.175096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:53.182218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:53.184778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.185486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.185980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.186836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.187328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.188098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.194960 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1085/2094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:52 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1467 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:53.202364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:53.203833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:53.215037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.215808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.216670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.217709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.218938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.219609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.754519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.765530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.766965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.768238 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-985a7a58-4437-4303-8e99-9b8ad8f1f00e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2954 microversion: 2.32 time: 0.601753 Sep 23 03:46:53.780534 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1010/2095] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:53 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2954 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:53.782488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.785561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:53.786171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:53.793551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5649363-6d87-4963-8cbd-a7951394a5bf tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.596058 Sep 23 03:46:53.793931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.794727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.795360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.796398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.797038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.797670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.810489 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1086/2096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:53 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:53.831973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "name": "network-vif-plugged", "status": "completed", "tag": "5ce48b43-d62e-42ae-adea-57b3136325b7"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:53.849223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.849843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.850345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.865810 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] Creating event network-vif-plugged:5ce48b43-d62e-42ae-adea-57b3136325b7 for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:46:53.874819 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5b75eabd-b601-4028-be8b-fedd2b66c225 req-b52acf3c-f309-4291-81c5-0994125ac672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062914 Sep 23 03:46:53.878333 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1087/2097] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:53.891074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4", "name": "network-vif-unplugged", "status": "completed", "tag": "c5dc7bef-67db-4b67-ab56-93b1b29bff29"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:53.904223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.904891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.905489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.918458 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] Creating event network-vif-unplugged:c5dc7bef-67db-4b67-ab56-93b1b29bff29 for instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 on n-h2-858495-2 Sep 23 03:46:53.924046 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3d57b207-3f71-4b50-ac7c-d6f62bcf23e4 req-cce434ee-6a4e-4c2b-96de-dadd0b023339 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043660 Sep 23 03:46:53.928393 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1088/2098] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:53.938393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:53.939409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:53.947377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.948309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.950231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.951397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:53.952214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:53.954296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:53.970671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.979368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:53.991206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:54.000678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ea00d06-dd2e-40fc-acac-28a9a28e4204 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.218702 Sep 23 03:46:54.001580 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1011/2099] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:53 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:54.013643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7557276a-ed65-4364-8394-3d6a7d33ac1b", "tag": "99f80216-be02-4464-b052-3232c405ca92"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:54.035280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.042085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.042740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.061903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] Creating event network-changed:99f80216-be02-4464-b052-3232c405ca92 for instance 7557276a-ed65-4364-8394-3d6a7d33ac1b on n-h1-858495-2 Sep 23 03:46:54.079361 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-313fc217-b859-4a84-abe2-0fa8a9b7adb0 req-0d951ba7-9e93-4872-975d-d80d27d39e12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076123 Sep 23 03:46:54.080007 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1012/2100] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:54.085571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: .version_select at 0x7f0c918b4820>, body: {"removeFloatingIp": {"address": "172.25.2.49"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:54.440742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:54.450710 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99c1453d-9e34-4563-95a8-37cc32146ee4 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.520375 Sep 23 03:46:54.466298 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1089/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:53 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:54.474005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-816721134"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:54.476569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:54.484143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.484312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:54.484758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.485174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.485993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.486812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.487613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.501642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.502144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.502592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.504028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.504500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.504936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.765525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81194177-da47-4970-83c5-20803342535f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "POST /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce/action" status: 202 len: 0 microversion: 2.1 time: 0.297376 Sep 23 03:46:54.767583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1090/2102] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:54 2022] POST /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:46:54.774360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:54.775536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:54.784614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.785771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.786467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:54.787431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:54.788149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:54.788964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.007109 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] HTTP exception thrown: Floating IP 172.25.2.49 is not associated with instance b9bf4863-674f-444f-a69e-c9de78a3ddd9. Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Request method failure captured: Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action HTTP/1.1 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 48 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvd-g5VgerBNx4KLPCvt1-3LLju9Fkjenh1VMzIRpxJsUOlIJYrVIi_vAHtduMScCL10DKazJThefWAdrD_PJLxCUpj53M_ERHT4V7F19kDwnk73VAQNUz9BpW29KHKKC9mB3yhkzYB6RVJHIx3Hr4ToPXH1zTjm4onITABuVo70_M Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:46:55.008573 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b485f12af57540f1a70b1e77abb43552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 199e61a016b843f59b611324801381c6 Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: {"removeFloatingIp": {"address": "172.25.2.49"}} Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:46:55.010572 n-d-858495-2 devstack@n-api.service[128723]: exception: Floating IP 172.25.2.49 is not associated with instance b9bf4863-674f-444f-a69e-c9de78a3ddd9. Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'b9bf4863-674f-444f-a69e-c9de78a3ddd9', 'body': {'removeFloatingIp': {'address': '172.25.2.49'}}} Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.49 is not associated with instance b9bf4863-674f-444f-a69e-c9de78a3ddd9. Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:55.011833 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.49 is not associated with instance b9bf4863-674f-444f-a69e-c9de78a3ddd9. Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:46:55.013748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Returning 409 to user: Floating IP 172.25.2.49 is not associated with instance b9bf4863-674f-444f-a69e-c9de78a3ddd9. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:46:55.015391 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1dba7fcc-d534-4207-99ca-3a439b5496d5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action" status: 409 len: 145 microversion: 2.1 time: 0.932348 Sep 23 03:46:55.015391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1013/2103] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:54 2022] POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action => generated 145 bytes in 934 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:46:55.026663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec575349-af72-464a-ad34-f8a036fd926f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8aa963a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:55.067685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.080273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33dd75ed-2469-412e-9b91-cc41b06b8dc1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1308 microversion: 2.1 time: 0.310475 Sep 23 03:46:55.081047 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1091/2104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:54 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:55.087980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:55.088603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:55.094373 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec575349-af72-464a-ad34-f8a036fd926f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1454 microversion: 2.1 time: 0.074469 Sep 23 03:46:55.096764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1014/2105] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:55 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:55.102604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:55.103678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:55.108155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.108846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.109639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.110608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.111155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.112649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.122534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.123026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.123664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.126225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.126907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.130106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.515064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.525458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.529927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.531756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.535516 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0e1b798-25f8-4a06-b750-d99a78169946 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.437414 Sep 23 03:46:55.535743 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-15ea55fa-5912-4852-a269-7b601c3e0f01 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2933 microversion: 2.32 time: 0.453452 Sep 23 03:46:55.536516 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1015/2106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:55 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:55.552157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1092/2107] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:55 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2933 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:55.552157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:55.552157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:55.556545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.557521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.558193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.559099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.559732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.560402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.568113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.49"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:55.691739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.703140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.704866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:55.711808 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3dd2517-0cc8-4329-b7f4-5ee967fbb639 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.172990 Sep 23 03:46:55.729396 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1093/2108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:55 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:55.735053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:55.736266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:55.742903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.743410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.744192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:55.744831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:55.746045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:55.747081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.295534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:56.307617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.309877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.310592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.312076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.312779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.313677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.591445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:56.602028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30abbc82-b637-48f3-b37b-67014cde53cb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.871515 Sep 23 03:46:56.634295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1094/2109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:55 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:56.649332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "name": "network-vif-plugged", "status": "completed", "tag": "f0def56d-d025-4858-9783-f2d04ff4a1ae"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:56.663628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.664538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.665720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.680559 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] Creating event network-vif-plugged:f0def56d-d025-4858-9783-f2d04ff4a1ae for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:46:56.687945 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5529eaee-0cb8-4014-9efe-1246cca2ea0b req-1bf2be28-358d-4a23-a567-309fddc4155c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051973 Sep 23 03:46:56.689447 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1095/2110] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:56.696015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4", "tag": "c5dc7bef-67db-4b67-ab56-93b1b29bff29"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:56.709685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.710449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.711110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.725606 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] Creating event network-changed:c5dc7bef-67db-4b67-ab56-93b1b29bff29 for instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 on n-h2-858495-2 Sep 23 03:46:56.734494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a7073b4f-eee3-4873-a064-0cac7f4789b7 req-ab71a1c6-ac75-4644-8bea-44e4b59ea4d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043406 Sep 23 03:46:56.737426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1096/2111] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:56.753229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:56.757718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:56.780154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.780657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.781105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:56.787930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:56.813764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:56.814607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:57.038110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:57.061395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:57.174170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:46:57.174890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquired lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:46:57.604865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:57.623572 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf59ee33-2cc1-47ab-9393-8101593636da tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1308 microversion: 2.1 time: 0.881299 Sep 23 03:46:57.625725 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1097/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:56 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1308 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:57.637430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7aa8e63-f05f-4236-a303-5556b3d7e4fa tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b45d3a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:57.723586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7aa8e63-f05f-4236-a303-5556b3d7e4fa tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1454 microversion: 2.1 time: 0.096055 Sep 23 03:46:57.724179 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1098/2113] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:46:57 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:57.731676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:57.732285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:57.749284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:57.749986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:57.750639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:57.751738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:57.752490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:57.753086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:58.241136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.261026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4041f31a-f7df-40c2-9ee6-1cbca5ea36d7 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1334 microversion: 2.1 time: 0.535263 Sep 23 03:46:58.264545 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1099/2114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:57 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1334 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:58.273418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:58.276434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:58.292558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:58.293411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:58.293876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:58.295120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:58.298036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:58.299841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:58.325469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:58.811025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.821283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.822754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.825201 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d771b4c-5aa9-47d0-bc87-2cf27398b0b1 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2866 microversion: 2.32 time: 0.558591 Sep 23 03:46:58.825817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1100/2115] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:58 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2866 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:58.850925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:58.851859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:58.858384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:58.858996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:58.859448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:58.860155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:58.860615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:58.861069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:58.983450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.998362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:58.999827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:59.003563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:46:59.009754 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24e7d8e7-a4f6-4ecd-84e3-d379a74d9752 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.166216 Sep 23 03:46:59.017801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1101/2116] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:46:58 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:46:59.027016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:59.028106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:59.036558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:59.037245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:59.037832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:59.038780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:59.039523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:59.040056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:59.697920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:46:59.733464 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21634185-eff9-4626-95c3-3db034412c3b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.713789 Sep 23 03:46:59.748768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1102/2117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:59 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:46:59.760677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-deleted", "tag": "a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:46:59.772634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:59.773119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:59.774050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:59.789304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] Creating event network-vif-deleted:a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:46:59.796442 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9da2d18c-0bef-4851-acac-d31fbbfb69d7 req-78a610f8-89ca-4dfd-ab88-488a483ebafb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050494 Sep 23 03:46:59.797530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1103/2118] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:46:59.802944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:46:59.803653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:46:59.803827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:46:59.812254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:59.813075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:59.813559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:46:59.814957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:46:59.816363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:46:59.817130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:00.307865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:00.326039 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a080b455-9865-4d69-92b5-46dd0d45dd05 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1308 microversion: 2.1 time: 0.527143 Sep 23 03:47:00.327260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1104/2119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:46:59 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:00.349809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-unplugged", "status": "completed", "tag": "88d28e56-054a-4607-9395-9c4ece17b2b1"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-unplugged", "status": "completed", "tag": "a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd7259d-b43a-4662-9c32-fb99612627dd"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-unplugged", "status": "completed", "tag": "275db122-e490-4cee-bc28-544f7af60b07"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-unplugged", "status": "completed", "tag": "970b186d-c284-4ec2-8027-c9877ffd29a2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:00.363284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:00.364746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:00.365433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:00.382914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Creating event network-vif-unplugged:88d28e56-054a-4607-9395-9c4ece17b2b1 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:00.384354 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Creating event network-vif-unplugged:a9b4f8fb-3259-49a7-ad05-e1fcfe3fc77b for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:00.384880 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Creating event network-vif-unplugged:8bd7259d-b43a-4662-9c32-fb99612627dd for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:00.386581 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Creating event network-vif-unplugged:275db122-e490-4cee-bc28-544f7af60b07 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:00.387554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] Creating event network-vif-unplugged:970b186d-c284-4ec2-8027-c9877ffd29a2 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:00.396060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-afed910c-feed-46de-8570-5d3afc2a1d6f req-4a73b1a8-46df-47b7-a398-08efc8b1b4e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.067154 Sep 23 03:47:00.396946 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1105/2120] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:00.406625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afe2f9de-6d41-463a-9dbd-a034e01a5851 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b45db80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:00.490208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-afe2f9de-6d41-463a-9dbd-a034e01a5851 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1454 microversion: 2.1 time: 0.091525 Sep 23 03:47:00.490886 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1106/2121] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:00 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:00.496867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd3746-49c4-4ca2-8cff-9fa0ed50acde", "tag": "4925370a-4a19-4589-aa55-cbfe52b23cd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:00.512874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:00.513388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:00.513898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:00.528001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] Creating event network-changed:4925370a-4a19-4589-aa55-cbfe52b23cd6 for instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde on n-h1-858495-2 Sep 23 03:47:00.534175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0c976026-c51a-440a-a4e7-c984a3d1a292 req-9b035420-8dea-497c-907b-0445403f66f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041706 Sep 23 03:47:00.538034 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1107/2122] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:00.726625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dcfaae2-9dfb-48d5-9e5b-b73fbb9e7489 tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] Calling method '.version_select at 0x7f0c8b0b3dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:01.279028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dcfaae2-9dfb-48d5-9e5b-b73fbb9e7489 tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 9398 microversion: 2.1 time: 0.739629 Sep 23 03:47:01.283447 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1108/2123] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:47:00 2022] GET /compute/v2.1/os-networks => generated 9398 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:01.288248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:01.289080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:01.296043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.296545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.297018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:01.297927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.298550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.299544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:01.860221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Updating instance_info_cache with network_info: [{"id": "99f80216-be02-4464-b052-3232c405ca92", "address": "fa:16:3e:61:88:16", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99f80216-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:47:01.881679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Releasing lock "refresh_cache-7557276a-ed65-4364-8394-3d6a7d33ac1b" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:47:01.882547 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-407e8c4f-177a-4f1b-a49a-a6eb84334ad4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b/action" status: 202 len: 0 microversion: 2.1 time: 6.344911 Sep 23 03:47:01.886966 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1016/2124] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:46:55 2022] POST /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b/action => generated 0 bytes in 6346 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:47:01.894373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:01.894991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:01.903773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.904274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.904715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:01.905584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.906043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.906660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:01.944021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:01.959399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0231152e-b580-4a58-8119-23bb7111720e tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1670 microversion: 2.1 time: 0.674781 Sep 23 03:47:01.961003 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1109/2125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:01 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1670 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:01.968174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:01.969127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:01.978187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.979691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.980328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:01.981236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:01.981807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:01.982377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.104034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.114690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.116262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.122615 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0dad4b5-d20e-4a4b-b57a-9ab929e8770a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1560 microversion: 2.91 time: 0.160044 Sep 23 03:47:02.139310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1110/2126] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:01 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:02.154351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.155217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:02.163768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.164577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.190661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.190923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.191068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.191068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.191068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.191226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.196285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.201868 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ad5394a-b1ce-4beb-860e-102797abb251 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2706 microversion: 2.32 time: 0.317574 Sep 23 03:47:02.229701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1017/2127] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:01 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2706 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:02.237766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71ea9316-685b-4111-a88b-8ac0fbcb128c tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] Calling method '.version_select at 0x7f0c8aacc8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.492360 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71ea9316-685b-4111-a88b-8ac0fbcb128c tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/aeba3486-51aa-4773-88f5-0f88525e575c" status: 200 len: 652 microversion: 2.1 time: 0.260509 Sep 23 03:47:02.492910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1018/2128] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:47:02 2022] GET /compute/v2.1/os-networks/aeba3486-51aa-4773-88f5-0f88525e575c => generated 652 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:02.498075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.498684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:02.506764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.507257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.510337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.510337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.510337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.510337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.519391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:02.529942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b521592-16f7-4bf4-bfbc-60c1d0942880 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.389022 Sep 23 03:47:02.530830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1111/2129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:02 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:02.540546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38724a9b-bf12-44aa-b714-8513295c2d2f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b403ee0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.599828 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38724a9b-bf12-44aa-b714-8513295c2d2f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1454 microversion: 2.1 time: 0.066363 Sep 23 03:47:02.600413 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1112/2130] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:02 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:02.609964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7557276a-ed65-4364-8394-3d6a7d33ac1b", "tag": "99f80216-be02-4464-b052-3232c405ca92"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-deleted", "tag": "88d28e56-054a-4607-9395-9c4ece17b2b1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:02.622151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.622645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.623085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.639857 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Creating event network-changed:99f80216-be02-4464-b052-3232c405ca92 for instance 7557276a-ed65-4364-8394-3d6a7d33ac1b on n-h1-858495-2 Sep 23 03:47:02.640371 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] Creating event network-vif-deleted:88d28e56-054a-4607-9395-9c4ece17b2b1 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:02.648360 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1459b6de-7b16-4c9d-85b9-56d2f7fa6033 req-91330701-78f7-44a6-b75d-d9362938608f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046742 Sep 23 03:47:02.649145 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1113/2131] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:02.655213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.656175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:02.663507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.664683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.665708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.681505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.682370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.683018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.717624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:47:02.879036 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad0a2844-0780-4872-a9b0-6ed2bbb1dc3f tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 204 len: 0 microversion: 2.1 time: 0.228167 Sep 23 03:47:02.882062 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1114/2132] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:02 2022] DELETE /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:47:02.898053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:02.898737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:02.916203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.916724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.917216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.917980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.918448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.918882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:02.959328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d7ae500-0838-49f6-9baa-13353e043aff tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d/ips" status: 200 len: 180 microversion: 2.1 time: 0.074768 Sep 23 03:47:02.969690 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1115/2133] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:47:02 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d/ips => generated 180 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:02.975381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:02.987627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:02.988283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:02.989342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.002678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] Creating event network-vif-plugged:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:47:03.007877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-aabfd612-21ab-4277-abc4-b883a1ff2db9 req-5149e029-0e2d-4a14-bf62-170c7eec2b70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036253 Sep 23 03:47:03.008448 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1116/2134] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:03.013906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a571309c-32bf-453f-942c-a78b79f2a745 tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] Calling method '.version_select at 0x7f0c8b403700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:03.034621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:03.043979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d542ba66-4d2b-4230-8894-571e6b50f3a4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1308 microversion: 2.1 time: 0.549824 Sep 23 03:47:03.044979 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1019/2135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:02 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:03.050039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.49"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:03.053773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:03.060460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.061255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.061850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.062651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.063192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.064014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.092429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:47:03.092846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquired lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:47:03.380008 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a571309c-32bf-453f-942c-a78b79f2a745 tempest-NetworksTest-1469392071 tempest-NetworksTest-1469392071-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 9398 microversion: 2.1 time: 0.370435 Sep 23 03:47:03.383221 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1117/2136] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:47:03 2022] GET /compute/v2.1/os-networks => generated 9398 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:03.393175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:03.394194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:03.403151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.404308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.405035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.406692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.407649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.408275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.444921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:47:03.565770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6eb3dedf-6b99-4c84-ae05-6cc7404670b0 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 204 len: 0 microversion: 2.1 time: 0.180486 Sep 23 03:47:03.569774 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1118/2137] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:03 2022] DELETE /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:47:03.577147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:03.577973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:03.588242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.589665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.590304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.591278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.592906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.593552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.729664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:03.741273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:03.743795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:03.756344 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33deb944-2271-4d04-9fc1-1c337b8efadf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1560 microversion: 2.91 time: 0.185141 Sep 23 03:47:03.769566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1119/2138] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:03 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:03.773747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:03.778392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:03.786163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.786163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.786163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:03.786163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:03.786533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:03.786533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:04.257534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:04.276261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:04.278123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:04.279707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31379166-6752-4eb3-a17c-afd4a101433e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2660 microversion: 2.32 time: 0.521146 Sep 23 03:47:04.281427 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1120/2139] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:03 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2660 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:04.291429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:04.296789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:04.313171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:04.313737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:04.314184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:04.314913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:04.315723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:04.316547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:04.340006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:04.833660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:04.844304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0a1513c-ea60-4481-9c7f-0f5c87ef7c4a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1391 microversion: 2.1 time: 0.561513 Sep 23 03:47:04.844950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1121/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:04 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1391 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:04.852221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:04.852848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:04.861005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:04.861801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:04.862478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:04.863462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:04.864007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:04.864525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:05.134066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:05.144237 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7eda7084-375b-4c60-9568-6e4bfa1b5dc4 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1676 microversion: 2.1 time: 0.298228 Sep 23 03:47:05.145288 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1122/2141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:04 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:05.162504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d948dfc2-5c21-4484-ad80-fa8eee9d8c33 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b4030d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:05.251037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d948dfc2-5c21-4484-ad80-fa8eee9d8c33 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1454 microversion: 2.1 time: 0.104408 Sep 23 03:47:05.252571 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1123/2142] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:05 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:05.269040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:05.269858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:05.281457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:05.282273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:05.283248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:05.286766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:05.288983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:05.304134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:05.366816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:47:07.102241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:07.128101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75d902f0-2134-4af6-9368-3b1df96c4f8e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1308 microversion: 2.1 time: 1.873807 Sep 23 03:47:07.158174 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1124/2143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:05 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1308 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:07.174074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-deleted", "tag": "970b186d-c284-4ec2-8027-c9877ffd29a2"}, {"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-deleted", "tag": "275db122-e490-4cee-bc28-544f7af60b07"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:07.213416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:07.215181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:07.216158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:07.263714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Creating event network-vif-deleted:970b186d-c284-4ec2-8027-c9877ffd29a2 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:07.264479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] Creating event network-vif-deleted:275db122-e490-4cee-bc28-544f7af60b07 for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:07.271331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7f252915-637b-44b4-9742-426af23c76e5 req-874e4c76-53a9-43e5-8719-f259a91b970e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111317 Sep 23 03:47:07.273754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1125/2144] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:07.284178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:07.292073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:07.305430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:07.308886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:07.309592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:07.310490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:07.314196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:07.314862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:07.797584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:07.811984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:07.820655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:07.840655 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7c26043-5eae-44f7-ac0e-0d7fdebd2c9b tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.564989 Sep 23 03:47:07.857957 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1126/2145] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:07 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:07.872008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd3746-49c4-4ca2-8cff-9fa0ed50acde", "name": "network-vif-plugged", "status": "completed", "tag": "4925370a-4a19-4589-aa55-cbfe52b23cd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:07.894902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:07.897109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:07.899440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:07.958934 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] Creating event network-vif-plugged:4925370a-4a19-4589-aa55-cbfe52b23cd6 for instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde on n-h1-858495-2 Sep 23 03:47:07.996666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-628ea9af-d5b3-4b26-8206-7c6955b9016d req-9610614c-de31-498a-9056-fa5b541f71f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136378 Sep 23 03:47:08.004407 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1127/2146] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:08.015648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:08.021526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:08.037200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:08.042649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:08.047730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:08.048719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:08.049430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:08.050086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:08.620792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:08.649582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:08.651587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:08.658779 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60039676-dc80-457c-b2cb-2405ddb3d0eb tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 2213 microversion: 2.32 time: 0.652070 Sep 23 03:47:08.689895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1128/2147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:08 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 2213 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:08.696735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:08.700332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:08.711427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:08.717824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:08.718599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:08.719538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:08.720327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:08.720942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:09.410650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Updating instance_info_cache with network_info: [{"id": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210", "address": "fa:16:3e:65:2c:99", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d3cbd9f-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:47:09.429235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Releasing lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:47:09.430185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0d4e42c-0163-4668-af91-ed6092cc6fb5 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action" status: 202 len: 0 microversion: 2.1 time: 6.384003 Sep 23 03:47:09.430815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1020/2148] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:47:03 2022] POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action => generated 0 bytes in 6385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:47:09.467375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:09.493454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:09.546635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:09.547508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:09.555954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:09.561186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:09.562061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:09.564640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:09.570456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:10.094145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:10.117941 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30a2667d-5839-4348-9ab1-003d56ffe556 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1381 microversion: 2.1 time: 1.424292 Sep 23 03:47:10.123811 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1129/2149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:08 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1381 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:10.134286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-069f9baf-5e44-4d0c-873f-6d591a7f189b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b535550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:10.634017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5dafda6670418da408ba0a18e567ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2678db4b110743488fc73b3aa6b2f436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:10.643331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a193712-32d4-416d-9c93-a513b95330da tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 200 len: 1655 microversion: 2.1 time: 1.211388 Sep 23 03:47:10.644032 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1021/2150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:09 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 1655 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:10.680838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:10.681545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:10.739096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:10.739603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:10.740052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:10.740772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:10.741238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:10.763387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:11.784334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:11.803366 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-968a9f9d-d271-4578-b520-6a5f53a5e7fe tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1488 microversion: 2.1 time: 1.156730 Sep 23 03:47:11.819240 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1022/2151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:10 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1488 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:11.845842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:11.850008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:11.864797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:11.873741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:11.874597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:11.877758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:11.879636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:11.881073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:12.009479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:12.030052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:12.032932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:12.040467 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75c834d1-e6bc-47d5-a853-174b4cd65e22 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.219665 Sep 23 03:47:12.052039 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1023/2152] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:11 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:12.060045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8093b3b4-d56f-4a68-ae3c-9080b0c960d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '.version_select at 0x7f0c933a34c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:12.386874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8093b3b4-d56f-4a68-ae3c-9080b0c960d6 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/abad3f0b-47ab-43ca-b63b-11eecee5db8f" status: 200 len: 184 microversion: 2.1 time: 0.330905 Sep 23 03:47:12.396111 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1024/2153] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:47:12 2022] GET /compute/v2.1/os-floating-ips/abad3f0b-47ab-43ca-b63b-11eecee5db8f => generated 184 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:12.748695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d9fe1f48-5961-423e-9776-8b17fee3d4a1 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] Calling method '.version_select at 0x7f0c8aa2eaf0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:12.771790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d9fe1f48-5961-423e-9776-8b17fee3d4a1 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.374099 Sep 23 03:47:12.780457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1025/2154] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:47:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:12.792949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:12.826951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:12.827711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:12.828729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:12.860891 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] Creating event network-changed:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:47:12.874090 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-67d50f90-0053-4c7b-99c0-ff55667707de req-23fc2f3b-d06a-48d8-b5a2-939a9aef1cff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091731 Sep 23 03:47:12.876905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1026/2155] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:12.888861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:12.890183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:12.912393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:12.913239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:12.916261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:12.917788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:12.918473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:12.920161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.117604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:13.151047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:13.228510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:13.230787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02b94cb0-8aba-4bab-8aa9-d8bf19254081 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.352387 Sep 23 03:47:13.236137 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1027/2156] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:12 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:13.254650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "name": "network-vif-deleted", "tag": "5ce48b43-d62e-42ae-adea-57b3136325b7"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:13.281159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.281785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.282306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.311991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] Creating event network-vif-deleted:5ce48b43-d62e-42ae-adea-57b3136325b7 for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:47:13.322874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a060d71b-835a-4285-aeaf-55d6ec7cf9de req-b1624243-f2fe-4a6e-85ac-4bcedb9c0678 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085340 Sep 23 03:47:13.327162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1028/2157] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:13.340516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-893b0fc7-01cd-4d9a-a69f-dd54e11fa491 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '.version_select at 0x7f0c8aae60d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:13.359451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893b0fc7-01cd-4d9a-a69f-dd54e11fa491 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.360171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893b0fc7-01cd-4d9a-a69f-dd54e11fa491 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.371305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893b0fc7-01cd-4d9a-a69f-dd54e11fa491 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.388573 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-893b0fc7-01cd-4d9a-a69f-dd54e11fa491 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1554 microversion: 2.1 time: 0.060005 Sep 23 03:47:13.401892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1029/2158] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 03:47:13 2022] GET /compute/v2.1/os-migrations => generated 1554 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:13.409660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "name": "network-vif-unplugged", "status": "completed", "tag": "f0def56d-d025-4858-9783-f2d04ff4a1ae"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:13.436640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.437129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.437612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.459670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] Creating event network-vif-unplugged:f0def56d-d025-4858-9783-f2d04ff4a1ae for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:47:13.470351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-88ccb15b-04a2-474b-9b1a-fb430ba3d3fd req-9bed982d-1fd1-4328-9210-18a569552659 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064364 Sep 23 03:47:13.482312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1030/2159] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:13.488762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:13.489632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:13.501638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.502127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.502583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.503307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.503777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.504231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.537326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d HTTP/1.1 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:13.539039 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:13.540026 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '88c7b589-f393-4f9e-bf6e-785fa85c200d'} Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:13.540589 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:13.541707 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:13.542723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:13.542723 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc2db374-9e50-4a80-a02a-61368fdb3cce tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 404 len: 111 microversion: 2.1 time: 0.056973 Sep 23 03:47:13.562051 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1031/2160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:13 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:13.567175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:13.582701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:13.583200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:13.586578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:13.803939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 03:47:13.942012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a371a666-c425-42a6-8425-6c93753cadbb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde/action" status: 202 len: 0 microversion: 2.1 time: 0.377175 Sep 23 03:47:13.944427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1032/2161] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:47:13 2022] POST /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:47:13.964436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.49"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:14.462484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:14.472210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:14.472718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:14.473239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:14.473898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:14.474366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:14.474797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:14.996540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:47:14.997162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquired lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:47:17.264156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:47:18.542729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Updating instance_info_cache with network_info: [{"id": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210", "address": "fa:16:3e:65:2c:99", "network": {"id": "408d828c-53fb-45a4-8e7a-9fdf28c75147", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-189070552-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b485f12af57540f1a70b1e77abb43552", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d3cbd9f-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:47:18.563944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Releasing lock "refresh_cache-b9bf4863-674f-444f-a69e-c9de78a3ddd9" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:47:18.564882 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0974aed5-02fc-4353-b0c3-9276020df171 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action" status: 202 len: 0 microversion: 2.1 time: 4.615956 Sep 23 03:47:18.566051 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1033/2162] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:47:13 2022] POST /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9/action => generated 0 bytes in 4621 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:47:18.575858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94c49687-5a84-40e0-b6ec-60cb642e9020 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8aafaf70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:18.711855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:19.088659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=12,nova_api:INSERT=11 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:19.140710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94c49687-5a84-40e0-b6ec-60cb642e9020 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.567647 Sep 23 03:47:19.142954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1034/2163] 10.222.0.25 () {60 vars in 1206 bytes} [Fri Sep 23 03:47:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:19.149688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:19.150322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:19.158034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.158542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.158992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.159718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.160188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.160628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.283936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:19.300724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:19.302302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:19.320050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3845882e-975d-4b7a-9fd4-8ce82fed4abc tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.174829 Sep 23 03:47:19.337392 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1035/2164] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:19 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:19.337392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:19.337392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:19.361231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.362438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.363199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.364124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.365607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.367325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.671849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a35bec2b-597a-44aa-b90d-e11a096be700 tempest-LiveMigrationTest-43138581 tempest-LiveMigrationTest-43138581-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1532 microversion: 2.1 time: 0.341264 Sep 23 03:47:19.672924 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1036/2165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:19 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1532 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:19.678917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:19.679532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:19.701990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.702516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.702980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.703711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.704289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.704725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.888742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:19.900224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f999a2d-5dd7-475c-9c99-3899a4903e74 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.225299 Sep 23 03:47:19.901304 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1037/2166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:19 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:19.906255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:19.907040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:19.914213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.914875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.915447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.916849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:19.917624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:19.918181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:19.987940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.016701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.023391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.025054 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4ac3d28-2166-4470-ac01-96ec4240b8e5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.122844 Sep 23 03:47:20.026851 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1038/2167] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:19 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:20.031858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34b510-4e6d-4625-a7ae-80cce03e399b", "name": "network-vif-deleted", "tag": "8bd7259d-b43a-4662-9c32-fb99612627dd"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:20.050564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.051205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.051811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.078390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] Creating event network-vif-deleted:8bd7259d-b43a-4662-9c32-fb99612627dd for instance 6f34b510-4e6d-4625-a7ae-80cce03e399b on n-h1-858495-2 Sep 23 03:47:20.084840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-833bb43a-3cc3-4f27-8a6b-a9c39e3eeaba req-db3d5e15-fdf9-4743-b36f-6daa7b7a284a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056577 Sep 23 03:47:20.086040 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1039/2168] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:20.092284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7557276a-ed65-4364-8394-3d6a7d33ac1b", "name": "network-vif-deleted", "tag": "99f80216-be02-4464-b052-3232c405ca92"}, {"server_uuid": "88c7b589-f393-4f9e-bf6e-785fa85c200d", "name": "network-vif-deleted", "tag": "f0def56d-d025-4858-9783-f2d04ff4a1ae"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:20.104124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.104827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.105446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.113024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:20.127745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Creating event network-vif-deleted:99f80216-be02-4464-b052-3232c405ca92 for instance 7557276a-ed65-4364-8394-3d6a7d33ac1b on n-h1-858495-2 Sep 23 03:47:20.128623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] Creating event network-vif-deleted:f0def56d-d025-4858-9783-f2d04ff4a1ae for instance 88c7b589-f393-4f9e-bf6e-785fa85c200d on n-h1-858495-2 Sep 23 03:47:20.135830 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8438f61b-8e89-4b65-b18a-0c0b4b926598 req-bffcf3ce-24be-499c-9d92-ac070353c521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048082 Sep 23 03:47:20.137423 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1040/2169] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:20.144959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.145876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.157715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.162095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.162995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.164652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.165412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.166063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.198370 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d HTTP/1.1 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:20.200429 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.201511 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '88c7b589-f393-4f9e-bf6e-785fa85c200d'} Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:20.202100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.203067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.205602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:20.206720 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-651543c1-4b39-4933-bafc-42b7da4c1490 tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 404 len: 111 microversion: 2.1 time: 0.067935 Sep 23 03:47:20.207810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1041/2170] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:20 2022] DELETE /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:20.213634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.214444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.221502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.222358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.223030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.223981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.224647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.227713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.244400 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] HTTP exception thrown: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Request method failure captured: Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b HTTP/1.1 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvd-g5VgerBNx4KLPCvt1-3LLju9Fkjenh1VMzIRpxJsUOlIJYrVIi_vAHtduMScCL10DKazJThefWAdrD_PJLxCUpj53M_ERHT4V7F19kDwnk73VAQNUz9BpW29KHKKC9mB3yhkzYB6RVJHIx3Hr4ToPXH1zTjm4onITABuVo70_M Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:20.246590 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b485f12af57540f1a70b1e77abb43552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 199e61a016b843f59b611324801381c6 Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.247673 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7557276a-ed65-4364-8394-3d6a7d33ac1b'} Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:20.248234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.249164 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.251583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Returning 404 to user: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:20.252656 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7fdf84d-b0cb-4d32-a726-ab2007bbe143 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 404 len: 111 microversion: 2.1 time: 0.043709 Sep 23 03:47:20.257316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1042/2171] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:20 2022] DELETE /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:20.263988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81a98df7-3416-4047-a229-1f1e51ef7204 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] Calling method '.version_select at 0x7f0c8aa96ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.279136 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81a98df7-3416-4047-a229-1f1e51ef7204 tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.019719 Sep 23 03:47:20.279734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1043/2172] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 03:47:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:20.284297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.284800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.291211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.292534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.293207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.294157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.294842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.295477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.331335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:47:20.373970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:20.458837 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77cb8879-777e-4942-9732-06f3b353c9dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 204 len: 0 microversion: 2.1 time: 0.177769 Sep 23 03:47:20.459931 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1044/2173] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:20 2022] DELETE /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:47:20.467638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.468756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: 88c7b589-f393-4f9e-bf6e-785fa85c200d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.477087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.477843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.478385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.479838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.480625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.481684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.502163 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d HTTP/1.1 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:20.504018 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.506154 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '88c7b589-f393-4f9e-bf6e-785fa85c200d'} Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:20.506902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. Sep 23 03:47:20.508731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.511271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance 88c7b589-f393-4f9e-bf6e-785fa85c200d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:20.511271 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90007073-72ed-4020-add0-4301a00c485f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d" status: 404 len: 111 microversion: 2.1 time: 0.044754 Sep 23 03:47:20.511271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1045/2174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:20 2022] GET /compute/v2.1/servers/88c7b589-f393-4f9e-bf6e-785fa85c200d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:20.516642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.517430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: 7557276a-ed65-4364-8394-3d6a7d33ac1b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.524684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.526195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.526765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.527591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.528163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.528741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.549214 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] HTTP exception thrown: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Request method failure captured: Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b HTTP/1.1 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvd-g5VgerBNx4KLPCvt1-3LLju9Fkjenh1VMzIRpxJsUOlIJYrVIi_vAHtduMScCL10DKazJThefWAdrD_PJLxCUpj53M_ERHT4V7F19kDwnk73VAQNUz9BpW29KHKKC9mB3yhkzYB6RVJHIx3Hr4ToPXH1zTjm4onITABuVo70_M Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:20.555001 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b485f12af57540f1a70b1e77abb43552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 199e61a016b843f59b611324801381c6 Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.556239 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7557276a-ed65-4364-8394-3d6a7d33ac1b'} Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:20.556926 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. Sep 23 03:47:20.558416 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:20.559297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Returning 404 to user: Instance 7557276a-ed65-4364-8394-3d6a7d33ac1b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:20.563061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d622eaf3-0e5b-4506-8406-6064103c501c tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b" status: 404 len: 111 microversion: 2.1 time: 0.049089 Sep 23 03:47:20.566983 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1046/2175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:20 2022] GET /compute/v2.1/servers/7557276a-ed65-4364-8394-3d6a7d33ac1b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:20.573194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82382bcf-442b-4689-953b-03816f58c7ca tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8aafad30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:20.741981 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-82382bcf-442b-4689-953b-03816f58c7ca tempest-QuotaClassesAdminTestJSON-731219970 tempest-QuotaClassesAdminTestJSON-731219970-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.172682 Sep 23 03:47:20.757184 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1047/2176] 10.222.0.25 () {60 vars in 1206 bytes} [Fri Sep 23 03:47:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:20.787336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.788366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:20.798573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.799542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.799759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.800583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:20.801165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:20.802050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:20.947203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.958698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.962823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:20.981991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5174db9c-a530-4e17-9eaf-82033a5867b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.214437 Sep 23 03:47:20.983100 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1048/2177] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:20 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:20.995620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:20.998086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:21.011964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:21.012645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:21.015739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:21.016490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:21.017069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:21.021588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:21.379596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:21.396989 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93aa14bd-68a7-40de-bc66-ee624c4f032a tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1387 microversion: 2.1 time: 0.412474 Sep 23 03:47:21.398191 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1049/2178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:20 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1387 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:21.405185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:21.412132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:21.444752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:21.448202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:21.454703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:21.476834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:21.477857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:21.478923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:21.512486 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 HTTP/1.1 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:21.515063 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:21.516609 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'bde2c78e-cdd1-4b75-8a65-667bf8d47075'} Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:21.517303 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:21.518511 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:21.521240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:21.524131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ddedf1d-f3ee-4e61-8170-728a7903e31f tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 404 len: 111 microversion: 2.1 time: 0.124727 Sep 23 03:47:21.529568 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1050/2179] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:21 2022] DELETE /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:21.534986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aa1acf8b-37c9-41db-b544-fba12668c967 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '.version_select at 0x7f0c933871f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:23.350908 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aa1acf8b-37c9-41db-b544-fba12668c967 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/abad3f0b-47ab-43ca-b63b-11eecee5db8f" status: 202 len: 0 microversion: 2.1 time: 1.821777 Sep 23 03:47:23.353454 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1051/2180] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:47:21 2022] DELETE /compute/v2.1/os-floating-ips/abad3f0b-47ab-43ca-b63b-11eecee5db8f => generated 0 bytes in 1825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:47:23.360946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:23.363068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:23.384629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:23.386433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:23.389119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:23.391369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:23.393813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:23.396198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:23.726447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:23.735260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b15c5073-16a1-4084-aca1-f8502694d480 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.379500 Sep 23 03:47:23.739333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1052/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:23 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:23.745965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:23.746594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:23.768836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:23.769855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:23.770323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:23.773514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:23.774084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:23.774555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:23.908641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:23.923432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:23.926201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:23.927439 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f56d5df5-2996-4b6e-8e6b-a29ce45f78e9 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.187084 Sep 23 03:47:23.937490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1053/2182] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:23 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:23.951103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:23.951754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] [instance: bde2c78e-cdd1-4b75-8a65-667bf8d47075] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:23.995575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.000888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.003699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.004820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.005311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.005790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.046211 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] HTTP exception thrown: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Request method failure captured: Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 HTTP/1.1 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSu9fEBrG9HGzagiso1m0yROMKLndgE6qAdAFpvMqtq75JPvNxr3mWUumafclsnp-ZdNFav4iE6rxxA8FwR7XTwIbOradjEUYnjDvN6u0LPGWyUJU3Cuju-1rfbp1HJknwq2NrGITgUpEiE81c6ql_oQX1xKxujo38_ObANvmbjZiyc Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:24.047804 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2678db4b110743488fc73b3aa6b2f436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2678db4b110743488fc73b3aa6b2f436 Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestMultiNic-1356660137 Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d5dafda6670418da408ba0a18e567ba Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestMultiNic-1356660137-project Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:24.048811 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'bde2c78e-cdd1-4b75-8a65-667bf8d47075'} Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:24.049386 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. Sep 23 03:47:24.050286 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:24.051631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] Returning 404 to user: Instance bde2c78e-cdd1-4b75-8a65-667bf8d47075 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:24.051631 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5dea1092-e5a5-4e50-a749-5fc4f218319d tempest-ServersTestMultiNic-1356660137 tempest-ServersTestMultiNic-1356660137-project] 10.222.0.25 "GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075" status: 404 len: 111 microversion: 2.1 time: 0.119585 Sep 23 03:47:24.051631 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1054/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:23 2022] GET /compute/v2.1/servers/bde2c78e-cdd1-4b75-8a65-667bf8d47075 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:24.092578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:24.093216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:24.116886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.117612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.122484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.124887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.134162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.137631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.377810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:24.392979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:24.398613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:24.410989 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-80b11e69-fe92-4cea-8c68-3fd031f6f841 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.359414 Sep 23 03:47:24.414724 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1055/2184] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:24 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:24.422641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:24.451298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.451669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.452170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.477499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] Creating event network-changed:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:47:24.496937 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-eb8d839c-ecee-4c05-aab1-e0460d6fda3a req-57420dab-eab0-4e24-b956-dbe88d011531 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079948 Sep 23 03:47:24.497603 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1056/2185] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:24.514859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:24.516025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:24.536415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.536934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.537452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.538175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.538646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.539106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.664493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:24.678823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26a1b499-9254-45e3-a99c-cacd9db9c8f0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.179749 Sep 23 03:47:24.680589 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1057/2186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:24 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:24.696966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4", "name": "network-vif-deleted", "tag": "c5dc7bef-67db-4b67-ab56-93b1b29bff29"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:24.713544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.714031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.719393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.746468 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] Creating event network-vif-deleted:c5dc7bef-67db-4b67-ab56-93b1b29bff29 for instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 on n-h1-858495-2 Sep 23 03:47:24.762235 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7b185101-f49e-44c5-ac56-fbd3e772a478 req-af45e714-6bcc-43c8-a385-30afbf613879 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079516 Sep 23 03:47:24.763996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1058/2187] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:24.783697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:24.789577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:24.821130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.824935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.825685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.826627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:24.827286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:24.829322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:24.912148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:47:25.106207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-263f3385-84a7-41a4-844b-af179f7470a4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 204 len: 0 microversion: 2.1 time: 0.340604 Sep 23 03:47:25.107393 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1059/2188] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:47:24 2022] DELETE /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:47:25.118636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:25.121989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:25.136096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.136628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.137218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:25.140798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.141380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.141793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:25.594639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:25.600666 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1615e5c3-f927-4aac-b708-175af8bb80e0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.490693 Sep 23 03:47:25.605735 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1060/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:25 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:25.625610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:25.627137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:25.672356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.672861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.673307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:25.676889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.677380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.677827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:25.858825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:25.882914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:25.895273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:25.895595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16a98ec5-a09b-4169-b7d1-f9439f4d6848 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.288763 Sep 23 03:47:25.896306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1061/2190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:25 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:25.933483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:25.934115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:25.937319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1,nova_api:UPDATE=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:25.956183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.956684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.957137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:25.958048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:25.959386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:25.959934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.303730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:26.315422 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c8ef2118-9de0-4cd7-b5b4-9ddf67cda7a9 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1526 microversion: 2.1 time: 0.417866 Sep 23 03:47:26.329375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1062/2191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:25 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1526 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:26.329375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:26.329375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:26.343279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.343801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.344270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.345025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.350505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.351359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.556707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:26.568720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:26.574471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:26.591163 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0257a5b-bb8e-4575-bed7-855cf8a0cabf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1555 microversion: 2.91 time: 0.271916 Sep 23 03:47:26.592003 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1063/2192] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:26 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:26.625028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:26.625726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:26.640865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.641284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.641772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.642497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.642958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.643388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.783762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:26.803083 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39d5625c-c620-46c0-a6f8-ba2bda774acb tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.195511 Sep 23 03:47:26.804340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1064/2193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:26 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:26.824166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:26.824805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:26.851646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.858122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.858793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.860045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:26.861342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:26.861967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:26.876235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:27.074239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-069f9baf-5e44-4d0c-873f-6d591a7f189b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1463 microversion: 2.1 time: 16.948084 Sep 23 03:47:27.079603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1130/2194] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:10 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1463 bytes in 16954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:27.084941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:27.089875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:27.106190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.107022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.107662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:27.108599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.109252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.110267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:27.633898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:27.658397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:27.661516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:27.662945 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a763fed-d03c-4727-a6a2-a6b52c6a677d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.582046 Sep 23 03:47:27.673784 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1131/2195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:27 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:27.679405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e584542b-d72b-493d-a818-fd9dc48ec0a6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b889040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:27.726660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:27.739961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e584542b-d72b-493d-a818-fd9dc48ec0a6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 200 len: 1463 microversion: 2.1 time: 0.064514 Sep 23 03:47:27.746836 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1132/2196] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:27 2022] GET /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 1463 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:27.752044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:27.752663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0cda0719-732b-40d3-97d7-e561c17a42a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.932589 Sep 23 03:47:27.756303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:27.762909 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1065/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:26 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:27.777069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.777935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.778946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:27.780064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.780730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.781783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:27.791334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:27.792454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:27.835154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.838066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.839787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:27.842103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:27.842658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:27.844327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:28.236215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:28.257410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:28.264633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:28.278484 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8875e157-e4d1-4885-92d7-cd8c1f5c2ce9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1537 microversion: 2.91 time: 0.512194 Sep 23 03:47:28.281662 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1066/2198] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:27 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1537 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:28.297963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:28.298779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:28.321530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:28.322181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:28.323841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:28.325945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:28.326391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:28.327836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:28.708973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:28.718003 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47a28bae-ac77-4c2d-b78a-ca2d300336e2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1467 microversion: 2.1 time: 0.430535 Sep 23 03:47:28.721646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1067/2199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:28 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1467 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:28.732689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:28.734007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:28.751268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:28.752162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:28.752761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:28.753717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:28.754345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:28.754961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.141942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.152617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e61a016b843f59b611324801381c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b485f12af57540f1a70b1e77abb43552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.166787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63d9e70b-d133-437c-9391-e2b123f402f4 tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 200 len: 1526 microversion: 2.1 time: 1.418069 Sep 23 03:47:29.170141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6b2d4c5-a744-40ee-b134-7353385403ea tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.442978 Sep 23 03:47:29.185969 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1133/2200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:27 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 1526 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:29.197579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:29.198391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:29.208571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.209487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.210232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.211276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.211883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.212599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.213100 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1068/2201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:28 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:29.233215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2006413139"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:29.238105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:29.245933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.246617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.247280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.248147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.248764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.249343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.314520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.329158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.331879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.334860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b5bd04a-7639-45a6-b371-baa8678ff67b tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.145243 Sep 23 03:47:29.350500 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1134/2202] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:29 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:29.356810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:29.363521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:29.371144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.372195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.372786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.373766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.374373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.374950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.764168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6fb24801-2402-4ba8-8523-65ba9fcee45c tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "POST /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2/action" status: 202 len: 0 microversion: 2.1 time: 0.546403 Sep 23 03:47:29.766317 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1069/2203] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:47:29 2022] POST /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:47:29.774473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bf4863-674f-444f-a69e-c9de78a3ddd9", "name": "network-vif-deleted", "tag": "5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:29.807294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.807855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.808304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.841183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] Creating event network-vif-deleted:5d3cbd9f-4ddd-4e41-9a40-8ab428bb4210 for instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 on n-h2-858495-2 Sep 23 03:47:29.859306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3bf424a2-12a3-4731-9428-7d93d4953ada req-4c158f24-6ff8-49b3-827b-0e67952bc67f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091354 Sep 23 03:47:29.866634 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1070/2204] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:29.872472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:29.879398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:29.894754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.897975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.900770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.902570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:29.904989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:29.905684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:29.945091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:29.973993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-614d0d2e-7e8f-4589-9f01-ef7c08356cdb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.621118 Sep 23 03:47:29.976796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1135/2205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:29 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:30.003382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:30.033003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.034154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.034878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.057320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] Creating event network-vif-unplugged:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:47:30.066364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.092825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.096920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-867aa882-46aa-4fb7-b654-623bd55e9854 req-6d441560-0b1c-4945-b1e9-925d30ebf442 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117784 Sep 23 03:47:30.099885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.104090 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1136/2206] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:30.119751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-969a7a2a-ee6d-4d47-a603-8b432d5981ad tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1540 microversion: 2.91 time: 0.251750 Sep 23 03:47:30.121224 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1071/2207] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:29 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1540 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:30.138471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a79b2690-3204-40fa-b979-e07d60c5fbf8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8aa264c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:30.153672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:30.158299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:30.166240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.167357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.168068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.168966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.169628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.170226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.231384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858495-2". {{(pid=128723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 03:47:30.238000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a79b2690-3204-40fa-b979-e07d60c5fbf8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.119448 Sep 23 03:47:30.248412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1137/2208] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:30.248412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:30.248412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] [instance: b9bf4863-674f-444f-a69e-c9de78a3ddd9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:30.273415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.273916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.274357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.281572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.282381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.282987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.325103 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] HTTP exception thrown: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Request method failure captured: Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 HTTP/1.1 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSvd-g5VgerBNx4KLPCvt1-3LLju9Fkjenh1VMzIRpxJsUOlIJYrVIi_vAHtduMScCL10DKazJThefWAdrD_PJLxCUpj53M_ERHT4V7F19kDwnk73VAQNUz9BpW29KHKKC9mB3yhkzYB6RVJHIx3Hr4ToPXH1zTjm4onITABuVo70_M Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:47:30.328310 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b485f12af57540f1a70b1e77abb43552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b485f12af57540f1a70b1e77abb43552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b485f12af57540f1a70b1e77abb43552 Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-891866710 Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 199e61a016b843f59b611324801381c6 Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-891866710-project Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. Sep 23 03:47:30.329430 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b9bf4863-674f-444f-a69e-c9de78a3ddd9'} Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:30.330009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. Sep 23 03:47:30.330975 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:30.332762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] Returning 404 to user: Instance b9bf4863-674f-444f-a69e-c9de78a3ddd9 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:30.332762 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13b11d00-21c1-4286-a21d-f02e458c245a tempest-FloatingIPsAssociationTestJSON-891866710 tempest-FloatingIPsAssociationTestJSON-891866710-project] 10.222.0.25 "GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9" status: 404 len: 111 microversion: 2.1 time: 0.089687 Sep 23 03:47:30.336403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1138/2209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/servers/b9bf4863-674f-444f-a69e-c9de78a3ddd9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:30.341696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:30.342541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:30.350912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.351757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.352429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.358237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.358932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.360492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.372376 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-335e4db7-27e2-43ab-afbb-25958f4c0086 tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action" status: 202 len: 0 microversion: 2.91 time: 0.223567 Sep 23 03:47:30.376433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1072/2210] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:47:30 2022] POST /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:47:30.386493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:30.387142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:30.398063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.398488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.398940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.399657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.400127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.401376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.626266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.636755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.647651 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ca9df69-7666-42c5-8e6e-3293ba5126e0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.309965 Sep 23 03:47:30.657377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1139/2211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:30.664435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.675735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:30.677167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.678442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:30.680522 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e9318835-4acf-42fd-b6bf-71acf2da0976 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.302663 Sep 23 03:47:30.697928 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1073/2212] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:30.711890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.712584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.713147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.713914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:30.714377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:30.714835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:30.864181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.880646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.882156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:30.897021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb1e202b-5368-4891-9629-7a43bf1eaeb8 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1488 microversion: 2.91 time: 0.238419 Sep 23 03:47:30.898578 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1140/2213] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1488 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:31.002659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:31.003876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:31.006474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:31.022155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.026118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.026583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.027336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.027802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.028239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.254657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cacdece-7552-4cdd-9ece-efba630b59fe tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b69a3a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:31.339218 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cacdece-7552-4cdd-9ece-efba630b59fe tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.077768 Sep 23 03:47:31.345685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1141/2214] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:31 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:47:31.673234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:31.674058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:31.695101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.696520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.701432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.703292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.709054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.711145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.808273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:31.819667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de300546-6ee1-4118-915e-7544948cc6d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.822734 Sep 23 03:47:31.820272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1074/2215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:30 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:31.835829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:31.850453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:31.869232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.872057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.873374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.877427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.878117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:31.879940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:31.947371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:31.960050 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-032c9978-002f-4f37-b836-59fb71d328f9 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.291172 Sep 23 03:47:31.977723 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1142/2216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:31 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:31.985673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:31.986665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:31.994181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:31.994903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:32.001302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:32.002407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:32.003115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:32.003647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:32.853371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.866214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.873441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.878602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.887412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.901344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:32.905868 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4cf482ba-69f1-4438-b3b9-efcd90874ec4 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1488 microversion: 2.91 time: 0.926658 Sep 23 03:47:32.907566 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec5d6afd-51ca-486a-80bf-0cb5e9b0b004 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 1.077889 Sep 23 03:47:32.909930 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1075/2217] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:31 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:32.913169 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1143/2218] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:31 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1488 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:32.920253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:32.923783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:32.929962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd851d7b-a397-456a-81bd-6201d4e22251 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93410e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:32.960580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:32.963764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:32.964405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:32.966226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:32.968945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:32.969657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.021217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd851d7b-a397-456a-81bd-6201d4e22251 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.105230 Sep 23 03:47:33.027304 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1076/2219] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:32 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:33.038287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:33.043239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:33.061970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.063309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.064705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.066036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.066726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.067513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.216997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:33.235138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9301c6ad-386c-48c0-9c35-7a724dbca19d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.205761 Sep 23 03:47:33.251168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1077/2220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:33 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:33.633533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:33.646548 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d231601-b0b2-4490-8b1a-47e5e06dcce9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.731695 Sep 23 03:47:33.667583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1144/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:32 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:33.941175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:33.942400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:33.943028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:33.943211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:33.950341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.950877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.951265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.959272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.960137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.960340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.960926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.961389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.968836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:33.970123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:33.972126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:33.972891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:34.381741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.384672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.395442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.396913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.405289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.406522 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-faf6307d-eee3-4cf2-b681-33c2ebaa6291 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.468789 Sep 23 03:47:34.407649 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1145/2222] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:33 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:34.410100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.417502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83bb8eab-6aca-4afc-838c-78b4503f95e4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b648160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:34.427924 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-090e2571-4ae7-4b5a-9284-96eb34082b42 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.491281 Sep 23 03:47:34.456049 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1078/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:33 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:34.490732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:34.492892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:34.506406 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83bb8eab-6aca-4afc-838c-78b4503f95e4 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.097209 Sep 23 03:47:34.507065 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1146/2224] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:34 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:34.515116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:34.515116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:34.515116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:34.515116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:34.515664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:34.515864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:34.686951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:34.686951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:34.717646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:34.720826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:34.726071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:34.728378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:34.738251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:34.738970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:34.828504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:34.842673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-377adff8-95cb-4079-9ea5-f5a01cf3f8d7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.385283 Sep 23 03:47:34.857447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1079/2225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:34 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:35.567155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:35.578149 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-216da2f6-e6f6-4ab1-b6fa-bc5e97fc6aae tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 0.907476 Sep 23 03:47:35.587107 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1147/2226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:34 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:35.597225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:35.610534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:35.628152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:35.634682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] Calling method '.version_select at 0x7f0c93387ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:35.646636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:35.648354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:35.652535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:35.657653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:35.659144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:36.341021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7e493f05-caaf-49e0-a358-24e57e6b9585 could not be found", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:47:36.342736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] HTTP exception thrown: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] Request method failure captured: Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-floating-ips/7e493f05-caaf-49e0-a358-24e57e6b9585 HTTP/1.1 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxX6O1Z1QHQAjd6mZ26jnSFOnOmwd6ybJyjtMZqph24Z_aLD_tcsXp4VV28nD1CeYsKPsAE8CDixlG2Ok-1ugfyV3q-VDROiXcn-jCJ3Bc8GZFM7oTgh3OHdlAUmH3Imq4u8S8gNGM-z5XiiQ-X3P8mzsW98DZzhpcqJ43sg4nqDDc Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 29d164540dd2465897e35e763d95d223 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1165405262 Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:47:36.348985 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29d164540dd2465897e35e763d95d223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29d164540dd2465897e35e763d95d223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29d164540dd2465897e35e763d95d223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29d164540dd2465897e35e763d95d223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1165405262 Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 29d164540dd2465897e35e763d95d223 Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1165405262 Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 29d8a84b89d04937aa129163fcbf55e5 Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: exception: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585 Sep 23 03:47:36.351785 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7e493f05-caaf-49e0-a358-24e57e6b9585'} Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:47:36.357919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7e493f05-caaf-49e0-a358-24e57e6b9585 could not be found Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46d00936-91be-44c4-8e89-c362479d8d3c'] Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585. Sep 23 03:47:36.361196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585 Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:36.363755 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:36.366491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:36.366491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585 Sep 23 03:47:36.366491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:47:36.369414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] Returning 404 to user: Floating IP not found for ID 7e493f05-caaf-49e0-a358-24e57e6b9585 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:36.387147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f3e25b0-f5ea-423a-85ad-00d8292eca52 tempest-FloatingIPDetailsNegativeTestJSON-1165405262 tempest-FloatingIPDetailsNegativeTestJSON-1165405262-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/7e493f05-caaf-49e0-a358-24e57e6b9585" status: 404 len: 111 microversion: 2.1 time: 1.024881 Sep 23 03:47:36.404752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:36.422371 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1080/2227] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Sep 23 03:47:35 2022] GET /compute/v2.1/os-floating-ips/7e493f05-caaf-49e0-a358-24e57e6b9585 => generated 111 bytes in 1061 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:36.456986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:36.484217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:36.495278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:36.501016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:36.519180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2671211-9135-4fd1-bb7d-393f619abb08 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.929603 Sep 23 03:47:36.530681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:36.532891 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1148/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:35 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:36.536844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:36.538313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:36.543720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:36.561937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:36.563750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:36.576386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-739ed984-55af-435f-b332-3c997e048905 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b64e820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:36.781690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-739ed984-55af-435f-b332-3c997e048905 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.226293 Sep 23 03:47:36.785807 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1149/2229] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:36 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:36.816696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:36.820884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:36.843364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:36.850616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:36.852610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:36.862545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:36.863410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:36.864199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:36.937596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:36.943895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:36.976359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.005661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.035087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cfa35679-c06c-4937-848c-3b7fcbdc68ef tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.610399 Sep 23 03:47:37.040998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1081/2230] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:36 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:37.064474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:37.082544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:37.106902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.110060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:37.114005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:37.114926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:37.118676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:37.119769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:37.120713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:37.141195 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d14145a6-d546-41e4-bed2-b7e1695182dd tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1184 microversion: 2.1 time: 0.346876 Sep 23 03:47:37.144052 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1150/2231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:36 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1184 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:37.565331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:37.566652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:37.585255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:37.590962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:37.591643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:37.592585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:37.597283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:37.597985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:37.881110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.897638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.899808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:37.908659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e57ffbf1-83ae-468d-96a1-592e51c898d5 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.349221 Sep 23 03:47:37.927387 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1151/2232] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:37 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:47:37.943307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c82bc401-dda8-49ae-9999-a551ea511d4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8a928c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:38.030667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c82bc401-dda8-49ae-9999-a551ea511d4b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.101899 Sep 23 03:47:38.031260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1152/2233] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:37 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:38.076647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:38.078680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:38.094026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:38.094770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:38.096969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:38.102177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:38.110662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:38.120845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:38.885110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:38.898849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d68093a8-6b62-4f79-8d3e-6cad73b587d6 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1498 microversion: 2.1 time: 1.840943 Sep 23 03:47:38.902372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1082/2234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:37 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1498 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:38.923988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:38.937631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:38.962942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:38.964183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:38.967009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:38.971298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:38.972915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:38.977125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:39.032689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.053311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.067736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.092466 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0e8d2bd-f33e-482a-9683-e87bf3b6695a tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 1.019128 Sep 23 03:47:39.100507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1153/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:38 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:47:39.125038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:39.127732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:39.154794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:39.160622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:39.161325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:39.167218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:39.167528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:39.168385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lazy-loading 'fault' on Instance uuid 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:47:39.170179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:39.172856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:39.177862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:39.179342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:39.330630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.363030 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d352db46-37e4-49ce-b4f8-962be2cf10e5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 200 len: 1143 microversion: 2.1 time: 0.459275 Sep 23 03:47:39.380121 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1083/2236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:38 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 1143 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:39.386090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9193a5af-2ba6-4465-aff9-3ca5b506355d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c935b7c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:39.530079 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9193a5af-2ba6-4465-aff9-3ca5b506355d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.148380 Sep 23 03:47:39.531095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1084/2237] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:39 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:39.547359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.551379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:39.563572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.582500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:39.584189 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-192cbac4-4c13-4190-9b80-822e6e105203 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.482252 Sep 23 03:47:39.585310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1154/2238] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:39 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:39.935633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:39.936389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:39.955504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:39.956367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:39.959525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:39.960687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:39.961375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:39.963317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:40.137603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:40.139113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:40.156081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:40.163645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:40.168436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:40.174318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:40.182335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:40.185862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:40.627735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:40.652823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:40.668401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:40.685816 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dfb375b0-6276-453a-9abe-ac016a204986 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.552020 Sep 23 03:47:40.694698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1155/2239] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:40 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:47:40.724944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:40.725737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:40.751305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:40.759944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:40.768986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:40.770221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:40.771014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:40.771550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:40.864557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] HTTP exception thrown: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Request method failure captured: Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 HTTP/1.1 Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpt1gtHBMJXhqiq-g2MQCmnQu6iOWlgPxYXOAXDTLgPcfBD3D2ku0lx0ehbRRJyxHucuJHaRK3YHJWa7GTnxOd7Xob2jj9ZqKwCDrGNeT-Q8rl9iGLyVXXXZQgdpIgGJnWdyMuBRKSJ9vrcq-pcGYk5g8sa9ABWMUq7hyN1fh9-ZrY Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:47:40.889046 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveMigrationTest-1371243068 Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveMigrationTest-1371243068-project Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 27045855dd484c7fbcbb75721afdcc9a Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveMigrationTest-1371243068-project Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. Sep 23 03:47:40.890608 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4'} Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:40.891556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. Sep 23 03:47:40.892675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:40.893771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Returning 404 to user: Instance 3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:40.893771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b6fddab-e2d3-4e54-b3c5-86dfbbef74ae tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4" status: 404 len: 111 microversion: 2.1 time: 0.195148 Sep 23 03:47:40.898291 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1156/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:40 2022] GET /compute/v2.1/servers/3bf7c26e-e13d-4d4a-8ce0-64fff8aa99a4 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:47:40.912590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9a19b65-9543-40a4-8781-dd9706dc2ce5 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b7234c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:41.077992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:41.099508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ed97fb2-612e-4146-bcfe-aa3b0cbd2a79 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 200 len: 1475 microversion: 2.1 time: 1.169694 Sep 23 03:47:41.108505 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1085/2241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:47:39 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 1475 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:41.128933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:41.133313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:41.151938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:41.159114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:41.172015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:41.175343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:41.179583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:41.185083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:41.527800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:41.541417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:41.542920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a32a76472d734439a0e262e0b6d104ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60be92080c34eff88c4c4cee896897a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:41.558941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-78afdf5c-ef4c-4dbc-83f6-46de7e48fd68 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 200 len: 1604 microversion: 2.32 time: 0.448871 Sep 23 03:47:41.566291 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1086/2242] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:41 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 1604 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:41.575998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1760082797"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:41.588098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:41.610350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:41.611207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:41.620353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:41.622513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:41.623213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:41.623897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:50.737225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=48 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:50.802060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:51.609708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=61 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:51.716141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=32 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:47:56.728737 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:47:56.730279 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 03:47:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde/action (ip 10.222.0.25) !!! Sep 23 03:47:58.126090 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9a19b65-9543-40a4-8781-dd9706dc2ce5 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 17.226547 Sep 23 03:47:58.127958 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1157/2243] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:40 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 17229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:58.154462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:58.171971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:58.208716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:58.215840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:58.218458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:58.222984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:58.225495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:58.227603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:58.411405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:58.459729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:58.481070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:47:58.516956 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5683137c-57ca-4bc9-a04d-ccf4b6f998a1 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.383429 Sep 23 03:47:58.519650 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1158/2244] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:58 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:47:58.584310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2", "name": "network-vif-plugged", "status": "completed", "tag": "9f0a6a9c-6365-4ab4-9b28-20d1213adb91"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:47:58.635451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:58.639984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:58.640726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:58.682920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] Creating event network-vif-plugged:9f0a6a9c-6365-4ab4-9b28-20d1213adb91 for instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 on n-h2-858495-2 Sep 23 03:47:58.698450 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6c4a0fbe-ddfa-45bb-bc3a-e64f58280d54 req-89d89b12-b688-46d4-88ea-391f94cfe17e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155682 Sep 23 03:47:58.706187 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1159/2245] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:47:58.721043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:58.728977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:47:58.754240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7261c67-d3fb-4322-bff7-14ce6a203443 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde/action" status: 202 len: 0 microversion: 2.1 time: 17.183955 Sep 23 03:47:58.756269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1087/2246] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:47:41 2022] POST /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde/action => generated 0 bytes in 17189 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:47:58.770594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:58.772131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:58.773714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4dcecd88-e688-4593-8773-ce55d63f4174 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aa96ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:58.774395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:58.781475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:47:58.782543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:47:58.783287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:47:58.832743 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] HTTP exception thrown: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Request method failure captured: Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b HTTP/1.1 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSrWNPEyk05aa7r9EP4I34rcVvVKLpEMzpzlxk-f_AOxIXfO3Z1xP49HfSMvViRNZJ5Z_DvsGtdvZ8Bg4PinrNAfj8pLGmTbnT-gVpA8umfLP2PU7IPLrSDp7FBbkpbtX2f7BrZfxsjgHyYxdOrzCmNGrZ7iXGryqwo1RReRf2CL8zE Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:47:58.839514 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f60be92080c34eff88c4c4cee896897a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a32a76472d734439a0e262e0b6d104ee Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:47:58.840769 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6f34b510-4e6d-4625-a7ae-80cce03e399b'} Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:47:58.841433 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:47:58.842490 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:47:58.848176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Returning 404 to user: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:47:58.850370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d13fa41e-5b8d-441a-a17a-8db2b8208fda tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 404 len: 111 microversion: 2.32 time: 0.141206 Sep 23 03:47:58.858450 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1160/2247] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:47:58 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:47:58.874868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-48cd0983-af6e-4fec-a526-7e048a4ed02d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '.version_select at 0x7f0c8b414f70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:58.938382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-48cd0983-af6e-4fec-a526-7e048a4ed02d tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712446299" status: 204 len: 0 microversion: 2.32 time: 0.075548 Sep 23 03:47:58.945525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1161/2248] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 23 03:47:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712446299 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:47:58.955432 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4dcecd88-e688-4593-8773-ce55d63f4174 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.191635 Sep 23 03:47:58.956394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1088/2249] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:58 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:59.144951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-012bd232-4cbc-40c9-8a69-85301e59fad0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b673310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:47:59.300619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-012bd232-4cbc-40c9-8a69-85301e59fad0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.159693 Sep 23 03:47:59.302052 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1162/2250] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:47:59 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:47:59.982538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7b343ce-b1bc-4893-9799-45a7d7f945b3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8baedd30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0ccFWSMV9qUX+ERjuiF9u76rVkLiO3ExCm97WmJi8XV9EIQydvoY0Dl+4/eLHYnPc8xA4h39IoSmhHIucNRmgY/Qv7yZN+J+3MJi/GPfvpJ0DO6GtMhD+0fTRS8RcSg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7b343ce-b1bc-4893-9799-45a7d7f945b3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 257 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:00.030541 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:00.032033 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0ccFWSMV9qUX+ERjuiF9u76rVkLiO3ExCm97WmJi8XV9EIQydvoY0Dl+4/eLHYnPc8xA4h39IoSmhHIucNRmgY/Qv7yZN+J+3MJi/GPfvpJ0DO6GtMhD+0fTRS8RcSg=="}} Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl0ccFWSMV9qUX+ERjuiF9u76rVkLiO3ExCm97WmJi8XV9EIQydvoY0Dl+4/eLHYnPc8xA4h39IoSmhHIucNRmgY/Qv7yZN+J+3MJi/GPfvpJ0DO6GtMhD+0fTRS8RcSg=='}}} Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:00.032820 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:00.034506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:48:00.035774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:48:00.036861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 03:48:00.036861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:00.040562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7b343ce-b1bc-4893-9799-45a7d7f945b3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:00.047123 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7b343ce-b1bc-4893-9799-45a7d7f945b3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.673175 Sep 23 03:48:00.055543 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1089/2251] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:47:59 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 687 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:00.077835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-280886182", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fcd843e5-9081-42d0-97cd-cea47d685ab6"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:00.121425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:00.122286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:00.164235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:00.165019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:00.165523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:00.185924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:00.186763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:00.187238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:00.272129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] validate_networks() for [('fcd843e5-9081-42d0-97cd-cea47d685ab6', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:48:00.732935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:00.747832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:00.751928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:00.770142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f3b1814-0970-4b0e-abe6-0e989ca6adb9 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.680506 Sep 23 03:48:00.772057 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1090/2252] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:00 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:00.790617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fcc6d97e-d8fd-41ba-b2de-52e961bad470 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1693a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:00.896790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fcc6d97e-d8fd-41ba-b2de-52e961bad470 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.114028 Sep 23 03:48:00.901288 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1091/2253] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:00 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:00.924451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8b169c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-533862081", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:01.007604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:01.034032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for user 27b0aa2b1bf445d4a6952579d56eaa5d and project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:01.126346 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 2166 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-533862081", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:01.155119 n-d-858495-2 devstack@n-api.service[128723]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-533862081', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:01.157506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2dd6c76a-e056-43e4-b525-4d71937e3ea8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.254265 Sep 23 03:48:01.160137 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1092/2254] 10.222.0.25 () {60 vars in 1160 bytes} [Fri Sep 23 03:48:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:48:01.172283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-145e85c7-b637-47d2-8acb-fd41792256e8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93490c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:01.328277 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-145e85c7-b637-47d2-8acb-fd41792256e8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1455 microversion: 2.1 time: 0.167800 Sep 23 03:48:01.337345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1093/2255] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:01 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:01.359543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a15a7fa2-337f-4ac3-abb9-65c08b1cca80 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8b169160>, body: {"keypair": {"name": "tempest-keypair-330311932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYmRcOw5jYc7yf9gyMH8TumYQUDDdV7fZSgyJDNHbAYj/lKASLbWpRr+gfU0H/EU10+UFESd0syTWpXQTujMJ7eKcgBKwh9N+Br08yHkBg+Q2o+0KTVUueWUFDiIvNu7g=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:01.427059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a15a7fa2-337f-4ac3-abb9-65c08b1cca80 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:01.448857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a15a7fa2-337f-4ac3-abb9-65c08b1cca80 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for user 27b0aa2b1bf445d4a6952579d56eaa5d and project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:01.588212 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a15a7fa2-337f-4ac3-abb9-65c08b1cca80 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.248687 Sep 23 03:48:01.593820 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1094/2256] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:48:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:01.608362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c93490700>, body: {"keypair": {"name": "tempest-keypair-330311932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYJm5YE4rxjt4NrdjcbMMrTX7b9V6ULDs3jgAD1/GzI20OMijAoghw1RLrIQmDWD7dOV76aH2bjbL+zU7iZIyyuJkwZi33Ao4fCk0ZrsAoc4dZmeii+nQMBmsn1S9j8EQ=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:01.685109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:01.704526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for user 27b0aa2b1bf445d4a6952579d56eaa5d and project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:01.777543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] HTTP exception thrown: Key pair 'tempest-keypair-330311932' already exists. Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 272 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "tempest-keypair-330311932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYJm5YE4rxjt4NrdjcbMMrTX7b9V6ULDs3jgAD1/GzI20OMijAoghw1RLrIQmDWD7dOV76aH2bjbL+zU7iZIyyuJkwZi33Ao4fCk0ZrsAoc4dZmeii+nQMBmsn1S9j8EQ=="}} Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: exception: Key pair 'tempest-keypair-330311932' already exists. Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-330311932', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYJm5YE4rxjt4NrdjcbMMrTX7b9V6ULDs3jgAD1/GzI20OMijAoghw1RLrIQmDWD7dOV76aH2bjbL+zU7iZIyyuJkwZi33Ao4fCk0ZrsAoc4dZmeii+nQMBmsn1S9j8EQ=='}}} Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27b0aa2b1bf445d4a6952579d56eaa5d-tempest-keypair-330311932' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 23 03:48:01.841818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result.read() Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 03:48:01.846887 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27b0aa2b1bf445d4a6952579d56eaa5d-tempest-keypair-330311932' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 3, 48, 1, 755026), 'updated_at': None, 'name': 'tempest-keypair-330311932', 'user_id': '27b0aa2b1bf445d4a6952579d56eaa5d', 'fingerprint': '57:4d:9e:e0:52:d1:e7:30:5b:19:42:82:1a:a9:aa:b9', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYJm5YE4rxjt4NrdjcbMMrTX7b9V6ULDs3jgAD1/GzI20OMijAoghw1RLrIQmDWD7dOV76aH2bjbL+zU7iZIyyuJkwZi33Ao4fCk0ZrsAoc4dZmeii+nQMBmsn1S9j8EQ==', 'type': 'ssh'}] Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi keypair.create() Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._create() Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-330311932' already exists. Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 23 03:48:01.853802 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-330311932' already exists. Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-330311932' already exists. Sep 23 03:48:01.857143 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:01.860275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 409 to user: Key pair 'tempest-keypair-330311932' already exists. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:01.861430 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e705b688-0fcc-4435-b5ba-27d4380f2f46 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.261992 Sep 23 03:48:01.862193 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1095/2257] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:48:01 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 264 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:48:01.875304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:01.877963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:01.914395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:01.916261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:01.921536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:01.922748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:01.923392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:01.924042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:02.591998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:02.604646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:02.620284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:02.640179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b3c5be5-b5a3-44e7-a041-3743b5810ddf tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.776716 Sep 23 03:48:02.665823 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1096/2258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:01 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:02.690289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b26de9d4-823f-4b45-bb96-f187effbd66c tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Calling method '.version_select at 0x7f0c934a9700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:02.740298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b26de9d4-823f-4b45-bb96-f187effbd66c tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330311932" status: 202 len: 0 microversion: 2.1 time: 0.072592 Sep 23 03:48:02.742142 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1097/2259] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330311932 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:48:02.749424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd5f16a4-c72b-42a6-9972-8a6b8483fe2c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b7ae820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:03.261850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd5f16a4-c72b-42a6-9972-8a6b8483fe2c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.518302 Sep 23 03:48:03.262442 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1098/2260] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:02 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:03.280035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0abb5c81-b16b-4f2f-8186-8f78e0a3a5da tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b259160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:05.922255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:48:05.924395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:48:05.925042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:48:05.928220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:48:05.928879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:48:05.961039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:05.965073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:05.967995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:05.969004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:05.974127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:05.976085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:06.049153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Getting quotas for project 1d7c4d656548437585ec8d92abaed351. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:06.061967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Getting quotas for user 5fa60c8b933f4f109eff3b22814ee8ee and project 1d7c4d656548437585ec8d92abaed351. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:06.111001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:48:06.113667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:48:06.236641 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19bf15af-97a6-485f-8fd1-83948b96c57e tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.725442 Sep 23 03:48:06.244313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1163/2261] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 6734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:48:06.258461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a96e793f-235e-4bc7-8f00-9e3e4838b432 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8b6739d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsSkqfeR9W+ZJQ2lLkJjTuvBq25IYs1ZwtYDCwNRrQofftuRP3iphaXED73N+2CcbNolEbFRQeDR4Dk1/GumSdIa/HXWdrCvp0mzzEibS3k+N8GvzGmcy9gDX03UfhPjQ=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a96e793f-235e-4bc7-8f00-9e3e4838b432 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 247 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsSkqfeR9W+ZJQ2lLkJjTuvBq25IYs1ZwtYDCwNRrQofftuRP3iphaXED73N+2CcbNolEbFRQeDR4Dk1/GumSdIa/HXWdrCvp0mzzEibS3k+N8GvzGmcy9gDX03UfhPjQ=="}} Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsSkqfeR9W+ZJQ2lLkJjTuvBq25IYs1ZwtYDCwNRrQofftuRP3iphaXED73N+2CcbNolEbFRQeDR4Dk1/GumSdIa/HXWdrCvp0mzzEibS3k+N8GvzGmcy9gDX03UfhPjQ=='}}} Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:48:06.262929 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:48:06.267161 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:06.273377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a96e793f-235e-4bc7-8f00-9e3e4838b432 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:06.275627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a96e793f-235e-4bc7-8f00-9e3e4838b432 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029777 Sep 23 03:48:06.280887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1164/2262] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:48:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:06.299969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:06.300913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:06.314605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:06.315326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:06.317324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:06.318300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:06.322662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:06.326006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:06.901904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:06.918263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:06.957235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:07.001509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e82e2384-c630-42c7-8bbb-1e767bdf09b2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1546 microversion: 2.91 time: 0.715519 Sep 23 03:48:07.002729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1165/2263] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:06 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1546 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:07.062309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20b7cad2-d1ba-4650-a778-017bcbc5aa1c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b538160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.209970 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0abb5c81-b16b-4f2f-8186-8f78e0a3a5da tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1464 microversion: 2.1 time: 6.945510 Sep 23 03:48:10.226951 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1099/2264] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:03 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1464 bytes in 6961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:10.233774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20b7cad2-d1ba-4650-a778-017bcbc5aa1c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 3.212713 Sep 23 03:48:10.237946 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1166/2265] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:07 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 3219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:10.253653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.254198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:10.256056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.257097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:10.264848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.268657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.269126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.269930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.272363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.274912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.275554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.276086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.277408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.278318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.279032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.281093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.363831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:10.553209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:10.577423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a12bd69b-b13e-47c9-adae-338cbfea3cd4 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1282 microversion: 2.1 time: 0.335531 Sep 23 03:48:10.590922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07f92488-c4e5-4fd5-ae82-0d59daff5da5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 204 len: 0 microversion: 2.1 time: 0.362402 Sep 23 03:48:10.591479 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1100/2266] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:48:10 2022] DELETE /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:10.595117 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1167/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:10 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1282 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:10.605705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c934a9a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2001335070", "public_key": " "}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:10.607521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.608181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:10.614883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.615883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.625971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.627561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.628684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.629779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.648583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:10.659013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for user 27b0aa2b1bf445d4a6952579d56eaa5d and project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:10.689152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 95 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2001335070", "public_key": " "}} Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2001335070', 'public_key': ' '}}} Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:10.691437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:10.697915 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.701121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:10.702792 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97d4d397-d2bc-46ca-97b7-a77bbb96ca2d tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109396 Sep 23 03:48:10.703555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1101/2268] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Sep 23 03:48:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:48:10.780775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d3f7d20-de24-4c76-8933-e51883eb7353 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Calling method '.version_select at 0x7f0c8b259b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.790113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:10.798608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:10.800055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:10.828395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f422e6ed-2ba6-409a-b025-5ff2e1abaf02 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1533 microversion: 2.91 time: 0.231404 Sep 23 03:48:10.829002 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1168/2269] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:10 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1533 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:10.833761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:10.834258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:10.855624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.857343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.857901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.859897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:10.861804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:10.862319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:10.902149 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] HTTP exception thrown: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Request method failure captured: Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b HTTP/1.1 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSrWNPEyk05aa7r9EP4I34rcVvVKLpEMzpzlxk-f_AOxIXfO3Z1xP49HfSMvViRNZJ5Z_DvsGtdvZ8Bg4PinrNAfj8pLGmTbnT-gVpA8umfLP2PU7IPLrSDp7FBbkpbtX2f7BrZfxsjgHyYxdOrzCmNGrZ7iXGryqwo1RReRf2CL8zE Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f60be92080c34eff88c4c4cee896897a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a32a76472d734439a0e262e0b6d104ee Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6f34b510-4e6d-4625-a7ae-80cce03e399b'} Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:10.907383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:10.910871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:10.914906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Returning 404 to user: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:10.915996 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bca31c7-837d-41e8-98e1-171bd50a574e tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 404 len: 111 microversion: 2.32 time: 0.086013 Sep 23 03:48:10.923319 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1169/2270] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:48:10 2022] DELETE /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:10.930645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cdcbfa33-0886-4c96-a863-ac0fb3339bf1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b811700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:11.001094 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d3f7d20-de24-4c76-8933-e51883eb7353 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.296289 Sep 23 03:48:11.002369 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1102/2271] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:48:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:48:11.008975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd3746-49c4-4ca2-8cff-9fa0ed50acde", "name": "network-vif-plugged", "status": "completed", "tag": "4925370a-4a19-4589-aa55-cbfe52b23cd6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:11.034884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cdcbfa33-0886-4c96-a863-ac0fb3339bf1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 200 len: 1464 microversion: 2.1 time: 0.110164 Sep 23 03:48:11.039714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.040229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.042493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.046667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1170/2272] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:10 2022] GET /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 1464 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:11.055514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:11.058890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:11.069285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.070789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.071453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.072970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.075199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.076120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.079553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] Creating event network-vif-plugged:4925370a-4a19-4589-aa55-cbfe52b23cd6 for instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde on n-h1-858495-2 Sep 23 03:48:11.095466 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4a5851f6-31c5-438b-b4d3-1e89eceaef4c req-8026fe7b-c78a-4036-b17f-cc056fe2d6ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091579 Sep 23 03:48:11.096702 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1103/2273] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:11.103641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f5a8ead-c89e-4332-affc-da4069b451c3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8b2591f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN2jqpAs3V6xFP9u6Ahf5jLA6lG0RyhmE/Cqcp47sgl3EgUbhEAbswDG4b7m5QBE/R4K+vUQawzgJZKkDAAnEj7HtUzi2Kddi3yTg1zpDaX+TFR4zxWHHXLfxi9Zd2GEg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f5a8ead-c89e-4332-affc-da4069b451c3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 507 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN2jqpAs3V6xFP9u6Ahf5jLA6lG0RyhmE/Cqcp47sgl3EgUbhEAbswDG4b7m5QBE/R4K+vUQawzgJZKkDAAnEj7HtUzi2Kddi3yTg1zpDaX+TFR4zxWHHXLfxi9Zd2GEg=="}} Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN2jqpAs3V6xFP9u6Ahf5jLA6lG0RyhmE/Cqcp47sgl3EgUbhEAbswDG4b7m5QBE/R4K+vUQawzgJZKkDAAnEj7HtUzi2Kddi3yTg1zpDaX+TFR4zxWHHXLfxi9Zd2GEg=='}}} Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 23 03:48:11.109297 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 03:48:11.112507 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.117415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f5a8ead-c89e-4332-affc-da4069b451c3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:11.118558 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f5a8ead-c89e-4332-affc-da4069b451c3 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020545 Sep 23 03:48:11.119341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1104/2274] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:48:11 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:11.127317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:11.128875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:11.141086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.142132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.143174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.144177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.144902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.146813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.834811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] Lazy-loading 'services' on Instance uuid 86b5ff18-5689-40f6-8590-1fcdef005c3a {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:48:11.890232 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4b9307d-c067-4186-b123-4188997e46bc tempest-UnshelveToHostMultiNodesTest-1924793717 tempest-UnshelveToHostMultiNodesTest-1924793717-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1938 microversion: 2.91 time: 0.769507 Sep 23 03:48:11.891650 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1105/2275] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:11 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1938 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:11.905771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:11.906766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] [instance: 6f34b510-4e6d-4625-a7ae-80cce03e399b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:11.917009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.921833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.922854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.923861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:11.924740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:11.925627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:11.982967 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] HTTP exception thrown: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Request method failure captured: Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b HTTP/1.1 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSrWNPEyk05aa7r9EP4I34rcVvVKLpEMzpzlxk-f_AOxIXfO3Z1xP49HfSMvViRNZJ5Z_DvsGtdvZ8Bg4PinrNAfj8pLGmTbnT-gVpA8umfLP2PU7IPLrSDp7FBbkpbtX2f7BrZfxsjgHyYxdOrzCmNGrZ7iXGryqwo1RReRf2CL8zE Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f60be92080c34eff88c4c4cee896897a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f60be92080c34eff88c4c4cee896897a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f60be92080c34eff88c4c4cee896897a Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TaggedBootDevicesTest-310274102 Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: a32a76472d734439a0e262e0b6d104ee Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TaggedBootDevicesTest-310274102-project Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6f34b510-4e6d-4625-a7ae-80cce03e399b'} Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:11.988695 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. Sep 23 03:48:11.994337 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:11.995457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] Returning 404 to user: Instance 6f34b510-4e6d-4625-a7ae-80cce03e399b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:12.000780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41481e4d-225a-47f8-bfa0-41fbe9ed9aa6 tempest-TaggedBootDevicesTest-310274102 tempest-TaggedBootDevicesTest-310274102-project] 10.222.0.25 "GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b" status: 404 len: 111 microversion: 2.32 time: 0.107780 Sep 23 03:48:12.005912 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1106/2276] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:11 2022] GET /compute/v2.1/servers/6f34b510-4e6d-4625-a7ae-80cce03e399b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:12.023445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6dbaeb70-3d52-40f2-a277-ac0ab7b1abf1 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Action: 'create', calling method: .version_select at 0x7f0c8b0d7f70>, body: {"pool": "non_exist_pool"} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:12.064416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:12.104568 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9d719bf-5308-4482-9995-b273c2dbeb7b tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 200 len: 1667 microversion: 2.1 time: 1.056167 Sep 23 03:48:12.112511 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1171/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:11 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 1667 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:12.137989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:12.138922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:12.184735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.185228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.196521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.198994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.199806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.200251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.271419 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6dbaeb70-3d52-40f2-a277-ac0ab7b1abf1 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] HTTP exception thrown: Floating IP pool not found. Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6dbaeb70-3d52-40f2-a277-ac0ab7b1abf1 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Request method failure captured: Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 26 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSx4KWuwDe8cjaupRJUZNg8c_BLRr1xegjYfdK7jDfKzLWDEfJr_1n-UZabX2MmmghAz6_FtKWY8A9sRcyOkWaxDJGnIb_kjOp7G8VYMw6DEq-qKi2nvv22mQzkM1e0p_IMiCX2IBvYvlGAFIrMNMldO-be4KdQRipatWKKQcdHboIY Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 225e551df13f4dd9ae8fd3ece0025de2 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 225e551df13f4dd9ae8fd3ece0025de2 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsNegativeTestJSON-1527015913-project Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: c1ced75f44b94072afffe048b2d37b9c Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1527015913-project Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: {"pool": "non_exist_pool"} Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: exception: Floating IP pool not found. Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:12.273236 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:12.277023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 23 03:48:12.277023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.277023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6dbaeb70-3d52-40f2-a277-ac0ab7b1abf1 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Returning 404 to user: Floating IP pool not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:12.277023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6dbaeb70-3d52-40f2-a277-ac0ab7b1abf1 tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.267795 Sep 23 03:48:12.277023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1107/2278] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:48:12 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:48:12.287582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Action: 'create', calling method: .version_select at 0x7f0c8b848040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1605905114", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:12.379543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:12.399016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Getting quotas for user 27b0aa2b1bf445d4a6952579d56eaa5d and project bd742744b30846d3a1c329fe52f66649. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:12.446991 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 118 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1605905114", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1605905114', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 03:48:12.466479 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 03:48:12.470030 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:12.478710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:12.480158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4b758d6-1cb6-4f65-8c17-3d96a9fe14e8 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.197127 Sep 23 03:48:12.484627 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1108/2279] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:48:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:48:12.510735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a411b8eb-79d6-4a96-88c7-87512f0237a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aa96550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:12.640099 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a411b8eb-79d6-4a96-88c7-87512f0237a5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.153941 Sep 23 03:48:12.647773 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1109/2280] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:12 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:12.671175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:12.676592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:12.709595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.714620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.718324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.722543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.728499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.731482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.780074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:12.789192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a06397dd-35ef-4f57-8efb-c281abdf5b3b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1468 microversion: 2.1 time: 0.674245 Sep 23 03:48:12.805766 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1172/2281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:12 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1468 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:12.805907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:12.806595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:12.823085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.823585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.824037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.824778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:12.825322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:12.825840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:12.899890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:13.203344 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-870041b4-88eb-4f5e-a5ec-102cdfa874ce tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 204 len: 0 microversion: 2.91 time: 0.400010 Sep 23 03:48:13.205426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1173/2282] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:48:12 2022] DELETE /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:48:13.220070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Calling method '.version_select at 0x7f0c8b414040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:13.771901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 could not be found", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:48:13.773041 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] HTTP exception thrown: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Request method failure captured: Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-floating-ips/a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 HTTP/1.1 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSx4KWuwDe8cjaupRJUZNg8c_BLRr1xegjYfdK7jDfKzLWDEfJr_1n-UZabX2MmmghAz6_FtKWY8A9sRcyOkWaxDJGnIb_kjOp7G8VYMw6DEq-qKi2nvv22mQzkM1e0p_IMiCX2IBvYvlGAFIrMNMldO-be4KdQRipatWKKQcdHboIY Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 225e551df13f4dd9ae8fd3ece0025de2 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_225e551df13f4dd9ae8fd3ece0025de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 225e551df13f4dd9ae8fd3ece0025de2 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1527015913 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsNegativeTestJSON-1527015913-project Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c1ced75f44b94072afffe048b2d37b9c Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1527015913-project Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: exception: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a3cd0f3d-997f-4a05-bf22-b2e2d67799c1'} Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 could not be found Sep 23 03:48:13.776376 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58abb5b1-ab14-4908-b6b2-1909d85b260b'] Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1. Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] Returning 404 to user: Floating IP not found for ID a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:13.780094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ca24756-ebe6-4f95-90ec-5f63621c32fd tempest-FloatingIPsNegativeTestJSON-1527015913 tempest-FloatingIPsNegativeTestJSON-1527015913-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a3cd0f3d-997f-4a05-bf22-b2e2d67799c1" status: 404 len: 111 microversion: 2.1 time: 0.571387 Sep 23 03:48:13.784381 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1174/2283] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:48:13 2022] DELETE /compute/v2.1/os-floating-ips/a3cd0f3d-997f-4a05-bf22-b2e2d67799c1 => generated 111 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:13.845950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d9c02ff-cd9b-45a1-9829-df6fec7a6b19 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Calling method '.version_select at 0x7f0c8bb395e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:13.902471 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9d9c02ff-cd9b-45a1-9829-df6fec7a6b19 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d9c02ff-cd9b-45a1-9829-df6fec7a6b19 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Request method failure captured: Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-971474056 HTTP/1.1 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSxvsb0HPXwWFGq4YnePAy9dk84yiz4QovxM077Fo_FRlHyuXbgRAHx2nrCMlpcgj0eTcBi5X33sLBtVzTFtciQ3Cp-maFzXaEvXv7yxc25lVOm34b71VWM2xWtJXHRTTs5mO2aQMKfHfL7zqKflbj3mYBYO7vLlPLXddufc3vXSrcc Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd742744b30846d3a1c329fe52f66649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd742744b30846d3a1c329fe52f66649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: bd742744b30846d3a1c329fe52f66649 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2019021995 Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2019021995-project Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: exception: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'tempest-keypair-non-existent-971474056'} Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.915492 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d9c02ff-cd9b-45a1-9829-df6fec7a6b19 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] Returning 404 to user: Keypair tempest-keypair-non-existent-971474056 not found for user 27b0aa2b1bf445d4a6952579d56eaa5d {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:13.918894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d9c02ff-cd9b-45a1-9829-df6fec7a6b19 tempest-KeyPairsNegativeTestJSON-2019021995 tempest-KeyPairsNegativeTestJSON-2019021995-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-971474056" status: 404 len: 144 microversion: 2.1 time: 0.131894 Sep 23 03:48:13.922380 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1175/2284] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 03:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-971474056 => generated 144 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:13.938610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1809615141"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:13.956206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:13.988514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:13.995285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:13.996427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:13.997970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.001218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.002611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.521627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c8d9603-b7e1-4bba-a5f4-e16402bafa01 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "POST /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce/action" status: 202 len: 0 microversion: 2.1 time: 0.597128 Sep 23 03:48:14.526048 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1176/2285] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:48:13 2022] POST /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:48:14.539137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:14.542787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 33d26f0f-b9a2-4263-a720-db922e1602a1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:14.549400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:14.573229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4eeb341-9909-46e4-ba37-07d27b7ca0ab tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 1.923838 Sep 23 03:48:14.574444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.576663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.577342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.579626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.580714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.581323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.603362 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] HTTP exception thrown: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. Sep 23 03:48:14.609283 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1110/2286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:12 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Request method failure captured: Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 HTTP/1.1 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpt1gtHBMJXhqiq-g2MQCmnQu6iOWlgPxYXOAXDTLgPcfBD3D2ku0lx0ehbRRJyxHucuJHaRK3YHJWa7GTnxOd7Xob2jj9ZqKwCDrGNeT-Q8rl9iGLyVXXXZQgdpIgGJnWdyMuBRKSJ9vrcq-pcGYk5g8sa9ABWMUq7hyN1fh9-ZrY Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 27045855dd484c7fbcbb75721afdcc9a Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '33d26f0f-b9a2-4263-a720-db922e1602a1'} Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:14.619504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. Sep 23 03:48:14.623036 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:14.625503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Returning 404 to user: Instance 33d26f0f-b9a2-4263-a720-db922e1602a1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:14.626787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-802bc322-5935-46e4-b756-d28865e273b0 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1" status: 404 len: 111 microversion: 2.1 time: 0.099266 Sep 23 03:48:14.628896 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1177/2287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:14 2022] GET /compute/v2.1/servers/33d26f0f-b9a2-4263-a720-db922e1602a1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:14.641115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d26f0f-b9a2-4263-a720-db922e1602a1", "name": "network-vif-deleted", "tag": "82b8a4f7-748e-44ed-8ca8-77aabd203008"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:14.641325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:14.642333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:14.669229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.670754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.672326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.690768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.691605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.692374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.708371 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] Creating event network-vif-deleted:82b8a4f7-748e-44ed-8ca8-77aabd203008 for instance 33d26f0f-b9a2-4263-a720-db922e1602a1 on n-h1-858495-2 Sep 23 03:48:14.726437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e8c26101-4638-4dc6-9c23-d63def455dfc req-9139fd01-519d-41f5-91df-719e2bb73e92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093089 Sep 23 03:48:14.729410 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1178/2288] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:14.738628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:14.739327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:14.739712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:14.752379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da1431d0-8193-4d3f-8bd9-a55dbc6249fd tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b0a5160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:14.886833 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da1431d0-8193-4d3f-8bd9-a55dbc6249fd tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.151131 Sep 23 03:48:14.901146 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1179/2289] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:14 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:14.916765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27a41ea7-57cc-49ee-86e9-0de6bfdb7d6e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8bae6ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:15.019519 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-27a41ea7-57cc-49ee-86e9-0de6bfdb7d6e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.115211 Sep 23 03:48:15.019519 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1180/2290] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:14 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:15.037289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-18f256a4-c4ce-4326-a764-6397b3d21c93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '.version_select at 0x7f0c8bd5aee0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:15.109064 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-18f256a4-c4ce-4326-a764-6397b3d21c93 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128046119" status: 202 len: 0 microversion: 2.1 time: 0.085486 Sep 23 03:48:15.114482 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1181/2291] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:48:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128046119 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:48:15.153401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:15.163462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:15.177198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:15.199926 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20b2c9b8-d974-49d9-8dd7-7e7407ad3882 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 0.588986 Sep 23 03:48:15.212565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1111/2292] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:14 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:48:15.534336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2", "name": "network-vif-unplugged", "status": "completed", "tag": "9f0a6a9c-6365-4ab4-9b28-20d1213adb91"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:15.564117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:15.566009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:15.566704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:15.600003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] Creating event network-vif-unplugged:9f0a6a9c-6365-4ab4-9b28-20d1213adb91 for instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 on n-h2-858495-2 Sep 23 03:48:15.612800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:15.614297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:15.625908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-427b51ae-087f-4728-85b9-baf16381da7b req-82ed29e8-4ae6-44f4-9edf-94cf8fd7cb95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090172 Sep 23 03:48:15.630802 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1182/2293] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:15.653899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:15.657566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:15.658033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:15.664624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:15.666578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:15.669250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:15.910782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86b173eb-5e0c-4f00-b440-43bb9331b908 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b8f1ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:16.019531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:16.038951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86b173eb-5e0c-4f00-b440-43bb9331b908 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.135684 Sep 23 03:48:16.040128 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1183/2294] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:15 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:16.058244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3eb31929-c77a-4b85-8583-24d7d46131f7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b801af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:16.091475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:16.133805 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3eb31929-c77a-4b85-8583-24d7d46131f7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.086628 Sep 23 03:48:16.137595 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1184/2295] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:16 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:16.236427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:16.237289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:16.249230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:16.253139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:16.253735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:16.254596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:16.258193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:16.258767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:17.170569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:17.184201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:17.187773 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e5d28c8-efd4-459d-890e-37dec440d0ef tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 1.579499 Sep 23 03:48:17.188368 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1112/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:15 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:17.212389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0076f76-4da6-448a-b7f3-2f7b5f943106 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93490280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:17.227890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:17.240412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21741ad177fd4ab3ab24ec64fc6f3c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaa78b545cf48d592c9a2ae2e8735ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:17.259125 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40cad8a7-f02d-478e-8e5e-6282427dc2a2 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 200 len: 1539 microversion: 2.91 time: 1.026937 Sep 23 03:48:17.261866 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1185/2297] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:16 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 1539 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:48:17.306185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-740719ec-ace0-43dc-85a8-b3814451a9d8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b6480d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:17.325820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0076f76-4da6-448a-b7f3-2f7b5f943106 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.121328 Sep 23 03:48:17.326678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1113/2298] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:17 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:17.440465 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-740719ec-ace0-43dc-85a8-b3814451a9d8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.159706 Sep 23 03:48:17.441686 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1186/2299] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:17 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:18.216004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:18.217248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:18.248587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:18.249073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:18.249758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:18.250744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:18.251243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:18.251678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:18.297223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:18.299290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] [instance: 86b5ff18-5689-40f6-8590-1fcdef005c3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:18.325318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:18.327767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:18.333578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:18.336290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:18.338557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:18.342100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:18.414536 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] HTTP exception thrown: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Request method failure captured: Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a HTTP/1.1 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSuz-gBYJ2mz4hn75JxUxxEJZ0RNrf9aHb5uRiUZpSfejDf0JaeWJSEwIA0lvTGpUb00R2xhLRf0VBxLopfA0u7IBQCpzTSZ8LDDNCRsdbZKop2JzvFzCH2ySpMMSGWLMCvOZq-P0s0Emujx_V1uiUZYbbUS23VZr1vxI-3m155C_qM Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.91 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9aaa78b545cf48d592c9a2ae2e8735ed Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1370408215 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9aaa78b545cf48d592c9a2ae2e8735ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9aaa78b545cf48d592c9a2ae2e8735ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9aaa78b545cf48d592c9a2ae2e8735ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9aaa78b545cf48d592c9a2ae2e8735ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1370408215 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9aaa78b545cf48d592c9a2ae2e8735ed Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1370408215 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-UnshelveToHostMultiNodesTest-1370408215-project Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 21741ad177fd4ab3ab24ec64fc6f3c04 Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1370408215-project Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '86b5ff18-5689-40f6-8590-1fcdef005c3a'} Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. Sep 23 03:48:18.422552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. Sep 23 03:48:18.429057 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:18.430530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] Returning 404 to user: Instance 86b5ff18-5689-40f6-8590-1fcdef005c3a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:18.433723 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60a89059-c2e5-405f-b904-a6fef6fe9b44 tempest-UnshelveToHostMultiNodesTest-1370408215 tempest-UnshelveToHostMultiNodesTest-1370408215-project] 10.222.0.25 "GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a" status: 404 len: 111 microversion: 2.91 time: 0.142300 Sep 23 03:48:18.436249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1187/2300] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:48:18 2022] GET /compute/v2.1/servers/86b5ff18-5689-40f6-8590-1fcdef005c3a => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:48:18.459085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ed6a45e-04d6-441d-81d5-405ca2943f6a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b648040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:18.558139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ed6a45e-04d6-441d-81d5-405ca2943f6a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.119219 Sep 23 03:48:18.562702 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1188/2301] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:18 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:18.585811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c3dad08-1738-4b62-87e5-c3bcd03cfe09 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b801820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:18.726590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c3dad08-1738-4b62-87e5-c3bcd03cfe09 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.156144 Sep 23 03:48:18.727258 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1189/2302] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:18 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:19.232085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:19.241649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e7fb92c-cb2c-4a6a-9a6f-267c4c8cb1e6 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 1.030795 Sep 23 03:48:19.252337 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1114/2303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:18 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:19.332798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:19.334383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:19.360436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:19.363533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:19.364413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:19.367523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:19.380841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:19.383973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:19.484692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:19.578453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98b008ec-404b-4824-b768-1d03062140b4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8baed790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:19.578987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:19.703766 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98b008ec-404b-4824-b768-1d03062140b4 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.129645 Sep 23 03:48:19.705713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1115/2304] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:19 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:19.726301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d17aa91e-ff26-401c-878f-cbaebc632399 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 204 len: 0 microversion: 2.1 time: 0.398168 Sep 23 03:48:19.735764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:19.736799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:19.741784 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1190/2305] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:48:19 2022] DELETE /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:19.753283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:19.755408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:19.756369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:19.760544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:19.763178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24a6f232-1ead-4a8e-8afc-bb2223c462b7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b8a1940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:19.763451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:19.764452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:19.896542 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24a6f232-1ead-4a8e-8afc-bb2223c462b7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.153109 Sep 23 03:48:19.906107 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1191/2306] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:19 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:20.264688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:20.265987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:20.291345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:20.295811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:20.301153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:20.306259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:20.310992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:20.312704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:20.493649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:20.505814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23d60715-bac1-49d4-b35a-e4a8ce278304 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1485 microversion: 2.1 time: 0.772096 Sep 23 03:48:20.507196 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1116/2307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:19 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1485 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:20.720181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cea5ba23-c551-4cf6-a5ea-fe388b688e48 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c934a9310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:20.845911 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cea5ba23-c551-4cf6-a5ea-fe388b688e48 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.129660 Sep 23 03:48:20.846833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1117/2308] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:20 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:20.915212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a83c039-664a-48d5-9b4c-928b2b92b8a2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b405430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:21.044200 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a83c039-664a-48d5-9b4c-928b2b92b8a2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.135854 Sep 23 03:48:21.045565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1118/2309] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:20 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:21.348165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c82eb1-61f1-4ec4-b754-2b695400eece", "tag": "21040eb7-40b5-44a6-a05f-9e807aa8576c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:21.402597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:21.402996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:21.403437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:21.451755 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] Creating event network-changed:21040eb7-40b5-44a6-a05f-9e807aa8576c for instance 86c82eb1-61f1-4ec4-b754-2b695400eece on n-h2-858495-2 Sep 23 03:48:21.463840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-adf65231-c0a7-4cd5-8c37-6cfc31631785 req-1b78e803-27c9-49aa-8219-9186b2282568 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120510 Sep 23 03:48:21.472593 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1119/2310] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:48:21.540147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3e1ea2-2cec-4495-ba93-f7e2439b352e", "name": "network-vif-deleted", "tag": "b8c2dfd0-50c2-43db-8062-4da807f40628"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:21.561274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:21.561814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:21.562264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:21.626409 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] Creating event network-vif-deleted:b8c2dfd0-50c2-43db-8062-4da807f40628 for instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e on n-h1-858495-2 Sep 23 03:48:21.654137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3160a9d9-5236-427f-a34f-46ff3403c6b9 req-3d2d1598-9c4e-4090-acc7-c4372cbb0c20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131286 Sep 23 03:48:21.667722 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1120/2311] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:48:21.674378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:21.675101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:21.697697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:21.723628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:21.724225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:21.729921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:21.734053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:21.734918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:21.735558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:21.817782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:21.880813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:21.881390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:21.881886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:21.898624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lazy-loading 'fault' on Instance uuid cf3e1ea2-2cec-4495-ba93-f7e2439b352e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:48:22.424529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:22.450805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:22.461202 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21a92f91-6ad0-4a08-85f2-e5a5b71da27d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 200 len: 1301 microversion: 2.1 time: 0.791055 Sep 23 03:48:22.471709 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1121/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:21 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 1301 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:22.496989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-268b0b26-3b06-4fe8-bead-ea44943f9e6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c934900d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:22.546184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:22.576645 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2678e60-5f07-4dd3-9665-61c80a1cc8ac tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 2.316294 Sep 23 03:48:22.582774 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1192/2313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:20 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:22.630059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9aa3dce5-97fa-4975-bceb-df19cb7011d1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8bd42160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:22.651116 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-268b0b26-3b06-4fe8-bead-ea44943f9e6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.175450 Sep 23 03:48:22.669382 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1122/2314] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:22 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:22.786665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9aa3dce5-97fa-4975-bceb-df19cb7011d1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.198403 Sep 23 03:48:22.787270 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1193/2315] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:22 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:23.507346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:23.516406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: cf3e1ea2-2cec-4495-ba93-f7e2439b352e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:23.546385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.547239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.547935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.548835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.551696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.552334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.595135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] HTTP exception thrown: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Request method failure captured: Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e HTTP/1.1 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSpt1gtHBMJXhqiq-g2MQCmnQu6iOWlgPxYXOAXDTLgPcfBD3D2ku0lx0ehbRRJyxHucuJHaRK3YHJWa7GTnxOd7Xob2jj9ZqKwCDrGNeT-Q8rl9iGLyVXXXZQgdpIgGJnWdyMuBRKSJ9vrcq-pcGYk5g8sa9ABWMUq7hyN1fh9-ZrY Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 27045855dd484c7fbcbb75721afdcc9a Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cf3e1ea2-2cec-4495-ba93-f7e2439b352e'} Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:23.597119 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. Sep 23 03:48:23.601234 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:23.603102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Returning 404 to user: Instance cf3e1ea2-2cec-4495-ba93-f7e2439b352e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:23.604163 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a035f8f9-30d8-413a-9e51-0cfc2a67dca7 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e" status: 404 len: 111 microversion: 2.1 time: 0.108438 Sep 23 03:48:23.610526 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1123/2316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:23 2022] GET /compute/v2.1/servers/cf3e1ea2-2cec-4495-ba93-f7e2439b352e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:23.623550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:23.626061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:23.626588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:23.626938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:23.645161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.649698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:23.650761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.651389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.654682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.655431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.656023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.669537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.671477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.673071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.674713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:23.677385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:23.678072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:23.759829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:24.038592 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2f0dd9c-3932-475e-9946-4138b197710d tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 204 len: 0 microversion: 2.1 time: 0.423175 Sep 23 03:48:24.040210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1124/2317] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:48:23 2022] DELETE /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:24.049671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d895be64-9bb4-461b-b4fa-e070a11f9cb8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c934a9af0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:24.142086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d895be64-9bb4-461b-b4fa-e070a11f9cb8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.095146 Sep 23 03:48:24.148229 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1125/2318] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:24 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:24.176329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad611b19-4ff1-4529-a062-6adc0ae2715e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1f8b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:24.251925 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad611b19-4ff1-4529-a062-6adc0ae2715e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.102417 Sep 23 03:48:24.252783 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1126/2319] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:24 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:24.281487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:24.281487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:24.287415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:24.304992 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4ed29e7-899d-4d01-8cac-ee3b4606c990 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 0.696690 Sep 23 03:48:24.306118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1194/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:23 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:24.331827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:24.332238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:24.332692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:24.333473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:24.333943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:24.334380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:25.142977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:25.164565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c7b71e6-d10c-4a0a-b7db-14676a3ecbd5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b673310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:25.175422 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09d8f689-f04e-44fb-8faa-d8240860a2f3 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1498 microversion: 2.1 time: 0.909469 Sep 23 03:48:25.195443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1127/2321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:24 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1498 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:25.277335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de63dfa9-be1d-46ba-8a4d-55797efb1a52 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1f8310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:25.284235 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c7b71e6-d10c-4a0a-b7db-14676a3ecbd5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.126118 Sep 23 03:48:25.292288 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1195/2322] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:25 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:25.330452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:25.333957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:25.353958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:25.359470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:25.360205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:25.362023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:25.363166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:25.365220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:25.368749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de63dfa9-be1d-46ba-8a4d-55797efb1a52 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.104042 Sep 23 03:48:25.369731 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1128/2323] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:25 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:25.778988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:25.792033 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16de16a9-4668-4c96-aeca-aa86d96f569f tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 0.467159 Sep 23 03:48:25.792928 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1196/2324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:25 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:26.228090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:26.228958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:26.252171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:26.256111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:26.256990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:26.258497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:26.259262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:26.260002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:26.316982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cde97c2-e991-4e33-831c-a25b5c1ec7b7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b8a1a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:26.482994 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cde97c2-e991-4e33-831c-a25b5c1ec7b7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.179859 Sep 23 03:48:26.485597 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1197/2325] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:26 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:26.508241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b32d1ae4-d021-4813-a757-545670738633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b0a5c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:26.602464 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b32d1ae4-d021-4813-a757-545670738633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.114614 Sep 23 03:48:26.603337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1198/2326] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:26 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:26.761491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:26.775253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0c45425-dcab-4dfc-9188-5e56b6d6a8b5 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1498 microversion: 2.1 time: 0.555013 Sep 23 03:48:26.797263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1129/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:26 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1498 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:26.817976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:26.818610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:26.830796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:26.833450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:26.834149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:26.835371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:26.835491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:26.838560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:26.922990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:26.948090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:26.948596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:26.949124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:26.977994 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] Creating event network-vif-plugged:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:48:26.990504 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-89563f1b-f0c6-4462-9d3a-a98f32a90fe8 req-f9352c5c-7501-4d58-b3b7-0d746e9ce18d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071898 Sep 23 03:48:26.992716 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1130/2328] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:27.508710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b9c2687-1a90-450e-9b27-ebe864fb780b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b0d7ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:27.609239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b9c2687-1a90-450e-9b27-ebe864fb780b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.111591 Sep 23 03:48:27.622509 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1131/2329] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:27 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:27.635296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4da45e12-bf8e-43ac-b359-29cb7f27acbb tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1f81f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:27.719061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4da45e12-bf8e-43ac-b359-29cb7f27acbb tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.094898 Sep 23 03:48:27.722368 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1132/2330] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:27 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:27.806319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:27.807426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:27.823455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:27.824366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:27.824853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:27.825676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:27.832823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:27.837882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:29.570722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:29.590073 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5cc22074-d672-460f-878a-01f1787ea650 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 2.777612 Sep 23 03:48:29.610126 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1199/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:26 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:29.627567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0f57efe-c081-400a-82fe-7ff5378eadfc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b37c820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:30.116289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0f57efe-c081-400a-82fe-7ff5378eadfc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1412 microversion: 2.1 time: 0.503915 Sep 23 03:48:30.120612 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1200/2332] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:29 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1412 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:30.140158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-776caad5-db37-4279-aeaf-1585e07deed7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b723d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:30.283738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27045855dd484c7fbcbb75721afdcc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4213ec46984d8fa9da47e40ede88ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:30.311448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdc634cf-904e-4d79-a5b8-44b045b2e228 tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 200 len: 1498 microversion: 2.1 time: 2.507658 Sep 23 03:48:30.315162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1133/2333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:27 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 1498 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:30.619429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:30.620447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:30.641985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:30.647641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:30.648997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:30.655550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:30.658865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:30.663557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:31.821753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:31.833140 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ae4d8c7-b9f6-4873-a7ca-9be403ea8658 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 1.216046 Sep 23 03:48:31.838967 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1134/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:30 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:31.845657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aae1827a-3928-44d4-8897-149d3b661350 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93398160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:36.831297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:38.432617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-776caad5-db37-4279-aeaf-1585e07deed7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 8.310060 Sep 23 03:48:38.456303 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aae1827a-3928-44d4-8897-149d3b661350 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1421 microversion: 2.1 time: 6.615502 Sep 23 03:48:38.461149 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1201/2335] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:30 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 8335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:38.461471 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1135/2336] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:31 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1421 bytes in 6619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:38.481034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:38.481936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] [instance: 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:38.483768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4", "name": "network-vif-deleted", "tag": "60142906-a522-49bf-aba3-a4aa63827558"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:38.511922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.512688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.515348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.517557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.518711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.521934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.525647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.526360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.526965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.557150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] HTTP exception thrown: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Request method failure captured: Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 HTTP/1.1 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSpt1gtHBMJXhqiq-g2MQCmnQu6iOWlgPxYXOAXDTLgPcfBD3D2ku0lx0ehbRRJyxHucuJHaRK3YHJWa7GTnxOd7Xob2jj9ZqKwCDrGNeT-Q8rl9iGLyVXXXZQgdpIgGJnWdyMuBRKSJ9vrcq-pcGYk5g8sa9ABWMUq7hyN1fh9-ZrY Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4213ec46984d8fa9da47e40ede88ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ff4213ec46984d8fa9da47e40ede88ac Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-LiveMigrationTest-1371243068 Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 27045855dd484c7fbcbb75721afdcc9a Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-LiveMigrationTest-1371243068-project Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4'} Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:38.562521 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:38.567876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] Returning 404 to user: Instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:38.571489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] Creating event network-vif-deleted:60142906-a522-49bf-aba3-a4aa63827558 for instance 1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 on n-h2-858495-2 Sep 23 03:48:38.571814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2d835ec-0b53-4b55-b105-a7f2504547be tempest-LiveMigrationTest-1371243068 tempest-LiveMigrationTest-1371243068-project] 10.222.0.25 "GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4" status: 404 len: 111 microversion: 2.1 time: 0.111794 Sep 23 03:48:38.575802 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1202/2337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:38 2022] GET /compute/v2.1/servers/1d8c59b3-d1c7-4aa5-8f1c-4b1e7818c4e4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:38.579520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-18e42a8c-bfdb-4517-a474-ef8c737bd888 req-562f7418-1ac3-4f3a-b20d-475a4eb624b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118905 Sep 23 03:48:38.584835 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1136/2338] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:38.586842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:38.587666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:38.602915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.616677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.620972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.622465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.623219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.625151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.836917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c82eb1-61f1-4ec4-b754-2b695400eece", "name": "network-vif-plugged", "status": "completed", "tag": "21040eb7-40b5-44a6-a05f-9e807aa8576c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:38.870948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:38.873849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:38.875811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:38.919038 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] Creating event network-vif-plugged:21040eb7-40b5-44a6-a05f-9e807aa8576c for instance 86c82eb1-61f1-4ec4-b754-2b695400eece on n-h2-858495-2 Sep 23 03:48:38.946674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bc75bf50-cfa0-4e8f-9136-9c2eadaf2b3e req-a51f3676-77ca-44f6-91d3-78fc40a06cb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354419 Sep 23 03:48:38.949899 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1137/2339] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:38.976604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e805dc74-3946-4446-9157-735ba14cb110 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b3ecaf0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:39.168663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e805dc74-3946-4446-9157-735ba14cb110 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 200 len: 1421 microversion: 2.1 time: 0.214540 Sep 23 03:48:39.178110 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1138/2340] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:38 2022] GET /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 1421 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:39.191358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-995f0a7e-3fa1-4655-ad64-0dda6f0d4c9f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b0f30d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:40.518610 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-995f0a7e-3fa1-4655-ad64-0dda6f0d4c9f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 204 len: 0 microversion: 2.1 time: 1.338945 Sep 23 03:48:40.519271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1139/2341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:39 2022] DELETE /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 0 bytes in 1340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:40.667912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35e216f4-30a5-4e12-97b2-c2f20ba0d60f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8b848160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1992922393", "description": "tempest-description-168623572"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:40.997510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:41.011786 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9279d23-2e7a-4ef7-9509-4dfde9f2ee35 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1324 microversion: 2.1 time: 2.434518 Sep 23 03:48:41.022267 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1203/2342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:38 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1324 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:41.037530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4016fb3f-3f07-46b7-9bba-462b800af135 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b69a280>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:41.210145 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4016fb3f-3f07-46b7-9bba-462b800af135 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.182478 Sep 23 03:48:41.212384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1204/2343] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:41 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:41.227878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:41.228382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:41.261844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:41.263108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:41.263830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:41.272332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:41.276117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:41.276894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:41.382733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:41.643586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81b17c9c-a2a9-48db-ab98-eb5faffb9d1d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 204 len: 0 microversion: 2.1 time: 0.429822 Sep 23 03:48:41.644498 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1205/2344] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:48:41 2022] DELETE /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:41.973821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-275265458", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1896f5f0-54eb-42f5-b3a9-0accb590ad4a"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:42.134455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] validate_networks() for [('1896f5f0-54eb-42f5-b3a9-0accb590ad4a', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:48:43.373317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:48:43.373917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:48:43.374309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:48:43.375169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:48:43.375861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:48:43.381165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35e216f4-30a5-4e12-97b2-c2f20ba0d60f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.858753 Sep 23 03:48:43.383088 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1140/2345] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:48:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:43.394156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:43.397573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:43.398934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:43.399445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:43.399893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:43.400646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:43.401123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:43.413776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:43.433593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:43.434631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:43.436562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:43.442131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:43.446088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:43.447800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:43.480064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:43.494622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for user 20166e829a544516a4adcdd3e0a4945e and project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:43.534745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:48:43.539556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:48:43.646032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-215e3a6c-b434-421f-b1bd-9d9e6ab9564b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676585 Sep 23 03:48:43.656678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1206/2346] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:48:43.668522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e652f465-674f-4193-8678-ec04aa32f344 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8aa55430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:43.763768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e652f465-674f-4193-8678-ec04aa32f344 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.105427 Sep 23 03:48:43.771864 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1207/2347] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:43 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:43.779739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd3746-49c4-4ca2-8cff-9fa0ed50acde", "name": "network-vif-unplugged", "status": "completed", "tag": "4925370a-4a19-4589-aa55-cbfe52b23cd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:43.794410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:43.795009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:43.795712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:43.811286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] Creating event network-vif-unplugged:4925370a-4a19-4589-aa55-cbfe52b23cd6 for instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde on n-h1-858495-2 Sep 23 03:48:43.819319 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-05536499-0b2b-42d6-ae06-a3d6fa86c109 req-ea100f3d-67cd-4e55-9513-6af3bb7d0173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043559 Sep 23 03:48:43.821792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1208/2348] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:43.828623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49d6c60d-18db-4bfe-a8ac-968e06bd977f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8bae6c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1532147844", "description": "tempest-description-1602989705"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:44.198647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:44.227896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e56415b8-ef24-456f-9724-67d172cc1507 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1522 microversion: 2.1 time: 0.843369 Sep 23 03:48:44.228856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1141/2349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:43 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:44.242667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df849a88-a585-4e69-9035-0244fcc503b9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:44.249487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-df849a88-a585-4e69-9035-0244fcc503b9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:44.573916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-df849a88-a585-4e69-9035-0244fcc503b9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:44.596442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df849a88-a585-4e69-9035-0244fcc503b9 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1207 microversion: 2.1 time: 0.363557 Sep 23 03:48:44.597099 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1142/2350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:44 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1207 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:44.654680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:44.655946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:44.675842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:44.676601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:44.677476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:44.679323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:44.679979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:44.684110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:44.823165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] HTTP exception thrown: Action 999 not found Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Request method failure captured: Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece/os-instance-actions/999 HTTP/1.1 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxv9GDejFy2rX3IoDE1Z_NJBIjaZg2KW9yQzj1FLkcjhVfZy9mErruNMHnWkXSfZ3AdOrkxuTaf6_y1RlFlMRuEZuTRpImyF6DCBSy0ovjYvvxN0JEhL8xgpYMnzPNmoP__xAesq3xMfr6D8JWoL9AQ-SQ3WLeDP4T-5uXhce2aJzg Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1d7c4d656548437585ec8d92abaed351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5fa60c8b933f4f109eff3b22814ee8ee Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: exception: Action 999 not found Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '86c82eb1-61f1-4ec4-b754-2b695400eece', 'id': '999'} Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 23 03:48:44.837408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:44.842262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Returning 404 to user: Action 999 not found {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:44.854283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36a84cab-7745-4a90-a709-d76205fabf31 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.229034 Sep 23 03:48:44.863831 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1143/2351] 10.222.0.25 () {58 vars in 1308 bytes} [Fri Sep 23 03:48:44 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece/os-instance-actions/999 => generated 66 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:48:44.876268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c552495c-e909-4c68-862a-d88a0711c311 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c934a9e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:44.976061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49d6c60d-18db-4bfe-a8ac-968e06bd977f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.151643 Sep 23 03:48:44.981406 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c552495c-e909-4c68-862a-d88a0711c311 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.115210 Sep 23 03:48:44.985236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1144/2352] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:44 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:44.990506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '.version_select at 0x7f0c8b169f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:44.993749 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1209/2353] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:48:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:45.002000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: c7e61c6e-041c-4300-97a5-e838b8db8ed1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:45.009004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] HTTP exception thrown: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Request method failure captured: Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/c7e61c6e-041c-4300-97a5-e838b8db8ed1/os-instance-actions HTTP/1.1 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSxv9GDejFy2rX3IoDE1Z_NJBIjaZg2KW9yQzj1FLkcjhVfZy9mErruNMHnWkXSfZ3AdOrkxuTaf6_y1RlFlMRuEZuTRpImyF6DCBSy0ovjYvvxN0JEhL8xgpYMnzPNmoP__xAesq3xMfr6D8JWoL9AQ-SQ3WLeDP4T-5uXhce2aJzg Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1d7c4d656548437585ec8d92abaed351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5fa60c8b933f4f109eff3b22814ee8ee Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': 'c7e61c6e-041c-4300-97a5-e838b8db8ed1'} Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:45.010739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. Sep 23 03:48:45.015124 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:48:45.027809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Returning 404 to user: Instance c7e61c6e-041c-4300-97a5-e838b8db8ed1 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:45.030600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-329e8bb4-0a90-4ceb-9177-d58440dad2d1 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/c7e61c6e-041c-4300-97a5-e838b8db8ed1/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044028 Sep 23 03:48:45.034410 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1145/2354] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Sep 23 03:48:44 2022] GET /compute/v2.1/servers/c7e61c6e-041c-4300-97a5-e838b8db8ed1/os-instance-actions => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:45.049471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:45.050311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:45.059762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:45.060256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:45.069278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:45.070086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:45.075819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:45.076375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:45.093709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1774220658", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "b41f64bf-9e16-4e37-b7d7-8812d93e0311"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:45.187301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] validate_networks() for [('b41f64bf-9e16-4e37-b7d7-8812d93e0311', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:48:45.246417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:48:45.586628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7e00081-3724-4846-a371-cf43e2745ebf tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 204 len: 0 microversion: 2.1 time: 0.543667 Sep 23 03:48:45.591939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1210/2355] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:48:45 2022] DELETE /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:48:45.602964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:45.607842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:45.639489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:45.640529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:45.641186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:45.644407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:45.645138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:45.649196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:46.607415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:46.617380 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03ea69d7-d832-4c96-b225-68e43e450848 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1528 microversion: 2.1 time: 1.020906 Sep 23 03:48:46.646457 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1211/2356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:45 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1528 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:46.652473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:46.653312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:46.667114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:46.670123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:46.670989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:46.674282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:46.675025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:46.675625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:46.969779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:46.979324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a64e528-167e-4ed5-86fd-69338480e474 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1265 microversion: 2.1 time: 0.331378 Sep 23 03:48:46.979918 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1212/2357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:46 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:47.007740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0c887a3-b674-4844-b89f-c36ad1e2016b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b723940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:47.103920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0c887a3-b674-4844-b89f-c36ad1e2016b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.107766 Sep 23 03:48:47.108456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1213/2358] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:46 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:47.315392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd3746-49c4-4ca2-8cff-9fa0ed50acde", "name": "network-vif-deleted", "tag": "4925370a-4a19-4589-aa55-cbfe52b23cd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:47.337881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:47.339509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:47.341982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:47.375367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] Creating event network-vif-deleted:4925370a-4a19-4589-aa55-cbfe52b23cd6 for instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde on n-h1-858495-2 Sep 23 03:48:47.398166 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4098fd82-b7ed-4bcb-ad9f-e2277781d93f req-38c417f9-7204-463d-9dff-b6d30e8a27c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286806 Sep 23 03:48:47.399434 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1214/2359] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:47.655753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:47.656547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:47.678912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:47.681956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:47.683160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:47.688852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:47.691787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:47.692572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:48.040219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:48:48.041199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:48:48.041862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:48:48.042452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:48:48.043373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:48:48.071195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:48.071672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:48.075104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:48.076986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:48.079399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:48.080444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:48.139753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Getting quotas for project 6ac755d23fcc4ec08edc0a67571fea93. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:48.161097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Getting quotas for user 252ad7dd5d0d4715b21e6777c2b3fa3f and project 6ac755d23fcc4ec08edc0a67571fea93. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:48.180353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:48:48.183196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:48:48.314401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4b12e62-21da-4535-9926-7b2486277af9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.222347 Sep 23 03:48:48.326193 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1146/2360] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:48:48.334169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:48.338615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:48.395591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:48.396062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:48.396522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:48.408211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:48.412124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:48.412821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:48.558088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:48.574724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47075da2-eb71-4bbd-b97f-fa5904dc8556 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1528 microversion: 2.1 time: 0.920651 Sep 23 03:48:48.585415 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1215/2361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:47 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1528 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:48.585415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c0b7962-9e9f-44eb-bb9f-e9ce85687b44 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c93378c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:48.690170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c0b7962-9e9f-44eb-bb9f-e9ce85687b44 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.111177 Sep 23 03:48:48.693249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1216/2362] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:48 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:48.703093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed3f7117-dd69-4f31-93f7-dbd5f85514af tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:48.703726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ed3f7117-dd69-4f31-93f7-dbd5f85514af tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:48.720961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:48.732758 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a82ee377-e86d-4668-a6dd-33d6fc867c15 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1265 microversion: 2.1 time: 0.405051 Sep 23 03:48:48.746169 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1147/2363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:48 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:48.989579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-353030591", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "8bdf3e76-5dd2-4e3f-b9a2-368680b84514"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:49.136348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] validate_networks() for [('8bdf3e76-5dd2-4e3f-b9a2-368680b84514', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:48:49.179520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ed3f7117-dd69-4f31-93f7-dbd5f85514af tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:49.218891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed3f7117-dd69-4f31-93f7-dbd5f85514af tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1216 microversion: 2.1 time: 0.523980 Sep 23 03:48:49.229508 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1217/2364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:48 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1216 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:49.622630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:49.623443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:49.672914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:49.682368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:49.683698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:49.691434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:49.702794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:49.703789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:49.735609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:50.250160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa60c8b933f4f109eff3b22814ee8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7c4d656548437585ec8d92abaed351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:50.259378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec258abf-1f75-46ab-9837-6b13c27a5a98 tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 200 len: 1486 microversion: 2.1 time: 0.658912 Sep 23 03:48:50.267425 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1218/2365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:49 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 1486 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:50.273311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-895ddf25-2eaa-419f-b634-227293739bd1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b4bbd30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:50.435601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-895ddf25-2eaa-419f-b634-227293739bd1 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.166898 Sep 23 03:48:50.436376 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1219/2366] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:50 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:50.477427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:50.478473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:50.504554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:50.509585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:50.509765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:50.510422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:50.510892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:50.511324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.035646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:51.044477 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e499c1b-f777-4103-a25d-fd94109127d1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1265 microversion: 2.1 time: 0.599718 Sep 23 03:48:51.048019 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1220/2367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:50 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1265 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:51.055295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:51.056886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:51.082224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.082898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.083541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.084418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.085028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.085684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.303012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:51.318507 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75374984-9714-46c1-907e-784e63288fad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1274 microversion: 2.1 time: 0.268198 Sep 23 03:48:51.328579 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1221/2368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:51 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:51.466584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c82eb1-61f1-4ec4-b754-2b695400eece", "name": "network-vif-deleted", "tag": "21040eb7-40b5-44a6-a05f-9e807aa8576c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:51.491459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.493702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.494356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.533766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] Creating event network-vif-deleted:21040eb7-40b5-44a6-a05f-9e807aa8576c for instance 86c82eb1-61f1-4ec4-b754-2b695400eece on n-h2-858495-2 Sep 23 03:48:51.552901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8afcad7b-4789-4160-93ca-752dc232ba24 req-08bdc7ce-42a1-4e19-81d9-d10f4c416dab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221022 Sep 23 03:48:51.558607 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1222/2369] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:51.576499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:51.582419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] [instance: 86c82eb1-61f1-4ec4-b754-2b695400eece] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:51.600536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.601047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.609703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.612087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.612838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.614497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.710954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] HTTP exception thrown: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Request method failure captured: Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece HTTP/1.1 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSxv9GDejFy2rX3IoDE1Z_NJBIjaZg2KW9yQzj1FLkcjhVfZy9mErruNMHnWkXSfZ3AdOrkxuTaf6_y1RlFlMRuEZuTRpImyF6DCBSy0ovjYvvxN0JEhL8xgpYMnzPNmoP__xAesq3xMfr6D8JWoL9AQ-SQ3WLeDP4T-5uXhce2aJzg Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1d7c4d656548437585ec8d92abaed351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1d7c4d656548437585ec8d92abaed351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1d7c4d656548437585ec8d92abaed351 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-577524511 Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5fa60c8b933f4f109eff3b22814ee8ee Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-577524511-project Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '86c82eb1-61f1-4ec4-b754-2b695400eece'} Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:51.749177 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. Sep 23 03:48:51.753679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:48:51.756870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] Returning 404 to user: Instance 86c82eb1-61f1-4ec4-b754-2b695400eece could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:48:51.762115 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8cdbf9c5-7bcd-4be8-8e85-768f0b1d77ec tempest-InstanceActionsNegativeTestJSON-577524511 tempest-InstanceActionsNegativeTestJSON-577524511-project] 10.222.0.25 "GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece" status: 404 len: 111 microversion: 2.1 time: 0.201921 Sep 23 03:48:51.771314 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1223/2370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:51 2022] GET /compute/v2.1/servers/86c82eb1-61f1-4ec4-b754-2b695400eece => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:48:51.794537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8ea7840-bd65-43e8-bb42-6cf0a0dcfed7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b6735e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:51.899894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:48:51.901808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:48:51.903167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:48:51.903815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:48:51.904439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:48:51.907398 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8ea7840-bd65-43e8-bb42-6cf0a0dcfed7 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.133535 Sep 23 03:48:51.908022 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1224/2371] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:51 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:51.929335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.931281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.932021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.932993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:51.933699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:51.934235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:51.957655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:52.053794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:52.071492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Getting quotas for project c3b9b5b7d8f743009c1ff26acaeb46a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:48:52.080260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Getting quotas for user 8d0d54e8f01845e2b6155b42d9fd2c5d and project c3b9b5b7d8f743009c1ff26acaeb46a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:48:52.088702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:52.089698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:52.106500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:48:52.109460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:52.109763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:48:52.109961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:52.115971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:52.117009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:52.117672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:52.118449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:52.300921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-474df4fe-4a0e-4452-b5ec-c1f0464d97b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.506735 Sep 23 03:48:52.302204 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1148/2372] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:48:52.315078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ff3c91f-131d-4039-8be8-33496f853f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:52.316010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ff3c91f-131d-4039-8be8-33496f853f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:52.507580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:52.517154 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37c87fec-6e42-4a8d-91a2-bd11fdccfb3b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1265 microversion: 2.1 time: 0.443947 Sep 23 03:48:52.520485 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1225/2373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:52 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1265 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:48:52.533620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:52.535073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:52.545839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:52.546347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:52.546835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:52.547496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:52.547996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:52.548590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:52.665150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ff3c91f-131d-4039-8be8-33496f853f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:52.695268 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ff3c91f-131d-4039-8be8-33496f853f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1215 microversion: 2.1 time: 0.384942 Sep 23 03:48:52.698487 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1149/2374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:52 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1215 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:52.902135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:52.918729 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71f4f5df-98be-4d5d-8541-cfad1e9b44fa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1274 microversion: 2.1 time: 0.396696 Sep 23 03:48:52.922082 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1226/2375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:52 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1274 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:52.924170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18709ba9-723d-4c16-824a-734d72ef000e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b2dc430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:53.042027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18709ba9-723d-4c16-824a-734d72ef000e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.122126 Sep 23 03:48:53.043875 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1150/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:52 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:53.543702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:53.545097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:53.555524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:53.557173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:53.557712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:53.558157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:53.558880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:53.559344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:53.559776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:53.727507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:53.730198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:53.745281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:53.746108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:53.746722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:53.747852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:53.753257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:53.753978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:54.399903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:54.408904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb3b2161-d3ad-4ff1-91d2-d239961922bb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1265 microversion: 2.1 time: 0.868973 Sep 23 03:48:54.429557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1227/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:53 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1265 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:54.434882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:54.441735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:54.461438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:54.467347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:54.470726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:54.471848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:54.473159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:54.476381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:54.484762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:54.498440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35919c64-3693-4edf-94f7-9f1337ad259f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1267 microversion: 2.1 time: 0.779151 Sep 23 03:48:54.499048 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1151/2378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:53 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1267 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:54.518795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-781bc1ab-b740-4fdd-8392-6c82bc03bf25 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b2593a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:54.632060 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-781bc1ab-b740-4fdd-8392-6c82bc03bf25 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.129786 Sep 23 03:48:54.641126 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1152/2379] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:54 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:55.491945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f264b0b-b2ed-4872-a159-870dab0221b4 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8bbe9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2034645302", "description": "tempest-description-469935830"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:55.984852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:56.019372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7d187a9-9ef0-4f5c-bb62-793f984c96b8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1316 microversion: 2.1 time: 1.588219 Sep 23 03:48:56.044040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1228/2380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:54 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1316 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:56.072633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:56.073158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:56.081715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:56.082539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:56.083792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:56.085047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:56.085758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:56.086599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:57.174522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:57.185020 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c49f942e-8cd4-42ba-8af8-aa1733d6c746 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 1.139497 Sep 23 03:48:57.189723 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1229/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:56 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:57.199109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:57.202277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:57.220998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:57.224477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:57.226024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:57.228462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:57.229000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:57.229470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:57.569251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:57.589280 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-660d6832-d33a-45ab-9d58-7a7194ca6f7f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1273 microversion: 2.1 time: 0.395963 Sep 23 03:48:57.615028 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1230/2382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:57 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:57.636012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a559fd35-8264-4f08-9c86-2c01a5b7bb0e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b7238b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:57.711337 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a559fd35-8264-4f08-9c86-2c01a5b7bb0e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.090796 Sep 23 03:48:57.712977 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1231/2383] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:48:57 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:57.719673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:57.720511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:57.733631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:57.734956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:57.736045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:57.737848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:57.740935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:57.742021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:58.371469 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f264b0b-b2ed-4872-a159-870dab0221b4 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.995997 Sep 23 03:48:58.384789 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1153/2384] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:48:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:48:58.409959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0682afe-60fd-42cb-bc0d-e36592e2a564", "tag": "dc76eac9-ee54-4d3b-af63-a50f59674ae6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:58.434429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:58.440484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:58.445185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:58.465684 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] Creating event network-changed:dc76eac9-ee54-4d3b-af63-a50f59674ae6 for instance e0682afe-60fd-42cb-bc0d-e36592e2a564 on n-h1-858495-2 Sep 23 03:48:58.474082 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5f3a96d9-472c-4f17-bab6-557f94f156f0 req-06094cd5-657f-45b9-b00b-cbd264e18269 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079858 Sep 23 03:48:58.477384 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1154/2385] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:48:58.500194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:58.506724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:58.524292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:58.526931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:58.528208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:58.529654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:58.530642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:58.531568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:58.940841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:58.955265 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83eed4d0-a7f0-4237-8496-9efc4e0868ba tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1316 microversion: 2.1 time: 1.240175 Sep 23 03:48:58.956206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1232/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:57 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1316 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:58.980817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dbf2d07-5e85-4aec-afcf-93721d291c3b tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b673ca0>, body: {"security_group_rule": {"parent_group_id": "28d1ab1b-bb80-4f61-9550-01c5fff92d62", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:48:59.194040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:48:59.457520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:48:59.471071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68c4d911-09f1-43af-9ba1-95ea3871ed6c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 0.984686 Sep 23 03:48:59.493540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1155/2387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:58 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:48:59.516482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:48:59.521490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:48:59.544434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:59.549070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:59.549668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:48:59.553012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:48:59.555466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:48:59.558108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:00.341761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:00.356478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4cb7110-e3fd-4bd8-8c6c-67a8775e8701 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.859069 Sep 23 03:49:00.357124 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1156/2388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:48:59 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:00.375502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-188b7dca-46f0-4f7a-b1f9-1ca1e8a5ca22 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b142a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:00.499331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-188b7dca-46f0-4f7a-b1f9-1ca1e8a5ca22 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1455 microversion: 2.1 time: 0.140125 Sep 23 03:49:00.515034 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1157/2389] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:00 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:00.524928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:00.533546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:00.547889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:00.552331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:00.553882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:00.554783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:00.556383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:00.558229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:01.229287 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dbf2d07-5e85-4aec-afcf-93721d291c3b tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.266274 Sep 23 03:49:01.230224 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1233/2390] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:48:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:01.246220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:01.247720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:01.266217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:01.269678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:01.271836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:01.272826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:01.275284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:01.276943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:01.958252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:02.159214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:02.171310 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f76bb2d-7922-496f-a55f-b5f9a90383bf tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1316 microversion: 2.1 time: 1.654490 Sep 23 03:49:02.186386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1158/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:00 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1316 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:02.195122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1208f75f-2d73-429b-b853-171f672c1cd1 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b142dc0>, body: {"security_group_rule": {"parent_group_id": "28d1ab1b-bb80-4f61-9550-01c5fff92d62", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:02.274022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:02.287650 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73bb9edc-52f7-42c1-965a-4b5be988c8b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 1.055973 Sep 23 03:49:02.303569 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1234/2392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:01 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:02.313613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:02.315602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:02.326686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:02.327616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:02.328492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:02.330302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:02.333922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:02.334392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:02.511254 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1208f75f-2d73-429b-b853-171f672c1cd1 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1208f75f-2d73-429b-b853-171f672c1cd1 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 138 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: {"security_group_rule": {"parent_group_id": "28d1ab1b-bb80-4f61-9550-01c5fff92d62", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: exception: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'security_group_rule': {'parent_group_id': '28d1ab1b-bb80-4f61-9550-01c5fff92d62', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:02.513516 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:02.517041 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:02.517041 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:02.517041 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 Sep 23 03:49:02.517041 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:02.521383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1208f75f-2d73-429b-b853-171f672c1cd1 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: This rule already exists in group 28d1ab1b-bb80-4f61-9550-01c5fff92d62 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:02.522588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1208f75f-2d73-429b-b853-171f672c1cd1 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.334778 Sep 23 03:49:02.526932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1159/2393] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:02 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:49:02.531958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a89c65f6-cc59-497f-9127-b2041e67dbd3 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1f8430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:02.588567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a89c65f6-cc59-497f-9127-b2041e67dbd3 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1464 microversion: 2.1 time: 0.060269 Sep 23 03:49:02.590014 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1160/2394] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:02 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1464 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:02.594804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-973427d5-ef3a-439e-a620-8d8486c14f8c tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b79ddc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:02.684103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=16 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:03.628936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:03.641789 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f572ade6-40e1-46d4-a083-4623ad072dda tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 1.336560 Sep 23 03:49:03.649931 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1235/2395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:02 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:03.661522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3dd4cbf-1457-4f9b-9403-91e4321b7493 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1b8dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:03.778362 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3dd4cbf-1457-4f9b-9403-91e4321b7493 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 200 len: 1464 microversion: 2.1 time: 0.127162 Sep 23 03:49:03.782064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1236/2396] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:03 2022] GET /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 1464 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:03.791702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:03.793158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:03.802480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:03.803822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:03.804478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:03.805459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:03.806518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:03.807911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.079718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-973427d5-ef3a-439e-a620-8d8486c14f8c tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/97e14784-79e8-4bd7-9ac8-78aad240131f" status: 202 len: 0 microversion: 2.1 time: 1.488354 Sep 23 03:49:04.086433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1161/2397] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Sep 23 03:49:02 2022] DELETE /compute/v2.1/os-security-group-rules/97e14784-79e8-4bd7-9ac8-78aad240131f => generated 0 bytes in 1496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:04.095232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:04.096103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:04.116977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:04.117860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:04.118915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.122185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:04.123074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:04.124625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.627698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:04.639627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-027ed083-c07b-471b-b133-b5b7d71989f0 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1316 microversion: 2.1 time: 0.855653 Sep 23 03:49:04.643439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1237/2398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:03 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1316 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:04.656119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:04.657035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:04.664325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:04.664817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:04.665516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.666356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:04.666881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:04.667502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.931696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:04.946245 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ffc1ce2c-c964-488f-9fca-0dfcd4152db5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 0.858369 Sep 23 03:49:04.961436 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1162/2399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:04 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:04.961436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc41f01d-5792-42a0-a520-014873a3171d", "tag": "45498f70-2486-46a9-8191-3e776d1543fa"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:04.974733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:04.975302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:04.975819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:04.991660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] Creating event network-changed:45498f70-2486-46a9-8191-3e776d1543fa for instance bc41f01d-5792-42a0-a520-014873a3171d on n-h1-858495-2 Sep 23 03:49:04.996971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-18c5c3ef-3162-4067-987c-7a0d03f5c88a req-156275fa-47cd-4279-b068-c5cfa077c2ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048298 Sep 23 03:49:05.000857 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1163/2400] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:05.007432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c401eef0-e7e1-465a-9897-47805b818ecd tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b259ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1560086138", "description": "tempest-description-1757093343"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:05.260112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:05.286008 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63d35a53-806f-497d-9a21-423aa8bb2d30 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1467 microversion: 2.1 time: 0.635120 Sep 23 03:49:05.286672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1238/2401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:04 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1467 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:05.291645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0682afe-60fd-42cb-bc0d-e36592e2a564", "name": "network-vif-plugged", "status": "completed", "tag": "dc76eac9-ee54-4d3b-af63-a50f59674ae6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:05.318961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:05.319718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:05.319899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:05.347543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] Creating event network-vif-plugged:dc76eac9-ee54-4d3b-af63-a50f59674ae6 for instance e0682afe-60fd-42cb-bc0d-e36592e2a564 on n-h1-858495-2 Sep 23 03:49:05.354088 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-eaf51ee5-b0ee-47ce-9d5e-fad63c09868c req-603fc85e-ca8b-44e6-bb2e-401039ad3d21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065627 Sep 23 03:49:05.354976 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1239/2402] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:05.365434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:05.368310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:05.387153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:05.387832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:05.388705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:05.389632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:05.390240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:05.390854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:05.977460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:06.043007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58585c66-3af8-415b-8fc8-044e564af026 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.683343 Sep 23 03:49:06.045431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1240/2403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:05 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:06.063034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d1548ac-1169-49ed-a349-8d944fc65460 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b673310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:06.089480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c401eef0-e7e1-465a-9897-47805b818ecd tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.087038 Sep 23 03:49:06.090536 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1164/2404] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:05 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:06.095313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:06.096114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:06.110066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:06.111817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:06.112296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:06.115241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:06.115726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:06.116168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:06.216776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5d1548ac-1169-49ed-a349-8d944fc65460 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-09-23T03%3A46%3A13Z" status: 200 len: 1902 microversion: 2.1 time: 0.165147 Sep 23 03:49:06.218830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1241/2405] 10.222.0.25 () {58 vars in 1199 bytes} [Fri Sep 23 03:49:06 2022] GET /compute/v2.1/images?changes-since=2022-09-23T03%3A46%3A13Z => generated 1902 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:06.224197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:06.227057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:06.237234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:06.238118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:06.239336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:06.240712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:06.241419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:06.242068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:06.854302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:06.857890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:06.874883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b35f3e5b-ee29-439e-92ca-ea53630c59ed tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 0.654691 Sep 23 03:49:06.875488 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1242/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:06 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:06.913886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-333375a3-24c0-4542-a663-6928ecdfee85 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b30f1f0>, body: {"security_group_rule": {"parent_group_id": "4ed96b42-508e-48c4-b3fe-f801decaa2e5", "ip_protocol": "tcp", "from_port": 1058120217, "to_port": 22}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:07.024615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:07.035253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5adf54a1-ba03-41d9-89ae-4065ec5f69ad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1316 microversion: 2.1 time: 0.943469 Sep 23 03:49:07.036453 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1165/2407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:06 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1316 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:07.042211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec6923d8-7915-4710-8a19-a7cecefceab6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b8871f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:07.174296 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-333375a3-24c0-4542-a663-6928ecdfee85 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Invalid port range 1058120217:22. Former value cannot be greater than the later Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-333375a3-24c0-4542-a663-6928ecdfee85 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 146 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: {"security_group_rule": {"parent_group_id": "4ed96b42-508e-48c4-b3fe-f801decaa2e5", "ip_protocol": "tcp", "from_port": 1058120217, "to_port": 22}} Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid port range 1058120217:22. Former value cannot be greater than the later Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ed96b42-508e-48c4-b3fe-f801decaa2e5', 'ip_protocol': 'tcp', 'from_port': 1058120217, 'to_port': 22}}} Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1058120217:22. Former value cannot be greater than the later Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1058120217:22. Former value cannot be greater than the later Sep 23 03:49:07.176667 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1058120217:22. Former value cannot be greater than the later Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-333375a3-24c0-4542-a663-6928ecdfee85 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: Invalid port range 1058120217:22. Former value cannot be greater than the later {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-333375a3-24c0-4542-a663-6928ecdfee85 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.279168 Sep 23 03:49:07.181540 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1243/2408] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:06 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:49:07.184081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec6923d8-7915-4710-8a19-a7cecefceab6 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1909869513" status: 200 len: 485 microversion: 2.1 time: 0.146007 Sep 23 03:49:07.185552 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1166/2409] 10.222.0.25 () {58 vars in 1231 bytes} [Fri Sep 23 03:49:07 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1909869513 => generated 485 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:07.186942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e131c1cc-ce3a-42a8-bf3c-4b4d23b43248", "tag": "18b994cc-df23-4e6d-bcb2-b253d56b680a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:07.190948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:07.192558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:07.204894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:07.210940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:07.211741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:07.214140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:07.214999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:07.218684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:07.219273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:07.223575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:07.224427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:07.225337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:07.265793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] Creating event network-changed:18b994cc-df23-4e6d-bcb2-b253d56b680a for instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 on n-h2-858495-2 Sep 23 03:49:07.275314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-61db1ae6-4cb7-4c08-9a2a-13fcbf61060e req-11d04099-a9da-40df-ad03-97bfb2bf776c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094569 Sep 23 03:49:07.278128 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1244/2410] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:07.283809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11d23a61-ece0-4a5e-9e45-55a9925f7658 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8be90280>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1907046772", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:07.286346 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-11d23a61-ece0-4a5e-9e45-55a9925f7658 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Security group id should be uuid Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11d23a61-ece0-4a5e-9e45-55a9925f7658 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 131 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1907046772", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group id should be uuid Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1907046772', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:07.288954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:07.292754 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 23 03:49:07.292754 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:07.294235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11d23a61-ece0-4a5e-9e45-55a9925f7658 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: Security group id should be uuid {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:07.295412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-11d23a61-ece0-4a5e-9e45-55a9925f7658 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015814 Sep 23 03:49:07.303414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1245/2411] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:07 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:49:07.308915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ecc02f5-b66d-400b-ba63-0b5a8369c338 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b64e820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:07.506623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ecc02f5-b66d-400b-ba63-0b5a8369c338 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?server=3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 957 microversion: 2.1 time: 0.201627 Sep 23 03:49:07.518367 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1246/2412] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Sep 23 03:49:07 2022] GET /compute/v2.1/images?server=3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 957 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:07.525850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4de94f51-de54-4bb8-9cd7-933b6fe367c6 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b143820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1089183873", "description": "tempest-description-2083553089"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:07.890308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:07.903138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-393df598-bd74-46a7-8330-70c55c9939c8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.716237 Sep 23 03:49:07.915315 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1167/2413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:07 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:07.915315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-832af0f3-fc23-4281-972a-bf8b1e873cff tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b633ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:08.029374 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-832af0f3-fc23-4281-972a-bf8b1e873cff tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 485 microversion: 2.1 time: 0.120885 Sep 23 03:49:08.030199 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1168/2414] 10.222.0.25 () {58 vars in 1317 bytes} [Fri Sep 23 03:49:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 485 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:08.034999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:08.058993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.059944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.060797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.085397 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] Creating event network-vif-unplugged:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:49:08.095013 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-550bf2b8-ea55-4e89-a01c-e366b5c21135 req-52a58fb8-711e-40c3-86ca-6b9f53325e98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063088 Sep 23 03:49:08.103233 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1169/2415] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:08.119176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:08.120388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:08.130057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.130940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.132043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.134370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.135090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.135702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.153261 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4de94f51-de54-4bb8-9cd7-933b6fe367c6 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.633452 Sep 23 03:49:08.153909 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1247/2416] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:08.159057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e4c4b2b-9d18-4130-a274-d9d0500370cf tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8bc5d160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:08.264171 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e4c4b2b-9d18-4130-a274-d9d0500370cf tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 485 microversion: 2.1 time: 0.109011 Sep 23 03:49:08.265179 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1248/2417] 10.222.0.25 () {58 vars in 1303 bytes} [Fri Sep 23 03:49:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 485 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:08.272316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:08.273843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:08.285585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.286360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.287050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.288198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.289161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.289917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.522683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:08.548675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:08.554749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d234221-4226-43cf-9099-41e461c2a255 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 0.448220 Sep 23 03:49:08.558515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1170/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:08 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:08.561009 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ed51469-185d-434f-8bb9-98ba1b148a98 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1504 microversion: 2.1 time: 0.294638 Sep 23 03:49:08.566356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-772dbe7a-7f57-41a1-b3ef-4d1b9edad073 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b848160>, body: {"security_group_rule": {"parent_group_id": "451fac9b-ae57-418a-8bfc-0d48ac558511", "ip_protocol": "tempest-999-490261464", "from_port": 22, "to_port": 22}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:08.579616 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1249/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:08 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:08.585432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e301d1ee-afd6-4011-8010-af8f44ddf207 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8bcfc430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:08.746866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-772dbe7a-7f57-41a1-b3ef-4d1b9edad073 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Invalid IP protocol tempest-999-490261464. Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-772dbe7a-7f57-41a1-b3ef-4d1b9edad073 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 156 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: {"security_group_rule": {"parent_group_id": "451fac9b-ae57-418a-8bfc-0d48ac558511", "ip_protocol": "tempest-999-490261464", "from_port": 22, "to_port": 22}} Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid IP protocol tempest-999-490261464. Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'security_group_rule': {'parent_group_id': '451fac9b-ae57-418a-8bfc-0d48ac558511', 'ip_protocol': 'tempest-999-490261464', 'from_port': 22, 'to_port': 22}}} Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-490261464. Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-490261464. Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:08.751171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-490261464. Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:08.754786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-772dbe7a-7f57-41a1-b3ef-4d1b9edad073 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: Invalid IP protocol tempest-999-490261464. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:08.755597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-772dbe7a-7f57-41a1-b3ef-4d1b9edad073 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.195521 Sep 23 03:49:08.758845 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1171/2420] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:08 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:49:08.770045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1992922393"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:08.776530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:08.822311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.822846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.827989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.828929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:08.829516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:08.829921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:08.837777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e301d1ee-afd6-4011-8010-af8f44ddf207 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.256840 Sep 23 03:49:08.838377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1250/2421] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:49:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:08.854583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-703ce91b-f4e3-48cd-905e-1d665b884d55 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b64ef70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1364176570", "description": "tempest-description-597344333"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:09.339831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.security_group_api [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Adding security group 58602791-2995-4407-ad9b-a570797a4fad to port dc76eac9-ee54-4d3b-af63-a50f59674ae6 Sep 23 03:49:09.594182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-703ce91b-f4e3-48cd-905e-1d665b884d55 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.754389 Sep 23 03:49:09.594979 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1251/2422] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:09.608404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8224ceec-0e2a-44ab-8bec-627842dc0426 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b30f160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:09.714029 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8224ceec-0e2a-44ab-8bec-627842dc0426 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.117200 Sep 23 03:49:09.715580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1252/2423] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:49:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:09.722959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:09.725061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:09.735473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:09.736770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:09.737514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:09.739065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:09.739891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:09.740526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:10.197930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:10.215677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6440ae1-7a0c-4194-b243-11e0021e52b5 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.498805 Sep 23 03:49:10.216596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1253/2424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:09 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:10.221292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:10.222171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:10.241532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:10.242032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:10.242475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:10.243199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:10.243679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:10.244091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:10.602648 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdb9d499-03e3-4353-83bd-4bd03bf10567 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/action" status: 202 len: 0 microversion: 2.1 time: 1.841079 Sep 23 03:49:10.609106 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1172/2425] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:49:08 2022] POST /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/action => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:10.610316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:10.628073 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6cd7422-b9b7-4c49-a199-9a32f69ddabf tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1307 microversion: 2.1 time: 0.410366 Sep 23 03:49:10.628680 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1254/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:10 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1307 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:10.633139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5332b802-7792-4624-bf39-db09bd192b16 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b169d30>, body: {"security_group_rule": {"parent_group_id": "bc2943f4-e703-4413-9080-764d31df55ca", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:10.633304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7286f4f9-7231-4d42-b8ce-421145342839 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b648b80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:10.800106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7286f4f9-7231-4d42-b8ce-421145342839 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.170255 Sep 23 03:49:10.809544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1255/2427] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:49:10 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:10.832979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc41f01d-5792-42a0-a520-014873a3171d", "name": "network-vif-plugged", "status": "completed", "tag": "45498f70-2486-46a9-8191-3e776d1543fa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:10.904697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:10.910542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:10.913857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:10.937395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] Creating event network-vif-plugged:45498f70-2486-46a9-8191-3e776d1543fa for instance bc41f01d-5792-42a0-a520-014873a3171d on n-h1-858495-2 Sep 23 03:49:10.950867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d4dab600-a1b4-4a8e-b049-6caca36219e6 req-be627760-a5de-483d-90c0-aae561df3fe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140147 Sep 23 03:49:10.952404 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1256/2428] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:10.975610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1532147844"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:10.979558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:11.006071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:11.012743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:11.014520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:11.015480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:11.024243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:11.025619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:11.057600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5332b802-7792-4624-bf39-db09bd192b16 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5332b802-7792-4624-bf39-db09bd192b16 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 138 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: {"security_group_rule": {"parent_group_id": "bc2943f4-e703-4413-9080-764d31df55ca", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bc2943f4-e703-4413-9080-764d31df55ca', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 03:49:11.060958 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5332b802-7792-4624-bf39-db09bd192b16 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:11.065107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5332b802-7792-4624-bf39-db09bd192b16 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.452727 Sep 23 03:49:11.065994 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1173/2429] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:49:11.081156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0682afe-60fd-42cb-bc0d-e36592e2a564", "tag": "dc76eac9-ee54-4d3b-af63-a50f59674ae6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:11.110934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:11.111733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:11.112357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:11.131146 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] Creating event network-changed:dc76eac9-ee54-4d3b-af63-a50f59674ae6 for instance e0682afe-60fd-42cb-bc0d-e36592e2a564 on n-h1-858495-2 Sep 23 03:49:11.139505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-04ad2958-5108-47ab-bcac-e5a8a478bacf req-9c3b7fd5-8558-4e2d-98fb-0b91ca3a9726 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071438 Sep 23 03:49:11.140850 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1174/2430] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:11.165690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-643bb5f7-dd51-4663-bbab-1f03a6ee014d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b530ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:11.361485 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-643bb5f7-dd51-4663-bbab-1f03a6ee014d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-09-23T03%3A46%3A08Z" status: 200 len: 6334 microversion: 2.1 time: 0.218261 Sep 23 03:49:11.362342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1175/2431] 10.222.0.25 () {58 vars in 1220 bytes} [Fri Sep 23 03:49:11 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-23T03%3A46%3A08Z => generated 6334 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:11.372317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e9540c83-6d83-4399-b3ea-0314daf05182 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c93490f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-270788758", "description": "tempest-description-1508529768"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:12.072679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Adding security group 756803e8-3375-4fb3-b328-d8c24157ce94 to port dc76eac9-ee54-4d3b-af63-a50f59674ae6 Sep 23 03:49:12.824342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e9540c83-6d83-4399-b3ea-0314daf05182 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.459262 Sep 23 03:49:12.827346 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1176/2432] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:12.839270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:12.843107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:12.869243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:12.871284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:12.871865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:12.879939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:12.882045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:12.883493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:13.396566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:13.414451 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a1ae064-f2a0-49ba-bfea-00633e95a52f tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.585142 Sep 23 03:49:13.427220 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1177/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:12 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:13.441187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65681062-07a8-41ac-9541-83b2521fa21b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b3ecf70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:13.562599 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65681062-07a8-41ac-9541-83b2521fa21b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1909869513" status: 200 len: 665 microversion: 2.1 time: 0.133749 Sep 23 03:49:13.564822 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1178/2434] 10.222.0.25 () {58 vars in 1252 bytes} [Fri Sep 23 03:49:13 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1909869513 => generated 665 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:13.575062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:13.576018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:13.585427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:13.586374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:13.587415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:13.588452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:13.589079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:13.589705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:13.640581 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-77c7d096-f254-4fa8-8e5a-44b059d2a3d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/action" status: 202 len: 0 microversion: 2.1 time: 2.684753 Sep 23 03:49:13.641222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1257/2435] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:49:10 2022] POST /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/action => generated 0 bytes in 2688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:13.652565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c14bf58-6a12-4536-9bc8-39dd9788fbba tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b648280>, body: {"security_group_rule": {"parent_group_id": "3a8843b6-99c6-4029-8745-df64ca886fee", "ip_protocol": "tcp", "from_port": 22, "to_port": 1929810351}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:13.837796 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7c14bf58-6a12-4536-9bc8-39dd9788fbba tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c14bf58-6a12-4536-9bc8-39dd9788fbba tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 146 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: {"security_group_rule": {"parent_group_id": "3a8843b6-99c6-4029-8745-df64ca886fee", "ip_protocol": "tcp", "from_port": 22, "to_port": 1929810351}} Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a8843b6-99c6-4029-8745-df64ca886fee', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1929810351}}} Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 Sep 23 03:49:13.841529 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c14bf58-6a12-4536-9bc8-39dd9788fbba tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 400 to user: Invalid port range 22:1929810351. Valid TCP ports should be between 1-65535 {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:13.846240 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c14bf58-6a12-4536-9bc8-39dd9788fbba tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.196764 Sep 23 03:49:13.848888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1258/2436] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:13 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:49:13.862092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-148ff675-08b0-44b3-991a-3cdef9888481 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b3703a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:13.962989 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-148ff675-08b0-44b3-991a-3cdef9888481 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1467 microversion: 2.1 time: 0.110460 Sep 23 03:49:13.979403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1259/2437] 10.222.0.25 () {58 vars in 1338 bytes} [Fri Sep 23 03:49:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1467 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:13.997510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:14.000974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:14.003422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:14.007471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21e0d3fb-2f8e-49d0-aed9-21b13379b91d tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1487 microversion: 2.1 time: 0.441538 Sep 23 03:49:14.008614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1179/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:13 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1487 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:14.015920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0682afe-60fd-42cb-bc0d-e36592e2a564", "tag": "dc76eac9-ee54-4d3b-af63-a50f59674ae6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:14.029771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:14.030760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:14.031345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:14.042328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:14.042818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:14.045018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:14.047078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] Creating event network-changed:dc76eac9-ee54-4d3b-af63-a50f59674ae6 for instance e0682afe-60fd-42cb-bc0d-e36592e2a564 on n-h1-858495-2 Sep 23 03:49:14.047559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:14.048416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:14.049559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:14.053946 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0005829b-25a7-4e07-a20a-7294dff4a300 req-8ec431d9-4885-4811-ac39-2f6098730f0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043461 Sep 23 03:49:14.054916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1180/2439] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:14.062148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Action: 'create', calling method: .version_select at 0x7f0c8b259b80>, body: {"security_group_rule": {"parent_group_id": "b248ba09-6f1b-461f-a12b-89e9f7652de2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:14.097067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:14.098396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Neutron security group b248ba09-6f1b-461f-a12b-89e9f7652de2 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:49:14.098970 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.098970 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 138 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: {"security_group_rule": {"parent_group_id": "b248ba09-6f1b-461f-a12b-89e9f7652de2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b248ba09-6f1b-461f-a12b-89e9f7652de2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:14.101161 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 404 to user: Security group b248ba09-6f1b-461f-a12b-89e9f7652de2 does not exist Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-1cf66387-37ab-4f33-9ab8-8a50546c4098'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b6807d9-d9e5-408b-8495-1b8129e49456 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.046867 Sep 23 03:49:14.104441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1181/2440] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Sep 23 03:49:14 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:14.113046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3d2944c9-aac8-48f4-a3b9-ff9a5ec3c097 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8aa964c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:14.228144 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3d2944c9-aac8-48f4-a3b9-ff9a5ec3c097 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1467 microversion: 2.1 time: 0.122690 Sep 23 03:49:14.233396 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1182/2441] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Sep 23 03:49:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1467 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:14.236373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:14.237206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:14.251498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:14.254609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:14.255204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:14.257909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:14.258634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:14.259081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:14.284019 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c08fddd3-1802-447c-8755-81aeaab7d43b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.302433 Sep 23 03:49:14.284973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1260/2442] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Sep 23 03:49:13 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564/os-security-groups => generated 1158 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:14.290124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b673310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:14.311535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lazy-loading 'flavor' on Instance uuid bc41f01d-5792-42a0-a520-014873a3171d {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:49:14.314509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:14.315247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Neutron security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 not found {{(pid=128724) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 23 03:49:14.315890 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] HTTP exception thrown: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.315890 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Request method failure captured: Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-group-rules/040be498-4a19-4110-9f35-f162dba7c2e8 HTTP/1.1 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyna9nx-NJUo10b-cMcU6KGWbgt2saQoAqBjLSb0mn68XIQYa0N6M13TG9c9E4NvOG8Wg8YHQM-vbMB-8SE1yioWGUj29NQ5xiC3EshUQvUT409C2FI15w0W5G_UpJt1oJdlYDenP-x6vQOAhYj-Qmctl7AOov7ZIBWK3H-VRtpvqI Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e385286d6c4a7fa310f11ea10f9f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 39e385286d6c4a7fa310f11ea10f9f53 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 73414dadd5f744f6a30d66cda1ede26b Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-209380256-project Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '040be498-4a19-4110-9f35-f162dba7c2e8'} Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:14.318713 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] Sep 23 03:49:14.322493 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:14.325934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Returning 404 to user: Security group rule 040be498-4a19-4110-9f35-f162dba7c2e8 does not exist Sep 23 03:49:14.325934 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-d5eb9b54-5d33-4946-9797-d743ff75aad4'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:14.325934 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c03d77e5-4840-42c5-860a-21230f6afdd2 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/040be498-4a19-4110-9f35-f162dba7c2e8" status: 404 len: 199 microversion: 2.1 time: 0.038245 Sep 23 03:49:14.326127 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1261/2443] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Sep 23 03:49:14 2022] DELETE /compute/v2.1/os-security-group-rules/040be498-4a19-4110-9f35-f162dba7c2e8 => generated 199 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:14.335988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a74ba95d-2035-4cec-a5a6-54cecd37ca05 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b6e5ee0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:14.480060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a74ba95d-2035-4cec-a5a6-54cecd37ca05 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.152605 Sep 23 03:49:14.483718 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1262/2444] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:49:14 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:14.497509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ff9405cb-f534-44be-834a-14e96f77adee tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8a94dd30>, body: {"security_group": {"name": " tempest-securitygroup -1216610242 ", "description": "tempest-description-316034331"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:14.549247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-453058ba-89da-444b-b1f9-b7243ed87c7a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d/action" status: 202 len: 0 microversion: 2.1 time: 0.316904 Sep 23 03:49:14.549943 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1183/2445] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:49:14 2022] POST /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:14.560331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52116481-4190-4f28-be7e-d9dc009753b4 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8bb23280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:15.003585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ff9405cb-f534-44be-834a-14e96f77adee tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.518559 Sep 23 03:49:15.005127 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1263/2446] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:14 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:15.009871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:15.010879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:15.021724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:15.022518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:15.023203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:15.024141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:15.024865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:15.025547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:15.329936 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52116481-4190-4f28-be7e-d9dc009753b4 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3a8843b6-99c6-4029-8745-df64ca886fee" status: 202 len: 0 microversion: 2.1 time: 0.772361 Sep 23 03:49:15.331394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1184/2447] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:14 2022] DELETE /compute/v2.1/os-security-groups/3a8843b6-99c6-4029-8745-df64ca886fee => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:15.341275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f640fd21-ff47-4350-a011-b5f517b33862 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b169ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:15.373387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:15.390021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90932313-8aea-4710-8b82-12472004a409 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.383628 Sep 23 03:49:15.391830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1264/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:15 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:15.421533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:15.423568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:15.449188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:15.452057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:15.452735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:15.453724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:15.475695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:15.479685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:15.526502 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f640fd21-ff47-4350-a011-b5f517b33862 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.193232 Sep 23 03:49:15.527124 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1185/2449] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:49:15 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:15.532092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82d5aba5-dd71-4d81-85a6-06cff2864619 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c934a9e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:15.654787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-82d5aba5-dd71-4d81-85a6-06cff2864619 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8" status: 200 len: 223 microversion: 2.1 time: 0.126420 Sep 23 03:49:15.655378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1186/2450] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:49:15 2022] GET /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 => generated 223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:15.665728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e131c1cc-ce3a-42a8-bf3c-4b4d23b43248", "name": "network-vif-plugged", "status": "completed", "tag": "18b994cc-df23-4e6d-bcb2-b253d56b680a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:15.682569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:15.683053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:15.683489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:15.710809 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] Creating event network-vif-plugged:18b994cc-df23-4e6d-bcb2-b253d56b680a for instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 on n-h2-858495-2 Sep 23 03:49:15.723838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c5651352-1e4a-4a40-8ad6-1bfc3c3de82c req-27f76335-93b9-441a-8ec1-9c2b95f60019 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067195 Sep 23 03:49:15.724742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1187/2451] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:15.730211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d81ac1c-d73f-4e9a-8992-39c886ff1582 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b530820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:16.211621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:16.227069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ee2cc91-3a75-408b-9f90-833ef27c5318 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 200 len: 1478 microversion: 2.1 time: 0.833956 Sep 23 03:49:16.227681 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1265/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:15 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 1478 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:16.232635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5bb5aef8-f329-463e-a56a-47590b375405 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b735310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:16.329687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5bb5aef8-f329-463e-a56a-47590b375405 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda" status: 200 len: 784 microversion: 2.1 time: 0.100610 Sep 23 03:49:16.332598 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1266/2453] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:16 2022] GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:16.344576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34adf275-57e0-4992-a121-2092987fb222 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b1b2160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:16.764270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d81ac1c-d73f-4e9a-8992-39c886ff1582 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/bc2943f4-e703-4413-9080-764d31df55ca" status: 202 len: 0 microversion: 2.1 time: 1.037981 Sep 23 03:49:16.764885 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1188/2454] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:15 2022] DELETE /compute/v2.1/os-security-groups/bc2943f4-e703-4413-9080-764d31df55ca => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:16.773710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-463642402"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:16.781728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:16.806338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:16.806338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:16.806338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:16.824045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:16.827125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:16.832508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:17.096432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:17.207676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7a9b659-1692-4a4f-94cf-9473751abd69 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d/action" status: 202 len: 0 microversion: 2.1 time: 0.440675 Sep 23 03:49:17.214657 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1189/2455] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:49:16 2022] POST /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:49:17.220798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c524eec5-e89f-49a1-bd8a-92586b8a6ff2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b1e0f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:17.258409 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-34adf275-57e0-4992-a121-2092987fb222 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8" status: 202 len: 0 microversion: 2.1 time: 0.923934 Sep 23 03:49:17.259400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1267/2456] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:16 2022] DELETE /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:17.266856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:17.267729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:17.306656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:17.307104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:17.308122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:17.309231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:17.309676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:17.310112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:17.327655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c524eec5-e89f-49a1-bd8a-92586b8a6ff2 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.110020 Sep 23 03:49:17.327655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1190/2457] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:49:17 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:17.336791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-743ceef1-64b6-49cb-af3b-b4395bccb655 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b530af0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:18.105940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:18.124918 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4d8018d-087f-47a1-8bb3-6c457052d583 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1315 microversion: 2.1 time: 0.859224 Sep 23 03:49:18.126556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1268/2458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:17 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:18.139153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-295c7599-1f13-4108-98d9-3649453dfe1e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b71c670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:18.241320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-295c7599-1f13-4108-98d9-3649453dfe1e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.113474 Sep 23 03:49:18.254701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1269/2459] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:18 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:18.259411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8bc5d5e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:18.403240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-743ceef1-64b6-49cb-af3b-b4395bccb655 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/451fac9b-ae57-418a-8bfc-0d48ac558511" status: 202 len: 0 microversion: 2.1 time: 1.069287 Sep 23 03:49:18.410866 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1191/2460] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:17 2022] DELETE /compute/v2.1/os-security-groups/451fac9b-ae57-418a-8bfc-0d48ac558511 => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:18.420319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f439a7f0-1969-4e1f-b758-77c16e4e1c2d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b79d550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:18.442373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:18.444631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:49:18.445466 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.445466 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 HTTP/1.1 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3be74278-6851-4fa4-afa1-4be4c3ddb7a8'} Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:18.451092 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] Sep 23 03:49:18.455118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:18.470715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:49:18.470715 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a933fd40-5d41-4350-b17e-b6f223af0e27'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:18.471653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9a7cb4c2-0672-4277-9194-8bc2399a6897 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8" status: 404 len: 194 microversion: 2.1 time: 0.223162 Sep 23 03:49:18.472244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1270/2461] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:49:18 2022] GET /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 => generated 194 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:18.494365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b89ab095-9ee5-4340-92af-9b67e5b409e9 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b293e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:19.371513 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b89ab095-9ee5-4340-92af-9b67e5b409e9 tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4ed96b42-508e-48c4-b3fe-f801decaa2e5" status: 202 len: 0 microversion: 2.1 time: 0.892046 Sep 23 03:49:19.375285 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1271/2462] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:18 2022] DELETE /compute/v2.1/os-security-groups/4ed96b42-508e-48c4-b3fe-f801decaa2e5 => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:19.380807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed73f840-9d2d-450d-90c8-453d4f807ad7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8b202310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1427653679", "description": "tempest-description-748677867"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:19.427536 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f439a7f0-1969-4e1f-b758-77c16e4e1c2d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73" status: 204 len: 0 microversion: 2.1 time: 1.014639 Sep 23 03:49:19.428837 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1192/2463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:18 2022] DELETE /compute/v2.1/images/6f96894f-2af7-43f2-8974-4e12dc5d4a73 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:19.700706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0375e66-6146-4764-b515-fdb050c8e2f6 tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] Calling method '.version_select at 0x7f0c8b79ddc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:19.738539 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0375e66-6146-4764-b515-fdb050c8e2f6 tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.305199 Sep 23 03:49:19.741142 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1193/2464] 10.222.0.25 () {60 vars in 1226 bytes} [Fri Sep 23 03:49:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:19.752460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:19.757312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:19.777142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:19.777760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:19.782582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:19.783463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:19.783965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:19.784423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:19.992814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed73f840-9d2d-450d-90c8-453d4f807ad7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.616355 Sep 23 03:49:19.993850 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1272/2465] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:19.998683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e0a9201-b7a4-45df-8a34-7b66645a43b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b30f160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:20.055847 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e0a9201-b7a4-45df-8a34-7b66645a43b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.060863 Sep 23 03:49:20.056945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1273/2466] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:19 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:20.062057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01d503cb-c878-4944-b1ca-36075a5e855c tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] Calling method '.version_select at 0x7f0c8b370dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:20.109663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:20.124501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c2fae67a-0af4-4bbc-9379-278f0c63bcb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1503 microversion: 2.1 time: 0.379989 Sep 23 03:49:20.126385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1194/2467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:19 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:20.143863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-902b9ebe-7220-427c-a1e2-d088b9edaf9d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b2c81f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:20.771452 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01d503cb-c878-4944-b1ca-36075a5e855c tempest-SecurityGroupRulesNegativeTestJSON-209380256 tempest-SecurityGroupRulesNegativeTestJSON-209380256-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/28d1ab1b-bb80-4f61-9550-01c5fff92d62" status: 202 len: 0 microversion: 2.1 time: 0.713171 Sep 23 03:49:20.772047 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1274/2468] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:20 2022] DELETE /compute/v2.1/os-security-groups/28d1ab1b-bb80-4f61-9550-01c5fff92d62 => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:20.779699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e327a477-8455-417a-8dc6-a4c78391c267 tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b2638b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:20.990607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e327a477-8455-417a-8dc6-a4c78391c267 tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.217242 Sep 23 03:49:21.003303 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1275/2469] 10.222.0.25 () {62 vars in 1247 bytes} [Fri Sep 23 03:49:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:21.009331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb56de80-31ee-4346-a21d-5b1e11906427 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8b3708b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1284256048", "description": "tempest-description-1134529888"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:21.074604 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-902b9ebe-7220-427c-a1e2-d088b9edaf9d tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0" status: 204 len: 0 microversion: 2.1 time: 0.946831 Sep 23 03:49:21.075290 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1195/2470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:20 2022] DELETE /compute/v2.1/images/69a39a3b-e3e0-4da8-83f7-b74426c5a1a0 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:21.091149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:21.091802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:21.103603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:21.104162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:21.104615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:21.105385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:21.105850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:21.106279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:21.179684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:49:21.382326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ed7acb46-32c0-4045-91a5-93b615292d74 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 204 len: 0 microversion: 2.1 time: 0.305382 Sep 23 03:49:21.386790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1196/2471] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:49:21 2022] DELETE /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:21.398226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5421961-69e9-48c1-b22a-6c64e22c15bb tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] Calling method '.version_select at 0x7f0c8b15e700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:21.433878 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5421961-69e9-48c1-b22a-6c64e22c15bb tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.045341 Sep 23 03:49:21.436511 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1197/2472] 10.222.0.25 () {60 vars in 1226 bytes} [Fri Sep 23 03:49:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:21.447970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d74bf31-e240-4820-93ba-b9263ec641f5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b300b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:21.588999 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d74bf31-e240-4820-93ba-b9263ec641f5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.150892 Sep 23 03:49:21.589616 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1198/2473] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:21 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:21.601045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0666665a-31a5-4a8b-b0a6-f917ba10f042 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b530ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:21.826849 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb56de80-31ee-4346-a21d-5b1e11906427 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.822085 Sep 23 03:49:21.837058 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1276/2474] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:21.842223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:21.843175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:21.861978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:21.864544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:21.865267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:21.866242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:21.869433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:21.870279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:22.420670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:22.462243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99106d90-4ac7-475e-863c-311d116c2427 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1509 microversion: 2.1 time: 0.621162 Sep 23 03:49:22.466216 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1277/2475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:21 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:22.483268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c428ac0-a372-4621-a30a-86c3b7e8d30a tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b3705e0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:22.610622 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0666665a-31a5-4a8b-b0a6-f917ba10f042 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974" status: 204 len: 0 microversion: 2.1 time: 1.017276 Sep 23 03:49:22.611389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1199/2476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:21 2022] DELETE /compute/v2.1/images/4ffb6903-707e-467d-bde6-40c02a279974 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:22.613100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0666665a-31a5-4a8b-b0a6-f917ba10f042 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:22.614427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0666665a-31a5-4a8b-b0a6-f917ba10f042 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001872 Sep 23 03:49:22.615039 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1200/2477] 10.222.0.25 () {56 vars in 886 bytes} [Fri Sep 23 03:49:22 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 03:49:22.653142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84e84582-5c95-4db3-9c67-53fe131639a9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8b1fe820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-171206699", "description": "tempest-description-142353494"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:22.659143 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c428ac0-a372-4621-a30a-86c3b7e8d30a tempest-QuotaClassesAdmin257Test-597890817 tempest-QuotaClassesAdmin257Test-597890817-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.191772 Sep 23 03:49:22.673295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1278/2478] 10.222.0.25 () {62 vars in 1247 bytes} [Fri Sep 23 03:49:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:22.673295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55e4e125-a211-49dc-95f5-2e43ed4f1244 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b19daf0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:22.772219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55e4e125-a211-49dc-95f5-2e43ed4f1244 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.105406 Sep 23 03:49:22.776523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1279/2479] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:22 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:22.787279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:22.787734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:22.819664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:22.833214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:22.833875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:22.834951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:22.835540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:22.836048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:22.966479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:49:23.289529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e74a4b1-2b3f-4189-97fc-0303e195e90f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 204 len: 0 microversion: 2.1 time: 0.510682 Sep 23 03:49:23.291937 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1280/2480] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:49:22 2022] DELETE /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:23.310738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:23.328584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:23.347028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:23.348495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:23.350297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:23.351205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:23.354104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:23.354731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:25.121101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84e84582-5c95-4db3-9c67-53fe131639a9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.504727 Sep 23 03:49:25.121752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1201/2481] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:25.126826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:25.127961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:25.160315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:25.163999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:25.164511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:25.164959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:25.172192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:25.172618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:25.173076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:26.949517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:26.966768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48c9c6b5-b0fa-4e56-8354-6a2475d9b1dc tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1509 microversion: 2.1 time: 1.843895 Sep 23 03:49:26.967960 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1202/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:25 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1509 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:26.978994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb945cf0-6881-4aa8-8a2b-f404720d0f31 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1fe160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:27.023792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:27.033449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33579192-10a7-4960-a9ba-1d4787270dc8 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1474 microversion: 2.1 time: 3.736961 Sep 23 03:49:27.045732 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1281/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:23 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1474 bytes in 3750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:27.057835 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb945cf0-6881-4aa8-8a2b-f404720d0f31 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.088602 Sep 23 03:49:27.058847 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1203/2484] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:26 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:27.058975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc41f01d-5792-42a0-a520-014873a3171d", "name": "network-vif-plugged", "status": "completed", "tag": "45498f70-2486-46a9-8191-3e776d1543fa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:27.076760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84aaab04-02e2-472a-86fd-4afef3a68945 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b0d75e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:27.087680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:27.088176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:27.088613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:27.123123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] Creating event network-vif-plugged:45498f70-2486-46a9-8191-3e776d1543fa for instance bc41f01d-5792-42a0-a520-014873a3171d on n-h1-858495-2 Sep 23 03:49:27.141590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ccf96ef5-5476-4d65-bf90-5905fde0f102 req-a14353b4-ee10-47b5-b46e-db92512e9654 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094449 Sep 23 03:49:27.145940 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1282/2485] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:27.992602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:27.993751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:28.013972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:28.019623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:28.020389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:28.024602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:28.032339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:28.033164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:28.391349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d54e8f01845e2b6155b42d9fd2c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b9b5b7d8f743009c1ff26acaeb46a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:28.459141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d2846c0-f6af-4cb1-a4bf-bd0831f26512 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 200 len: 1467 microversion: 2.1 time: 0.471158 Sep 23 03:49:28.490159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1283/2486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:27 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:28.506577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:28.508029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:28.531789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:28.538814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:28.540753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:28.542918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:28.543633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:28.545632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:29.463000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84aaab04-02e2-472a-86fd-4afef3a68945 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 2.402639 Sep 23 03:49:29.463741 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1204/2487] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:49:27 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:29.488763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94089bf0-6913-48d4-aeac-9a5a5a2abf52 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b15e670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:29.640186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94089bf0-6913-48d4-aeac-9a5a5a2abf52 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.175195 Sep 23 03:49:29.641375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1205/2488] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:29 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:29.652276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e131c1cc-ce3a-42a8-bf3c-4b4d23b43248", "name": "network-vif-deleted", "tag": "18b994cc-df23-4e6d-bcb2-b253d56b680a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:29.694855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:29.695365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:29.695810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:29.725121 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] Creating event network-vif-deleted:18b994cc-df23-4e6d-bcb2-b253d56b680a for instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 on n-h2-858495-2 Sep 23 03:49:29.746147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7bb8d000-7d71-4b68-9738-512192a1eb01 req-48ec1cf9-be68-4fe0-9918-5eb440949185 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102691 Sep 23 03:49:29.747139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1206/2489] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:29.754469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e131c1cc-ce3a-42a8-bf3c-4b4d23b43248", "name": "network-vif-unplugged", "status": "completed", "tag": "18b994cc-df23-4e6d-bcb2-b253d56b680a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:29.767219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:29.767951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:29.768459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:29.793264 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] Creating event network-vif-unplugged:18b994cc-df23-4e6d-bcb2-b253d56b680a for instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 on n-h2-858495-2 Sep 23 03:49:29.803195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-36ce36ea-4e8e-419d-bff8-34c130bca087 req-42eeb928-ba94-43a0-b9f0-bcda5b840173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053132 Sep 23 03:49:29.807028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1207/2490] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:29.814621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dba04971-8ee7-4baf-9595-a330fb6eaa20 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b15e310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:29.986872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:29.997958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa370368-a393-4a5c-b994-b517065f98b0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 200 len: 1474 microversion: 2.1 time: 1.506129 Sep 23 03:49:30.000030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1284/2491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:28 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 1474 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:30.005910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:30.014404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:30.024203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.024973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.025757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.026678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.027297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.028078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.049104 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 HTTP/1.1 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e131c1cc-ce3a-42a8-bf3c-4b4d23b43248'} Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.050888 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.055741 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.060513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.083140 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfecdc6d-57eb-4971-bcaf-0ecb4ff13261 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 404 len: 111 microversion: 2.1 time: 0.081240 Sep 23 03:49:30.103358 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1285/2492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:30 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.123387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-988685023", "metadata": {"image_type": "test"}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:30.126920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:30.138455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.144739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.145233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.165573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.168342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.168835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.214721 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248/action HTTP/1.1 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 111 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-988685023", "metadata": {"image_type": "test"}}} Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e131c1cc-ce3a-42a8-bf3c-4b4d23b43248', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-988685023', 'metadata': {'image_type': 'test'}}}} Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 03:49:30.216745 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.220967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.223584 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d33af2c-cda3-4101-9a5c-bead7f0ee1f8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "POST /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248/action" status: 404 len: 111 microversion: 2.1 time: 0.114330 Sep 23 03:49:30.223584 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1286/2493] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Sep 23 03:49:30 2022] POST /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.236522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1584624445", "metadata": {"image_type": "test"}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:30.240446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Failed to fetch instance by id tempest-invalid-1742624392 {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:49:30.241180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance tempest-invalid-1742624392 could not be found. Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/tempest-invalid-1742624392/action HTTP/1.1 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 112 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1584624445", "metadata": {"image_type": "test"}}} Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance tempest-invalid-1742624392 could not be found. Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'tempest-invalid-1742624392', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1584624445', 'metadata': {'image_type': 'test'}}}} Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1742624392 could not be found. Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.251928 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1742624392 could not be found. Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1742624392 could not be found. Sep 23 03:49:30.256293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.259030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance tempest-invalid-1742624392 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.260334 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbc4cac2-5467-4323-9714-21e8c1634fb1 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-1742624392/action" status: 404 len: 101 microversion: 2.1 time: 0.030265 Sep 23 03:49:30.265828 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1287/2494] 10.222.0.25 () {60 vars in 1249 bytes} [Fri Sep 23 03:49:30 2022] POST /compute/v2.1/servers/tempest-invalid-1742624392/action => generated 101 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.279713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2134356397"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:30.286835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:49:30.287471 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 57 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-test-snap-2134356397"}} Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2134356397'}}} Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.291309 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.295312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.300078 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a4759d5-93d6-46f5-9c64-d143380b805d tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019973 Sep 23 03:49:30.305101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1288/2495] 10.222.0.25 () {60 vars in 1275 bytes} [Fri Sep 23 03:49:30 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.328328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1076863181"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:30.332223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:49:30.332747 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 57 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-test-snap-1076863181"}} Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1076863181'}}} Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.335369 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4aebe538-a5c3-4ed8-8f8c-e50fa84f5149 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.025957 Sep 23 03:49:30.342584 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1289/2496] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Sep 23 03:49:30 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.355809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:30.355809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:30.362273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.362813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.363256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.363979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.364449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.364867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.385798 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 HTTP/1.1 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e131c1cc-ce3a-42a8-bf3c-4b4d23b43248'} Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.387732 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.393290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fb0f994-cf0c-4221-96d8-1103f89260c4 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 404 len: 111 microversion: 2.1 time: 0.042848 Sep 23 03:49:30.395470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1290/2497] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:49:30 2022] DELETE /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.400087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:30.401244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] [instance: e131c1cc-ce3a-42a8-bf3c-4b4d23b43248] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:30.414298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.415626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.416247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.422497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:30.423786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:30.424409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:30.463074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] HTTP exception thrown: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Request method failure captured: Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 HTTP/1.1 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSygo4NChsD-fDSUVYqXO6fLmgImb4k_2Xa8cgTCEPY8aaLL-98VR2O848KWMGG2ptzhpfVwgz0WP5h44RD1A_dXQZ50LGikpPWNnD-0hInLfC-45N-1tvzIr1sbRiVvZeW2id5nnYVePoLlwfWUxXxU8iaFQtEGPPLzRrML4pkiRF0 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3b9b5b7d8f743009c1ff26acaeb46a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c3b9b5b7d8f743009c1ff26acaeb46a1 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1762115503 Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8d0d54e8f01845e2b6155b42d9fd2c5d Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesNegativeTestJSON-1762115503-project Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e131c1cc-ce3a-42a8-bf3c-4b4d23b43248'} Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:30.468079 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. Sep 23 03:49:30.472307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:30.475468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] Returning 404 to user: Instance e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:30.482214 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38d2091d-0f26-4cfe-a948-9e4ecde9a9b8 tempest-ImagesNegativeTestJSON-1762115503 tempest-ImagesNegativeTestJSON-1762115503-project] 10.222.0.25 "GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248" status: 404 len: 111 microversion: 2.1 time: 0.087191 Sep 23 03:49:30.491157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1291/2498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:30 2022] GET /compute/v2.1/servers/e131c1cc-ce3a-42a8-bf3c-4b4d23b43248 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:30.657255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-daba1c7d-f089-4cf0-bdb3-146b46c0b7f2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b10c5e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:30.740083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-daba1c7d-f089-4cf0-bdb3-146b46c0b7f2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.087903 Sep 23 03:49:30.745054 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1292/2499] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:30 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:49:31.153409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b0ff9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:31.326790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.328155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.330360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.333647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.334564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.337843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.381738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:31.424032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:31.542151 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b022275e-9f78-4b6c-ac3b-58193cbb4cf0 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19" status: 200 len: 240 microversion: 2.36 time: 0.785469 Sep 23 03:49:31.548222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1293/2500] 10.222.0.25 () {62 vars in 1303 bytes} [Fri Sep 23 03:49:30 2022] PUT /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19 => generated 240 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:31.570851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dba04971-8ee7-4baf-9595-a330fb6eaa20 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa" status: 202 len: 0 microversion: 2.1 time: 1.761324 Sep 23 03:49:31.573287 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1208/2501] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:29 2022] DELETE /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa => generated 0 bytes in 1765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:31.574136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.574785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:31.580605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Calling method '.version_select at 0x7f0c8b1fe3a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.591737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.593912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.597664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.598482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.598960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.599406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.640282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] HTTP exception thrown: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Request method failure captured: Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 HTTP/1.1 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSv_MVbwpn6-oa5M3N1mqKDBjAp3iGQGdjHB-Ho4r_8OEHMuL8KZxvpLOYHrzBJStsMUdw81U1iorzfa16Zau4-RqDVX_nLhH3qnaHB9iD5Vf5Nu2OO_S9Z4cHtAWVvO2mNvE4XjJtmpRJgnWFuKGhxcPXFuSvjVMG8oaG7fR5Ctx1E Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9269b2c0a2fc44c78435abd417ec74e4 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9269b2c0a2fc44c78435abd417ec74e4 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListImageFiltersTestJSON-1471682917-project Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0208ba9f3caa4e7aa45fd433061d2ce5 Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListImageFiltersTestJSON-1471682917-project Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2'} Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:31.650945 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. Sep 23 03:49:31.654581 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.662314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Returning 404 to user: Instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:31.663664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9a167306-07d6-45c8-9116-702c1704b1a0 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2" status: 404 len: 111 microversion: 2.1 time: 0.114067 Sep 23 03:49:31.665846 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1294/2502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:31 2022] GET /compute/v2.1/servers/b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:31.687028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b5da430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.719540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.719952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.720587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.721366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.722487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.722944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.746140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:31.746702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:49:31.747375 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.747375 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa HTTP/1.1 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa'} Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:31.749658 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:49:31.755727 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-638a1bc8-6b58-4c83-89c9-898074580b42'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:31.763109 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fb30933-e654-4976-bb2f-7e5d33ee671d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa" status: 404 len: 194 microversion: 2.1 time: 0.087289 Sep 23 03:49:31.763857 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1295/2503] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:49:31 2022] GET /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:31.767115 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-86615751-d2c2-4b45-954b-5a3cbbc42122 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19/detail" status: 200 len: 672 microversion: 2.36 time: 0.191846 Sep 23 03:49:31.768176 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1209/2504] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Sep 23 03:49:31 2022] GET /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19/detail => generated 672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:31.780066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d6796e5-3eec-45da-b8b9-3a47708831c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1edee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.802645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.803648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:31.824753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=15,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:31.863905 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0d6796e5-3eec-45da-b8b9-3a47708831c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.092511 Sep 23 03:49:31.864834 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1210/2505] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:31 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:31.867351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.867862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.868306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.869022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:31.872981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fd7f6e1-09b2-4a37-82f6-5144d221335f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8baed820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:31.878699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:31.879222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:31.939115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:49:32.205545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f99e6288-8be6-4cbb-a4e2-397ad8d2904f tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 204 len: 0 microversion: 2.1 time: 0.440079 Sep 23 03:49:32.209816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1296/2506] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:49:31 2022] DELETE /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:32.217222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2", "name": "network-vif-deleted", "tag": "9f0a6a9c-6365-4ab4-9b28-20d1213adb91"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:32.247844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.248327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.252360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.304288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] Creating event network-vif-deleted:9f0a6a9c-6365-4ab4-9b28-20d1213adb91 for instance b2b5ffa0-b3fc-4fe6-86e0-801aa0ac87e2 on n-h2-858495-2 Sep 23 03:49:32.323614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fca2e3f5-dd4a-460d-8b02-d2fc3908b422 req-ba9dc933-69a9-4a2b-9469-2f9088d0e4fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112240 Sep 23 03:49:32.324243 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1297/2507] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:32.358231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Action: 'update', calling method: .version_select at 0x7f0c8b1b2550>, body: {"quota_set": {"ram": "2048"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:32.519830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.520316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.528568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.532706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.533221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.533788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.652457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.653239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.653863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.656012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.656677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.657268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.754494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cfeb2e7-2772-46b3-a7ad-7539d90cf389 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19?user_id=3a60be175e334f8ab537c8fdc556ff61" status: 200 len: 240 microversion: 2.36 time: 0.419921 Sep 23 03:49:32.764304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1298/2508] 10.222.0.25 () {62 vars in 1384 bytes} [Fri Sep 23 03:49:32 2022] PUT /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19?user_id=3a60be175e334f8ab537c8fdc556ff61 => generated 240 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:32.770402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:32.771511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:32.809386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.809914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.810434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:32.811179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:32.811654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:32.812781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:33.249455 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fd7f6e1-09b2-4a37-82f6-5144d221335f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43" status: 202 len: 0 microversion: 2.1 time: 1.383505 Sep 23 03:49:33.251050 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1211/2509] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:31 2022] DELETE /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43 => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:33.407935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-413181578", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "3ea4d905-b317-4884-a6c5-67a68779a621"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:33.479533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:33.492337 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a1d57f6-d71a-4b16-816f-a0bf3f58fe9e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1473 microversion: 2.1 time: 0.725926 Sep 23 03:49:33.502296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1299/2510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:32 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1473 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:33.512835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d74fb5aa-0bc0-4782-ada9-bd30ea363747 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] Calling method '.version_select at 0x7f0c8b263160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:33.526220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] validate_networks() for [('3ea4d905-b317-4884-a6c5-67a68779a621', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:33.694034 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d74fb5aa-0bc0-4782-ada9-bd30ea363747 tempest-QuotasAdminTestV236-2113986329 tempest-QuotasAdminTestV236-2113986329-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19?user_id=3a60be175e334f8ab537c8fdc556ff61" status: 200 len: 282 microversion: 2.36 time: 0.188294 Sep 23 03:49:33.694762 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1300/2511] 10.222.0.25 () {60 vars in 1364 bytes} [Fri Sep 23 03:49:33 2022] GET /compute/v2.1/os-quota-sets/542a7c24625049d6a382531b4b904b19?user_id=3a60be175e334f8ab537c8fdc556ff61 => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:49:33.700557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8d4e610-258a-48b3-889f-9701a2eb3806 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b64f0d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:33.781118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8d4e610-258a-48b3-889f-9701a2eb3806 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.084931 Sep 23 03:49:33.782246 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1301/2512] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:33 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:33.797197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b889f70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:33.979373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:33.980411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 89e2dc85-800f-4bc3-833f-96b176978d43 not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:49:33.981066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.981066 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43 HTTP/1.1 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '89e2dc85-800f-4bc3-833f-96b176978d43'} Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:33.987944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] Sep 23 03:49:33.992333 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:33.996112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:49:33.996112 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-a5733745-c7a6-418a-942c-abeb8b9a4787'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:33.996112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7677f6cb-e933-43ea-831d-10b5b07ecd88 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43" status: 404 len: 194 microversion: 2.1 time: 0.212723 Sep 23 03:49:33.997509 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1302/2513] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:49:33 2022] GET /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43 => generated 194 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:34.013455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e76fd90-9587-45fc-a2d6-4222e3eb1547 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b889820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:36.056680 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e76fd90-9587-45fc-a2d6-4222e3eb1547 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7" status: 202 len: 0 microversion: 2.1 time: 2.055217 Sep 23 03:49:36.058539 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1303/2514] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:49:34 2022] DELETE /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7 => generated 0 bytes in 2057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:49:36.064803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:36.066428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:36.091104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:36.093735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:36.098675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:36.104999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:36.108147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:36.108903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:36.836696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:36.836696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:36.836696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:36.836696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:36.836696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:36.862195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:36.862956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:36.864428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:36.866815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:36.870399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:36.871102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:36.965227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Getting quotas for project e12009e256ce4f95b47efc3b5953990d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:36.975503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Getting quotas for user 62715c49f3f14a23b3c3d2dbd3fa2ee0 and project e12009e256ce4f95b47efc3b5953990d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:37.036378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:37.044234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:37.193524 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-358d9367-d758-4888-af15-18104d191249 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.940851 Sep 23 03:49:37.197896 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1212/2515] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:37.203057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c43e6a28-a331-47c9-af3a-cf5a0aae4a5c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c9341db80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:37.337313 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c43e6a28-a331-47c9-af3a-cf5a0aae4a5c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.138032 Sep 23 03:49:37.338324 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1213/2516] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:37 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:37.342943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b15ea60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:37.715449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:37.729169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-062e3d37-1ea1-4083-b11c-3ae5d2eee446 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1473 microversion: 2.1 time: 1.669256 Sep 23 03:49:37.729801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1304/2517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:36 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1473 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:37.748481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-517ddcd1-08da-4807-982e-be6b3d483837 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:37.749313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-517ddcd1-08da-4807-982e-be6b3d483837 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:37.912486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:49:37.917084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 4dbe8688-9144-463e-b578-4625c23923a7 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:49:37.922172 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.922172 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7 HTTP/1.1 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4dbe8688-9144-463e-b578-4625c23923a7'} Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:49:37.925877 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] Sep 23 03:49:37.929919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:49:37.933942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:49:37.933942 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-725f1f64-3e8e-454f-9ac9-e579dc250b82'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:37.935735 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fabfb8a-69f2-4cd7-879b-c7b0aaab5526 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7" status: 404 len: 194 microversion: 2.1 time: 0.596397 Sep 23 03:49:37.937011 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1214/2518] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:49:37 2022] GET /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7 => generated 194 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:37.955548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-553c9410-507b-40eb-90f2-8c6240f2919a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b3ec790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:38.268638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-517ddcd1-08da-4807-982e-be6b3d483837 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:38.302908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-517ddcd1-08da-4807-982e-be6b3d483837 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1216 microversion: 2.1 time: 0.559353 Sep 23 03:49:38.304935 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1305/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:37 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1216 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:38.358584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f676e56-2bbf-419d-9768-a4269c23179b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8bcd20d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:38.526052 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f676e56-2bbf-419d-9768-a4269c23179b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.175688 Sep 23 03:49:38.541987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1306/2520] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:38 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:38.757279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:38.758151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:38.769302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:38.770816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:38.773953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:38.774990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:38.776121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:38.786308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:39.180972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:39.197770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6257d54-5c79-4744-b3cc-936f79cf305e tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1431 microversion: 2.1 time: 0.438344 Sep 23 03:49:39.198471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1307/2521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:38 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1431 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:49:39.328672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:39.329550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:39.346224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:39.348081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:39.348556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:39.354970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:39.356258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:39.359629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:39.713861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:39.735904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56838ccd-166b-4b2a-8fd9-1c8000ee31ca tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1268 microversion: 2.1 time: 0.410910 Sep 23 03:49:39.739213 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1308/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:39 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1268 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:39.746839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7beb0e-2c3a-44a5-ba27-17debaba88ce", "name": "network-vif-deleted", "tag": "6c35cd91-24fc-4b47-b87d-f9fcd590c8a6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:39.757222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:39.758260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:39.759378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:39.800309 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] Creating event network-vif-deleted:6c35cd91-24fc-4b47-b87d-f9fcd590c8a6 for instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce on n-h2-858495-2 Sep 23 03:49:39.809518 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-153d5d4f-a2a0-4dca-a6de-69c4ccce2d07 req-d77cca50-ac29-434d-bd9b-f8e7b026be8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068662 Sep 23 03:49:39.821070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1309/2523] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:39.827202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-18125745-32f8-49b3-ada7-bda621094323 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1c9a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:39.918600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-18125745-32f8-49b3-ada7-bda621094323 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.095733 Sep 23 03:49:39.924442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1310/2524] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:39 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:40.224602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:40.225589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:40.254697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:40.255312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:40.255766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:40.256515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:40.257159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:40.257888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:40.325038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:40.325038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:40.325038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:40.325038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lazy-loading 'fault' on Instance uuid 3e7beb0e-2c3a-44a5-ba27-17debaba88ce {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:49:40.576493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-553c9410-507b-40eb-90f2-8c6240f2919a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 2.629899 Sep 23 03:49:40.576493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1215/2525] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:49:37 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:40.589733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0208ba9f3caa4e7aa45fd433061d2ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9269b2c0a2fc44c78435abd417ec74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:40.591503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-585b5c78-12c2-4b3b-9b0d-f788746f0ee3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8a807e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2014095176", "description": "tempest-description-653183777"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:40.609746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6de2a99-68a0-4b47-a271-4790e0fb7203 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 200 len: 1308 microversion: 2.1 time: 0.391137 Sep 23 03:49:40.618380 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1311/2526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:40 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:40.767204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:40.770118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:40.783674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:40.785343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:40.786143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:40.787288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:40.788065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:40.790960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:41.051281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:41.084635 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46877dbe-21d2-4c01-be2a-07e4187d9aa8 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1274 microversion: 2.1 time: 0.321457 Sep 23 03:49:41.097378 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1312/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:40 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:49:41.097378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d30bc936-5267-4a62-89e1-25c3281e778c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b723040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:41.201970 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d30bc936-5267-4a62-89e1-25c3281e778c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.114341 Sep 23 03:49:41.206820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1313/2528] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:41 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:41.643453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:41.644760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] [instance: 3e7beb0e-2c3a-44a5-ba27-17debaba88ce] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:41.647849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-585b5c78-12c2-4b3b-9b0d-f788746f0ee3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.060652 Sep 23 03:49:41.649140 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1216/2529] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:41.664986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1e997f6-6e2b-4168-a06c-780e3a22b855 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8a9d2700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-337042224", "description": "tempest-description-2000781164"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:41.695733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:41.702825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:41.705226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:41.707304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:41.707799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:41.708246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:41.772413 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] HTTP exception thrown: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Request method failure captured: Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce HTTP/1.1 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSv_MVbwpn6-oa5M3N1mqKDBjAp3iGQGdjHB-Ho4r_8OEHMuL8KZxvpLOYHrzBJStsMUdw81U1iorzfa16Zau4-RqDVX_nLhH3qnaHB9iD5Vf5Nu2OO_S9Z4cHtAWVvO2mNvE4XjJtmpRJgnWFuKGhxcPXFuSvjVMG8oaG7fR5Ctx1E Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9269b2c0a2fc44c78435abd417ec74e4 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9269b2c0a2fc44c78435abd417ec74e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9269b2c0a2fc44c78435abd417ec74e4 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1471682917 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListImageFiltersTestJSON-1471682917-project Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0208ba9f3caa4e7aa45fd433061d2ce5 Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListImageFiltersTestJSON-1471682917-project Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3e7beb0e-2c3a-44a5-ba27-17debaba88ce'} Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:49:41.775240 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Returning 404 to user: Instance 3e7beb0e-2c3a-44a5-ba27-17debaba88ce could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06497e5f-2d39-42e8-8b14-aba8ddf64633 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce" status: 404 len: 111 microversion: 2.1 time: 0.144622 Sep 23 03:49:41.781216 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1314/2530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:41 2022] GET /compute/v2.1/servers/3e7beb0e-2c3a-44a5-ba27-17debaba88ce => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:49:41.788783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f76bb0bc-8f46-4c28-8f8f-a44523b5e784 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8b8a1d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:42.425918 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1e997f6-6e2b-4168-a06c-780e3a22b855 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.768194 Sep 23 03:49:42.426961 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1217/2531] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:49:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:42.443438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:42.444995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:42.472596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:42.472719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:42.474067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:42.474802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:42.475256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:42.476052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:42.632572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:42.647403 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e8969f3-00ee-4e4e-a2f2-0e4a10ec6d36 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1274 microversion: 2.1 time: 0.219314 Sep 23 03:49:42.665327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1218/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:42 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:42.678370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=7 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:42.694447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1eb4424-2f1a-492e-8772-f69b7befdf7c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8bb664c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:43.131776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f76bb0bc-8f46-4c28-8f8f-a44523b5e784 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5" status: 204 len: 0 microversion: 2.1 time: 1.349922 Sep 23 03:49:43.134584 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1315/2533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:41 2022] DELETE /compute/v2.1/images/b366e76c-a430-4f74-bee0-e29f3bfc48e5 => generated 0 bytes in 1352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:43.141173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1167463865", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "b41f64bf-9e16-4e37-b7d7-8812d93e0311"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:43.215373 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1eb4424-2f1a-492e-8772-f69b7befdf7c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.545695 Sep 23 03:49:43.217543 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1219/2534] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:42 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:43.242387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ef28d37-6dfc-498d-b530-897d564abf76 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8a9d2dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:44.614946 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ef28d37-6dfc-498d-b530-897d564abf76 tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6" status: 204 len: 0 microversion: 2.1 time: 1.395569 Sep 23 03:49:44.615539 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1220/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:43 2022] DELETE /compute/v2.1/images/3fe7e509-f254-448c-aac3-9225679880e6 => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:44.624748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:44.625781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:44.645406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] validate_networks() for [('b41f64bf-9e16-4e37-b7d7-8812d93e0311', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:44.661104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:44.661648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:44.662499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:44.663249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:44.663720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:44.664229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:45.253154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:45.262382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd090137-55ef-44ab-8796-1a663c4f57c6 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 0.642160 Sep 23 03:49:45.268833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1221/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:44 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:45.289659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f864ccc7-017a-4987-8725-a47754eec248 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8aa92a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:45.355602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f864ccc7-017a-4987-8725-a47754eec248 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.083136 Sep 23 03:49:45.356424 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1222/2537] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:45 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:45.363418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b44d7e1-6d8a-4baa-b1d3-15a8a0108505", "tag": "cea3de45-5f10-4f68-b65a-062b9f29cc20"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:45.391333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:45.395736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:45.397279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:45.417443 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] Creating event network-changed:cea3de45-5f10-4f68-b65a-062b9f29cc20 for instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 on n-h2-858495-2 Sep 23 03:49:45.425045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-aa44bfdf-ac48-4261-ae72-f06744c5522d req-ec75b46d-76aa-4a19-8e73-78af184dc93b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065844 Sep 23 03:49:45.426532 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1223/2538] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:45.433369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41eeb3af-7876-4c25-96c1-fe0804fe1b5b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] Calling method '.version_select at 0x7f0c8aa92dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:46.172729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:46.174799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:46.175425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:46.175958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:46.176444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:46.191121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:46.191605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:46.192192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:46.193514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:46.195046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:46.195718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:46.221671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Getting quotas for project 6ac755d23fcc4ec08edc0a67571fea93. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:46.232671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Getting quotas for user 252ad7dd5d0d4715b21e6777c2b3fa3f and project 6ac755d23fcc4ec08edc0a67571fea93. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:46.261922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:46.266349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:46.354875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbd0e1d2-4ddc-4108-913a-8b2d404b01c4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.218847 Sep 23 03:49:46.356031 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1316/2539] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:46.364805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:46.369534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:46.390081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:46.390664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:46.391673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:46.392677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:46.393767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:46.394210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:46.734552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:46.756843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a6de070-d4f5-48a2-ad3e-dcf62ddcca50 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 0.397835 Sep 23 03:49:46.760045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1317/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:46 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:46.771561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5810cd4b-5bb5-4c77-a304-2438bb5be0e8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:46.774180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5810cd4b-5bb5-4c77-a304-2438bb5be0e8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:46.867000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5810cd4b-5bb5-4c77-a304-2438bb5be0e8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:46.875218 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5810cd4b-5bb5-4c77-a304-2438bb5be0e8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1216 microversion: 2.1 time: 0.113714 Sep 23 03:49:46.875905 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1318/2541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:46 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:46.885831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4350c67-8dea-48de-8245-1533de5943b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b8a1550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:46.929614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:46.999455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:47.010754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41eeb3af-7876-4c25-96c1-fe0804fe1b5b tempest-ListImageFiltersTestJSON-1471682917 tempest-ListImageFiltersTestJSON-1471682917-project] 10.222.0.25 "DELETE /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81" status: 204 len: 0 microversion: 2.1 time: 1.582470 Sep 23 03:49:47.011416 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1224/2542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:45 2022] DELETE /compute/v2.1/images/01cce475-01fa-44a1-935b-69a38330de81 => generated 0 bytes in 1584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:47.080246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d4350c67-8dea-48de-8245-1533de5943b5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1437 microversion: 2.1 time: 0.203036 Sep 23 03:49:47.089530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1319/2543] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:46 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1437 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:47.807490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:47.808764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:47.819459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:47.820584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:47.821683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:47.822933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:47.823649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:47.824308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:47.832227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:47.901425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:47.902609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:47.932716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:47.933224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:47.942338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:47.950252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:47.951007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:47.951638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:48.093415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:48.103618 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-884b5acd-c96e-4ec9-8d69-d2ab43b0afa9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1220 microversion: 2.1 time: 0.207425 Sep 23 03:49:48.104880 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1320/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:47 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:49:48.110017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5531b38e-e08f-41db-ba89-2cc3ddad2fd5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b030940>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:48.186821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5531b38e-e08f-41db-ba89-2cc3ddad2fd5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1446 microversion: 2.1 time: 0.080291 Sep 23 03:49:48.198355 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1321/2545] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:48 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:48.204992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7db3c69b-5a6b-4955-86cb-2665f7fde9ba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b648280>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:48.272908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7db3c69b-5a6b-4955-86cb-2665f7fde9ba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 200 len: 1446 microversion: 2.1 time: 0.073072 Sep 23 03:49:48.274701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1322/2546] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:49:48 2022] GET /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 1446 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:48.295712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa3b9f99-cba3-4efe-901b-f2ab185002ea tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b0ffa60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:48.383589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:48.395131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7df4346-c214-4caa-90d9-b910bf0bbc78 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 0.598207 Sep 23 03:49:48.410445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1225/2547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:47 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:48.936981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1750060473", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:49.085864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:49.575838 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa3b9f99-cba3-4efe-901b-f2ab185002ea tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 204 len: 0 microversion: 2.1 time: 1.290586 Sep 23 03:49:49.579990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1323/2548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:48 2022] DELETE /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:49.595135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:49.597058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:49.615996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:49.616793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:49.618619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:49.623335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:49.623934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:49.624780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:49.914305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:49.928600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39dc6dff-df1c-42f0-afe3-1fc1e78d2d4c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1274 microversion: 2.1 time: 0.350020 Sep 23 03:49:49.931289 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1324/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:49 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:49.946736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:49.950218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:49.962541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:49.964138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:49.968514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:49.969699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:49.970326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:49.973217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:50.101925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:50.102585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:50.103160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:50.103967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:50.104539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:50.119838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:50.120493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:50.121262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:50.123235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:50.123841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:50.124280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:50.159578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Getting quotas for project 1703969e99664a7a9b3fb03d1d275740. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:50.170763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Getting quotas for user ee608439593f49a1a368a26f8beb3eb8 and project 1703969e99664a7a9b3fb03d1d275740. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:50.193134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:50.196326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:50.303898 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-15efa33e-0ed9-4b46-9410-e02b4b9c9fd1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704959 Sep 23 03:49:50.309887 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1226/2550] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:50.327529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:50.329884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:50.346546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:50.347430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:50.348066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:50.349506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:50.350214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:50.351255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:50.489798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:49:50.629141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:50.645702 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bff73229-0c78-4eac-9a68-9c03e0b236e0 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 0.712136 Sep 23 03:49:50.646791 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1325/2551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:49 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:50.726301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5098e9ea-96a3-4d3f-a934-5a46d3f5ddab tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 204 len: 0 microversion: 2.1 time: 0.413780 Sep 23 03:49:50.730542 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1227/2552] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:49:50 2022] DELETE /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:49:50.752447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99c72704-72ca-4c50-96e1-f5263ce2b29b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:50.755024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-99c72704-72ca-4c50-96e1-f5263ce2b29b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:50.909786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-99c72704-72ca-4c50-96e1-f5263ce2b29b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:50.933786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99c72704-72ca-4c50-96e1-f5263ce2b29b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1217 microversion: 2.1 time: 0.199978 Sep 23 03:49:50.934562 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1228/2553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:50 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:50.956949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:50.961031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:50.999276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:51.002434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:51.004168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:51.010381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:51.013544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:51.014782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:51.320234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1948191990", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:51.443035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:51.695452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:51.709496 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-551a2ae5-8d37-46ba-b017-0a4a44335d0a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.757571 Sep 23 03:49:51.710134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1229/2554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:50 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:49:51.722085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-448455525", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1896f5f0-54eb-42f5-b3a9-0accb590ad4a"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:51.832081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] validate_networks() for [('1896f5f0-54eb-42f5-b3a9-0accb590ad4a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:52.375031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:52.377895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:52.378674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:52.380894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:52.381574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:52.423174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:52.426749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:52.427669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:52.428821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:52.435638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:52.436758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:52.437508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:52.527488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:52.558079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for user 505327a949b74cca88abf6bb709da9c6 and project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:52.597722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:52.599382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:52.605326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:52.740637 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dcc370f8-e5ce-4da5-b094-08fe5f42b804 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077091 Sep 23 03:49:52.753722 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1326/2555] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:52.768292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:52.770809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:52.786830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:52.788283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:52.790765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:52.791707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:52.793004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:52.794979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:52.863876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:54.141910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:54.142870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:54.143568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:54.144196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:54.145269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:54.202455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.202982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.205658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.209933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.212144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.214741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.315940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:54.320084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:54.337609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Getting quotas for user 20166e829a544516a4adcdd3e0a4945e and project 8dc16ad5d64040e49238a855b83dd35d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:54.340215 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb991aa9-b5cb-43b5-8778-fb8c994d8082 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 1.585289 Sep 23 03:49:54.341002 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1327/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:52 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:54.346236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:54.347082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:54.363150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.363861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.364464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.365448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.366254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.366861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.384408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:54.391806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:54.541389 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61505184-81a7-4ffb-b761-92f9b2c0cc8a tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.823270 Sep 23 03:49:54.543029 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1230/2557] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:54.555025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc41f01d-5792-42a0-a520-014873a3171d", "name": "network-vif-unplugged", "status": "completed", "tag": "45498f70-2486-46a9-8191-3e776d1543fa"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:54.575184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.575978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.578151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.596801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:54.607432 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] Creating event network-vif-unplugged:45498f70-2486-46a9-8191-3e776d1543fa for instance bc41f01d-5792-42a0-a520-014873a3171d on n-h1-858495-2 Sep 23 03:49:54.621076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ff05812d-64a7-4750-8e73-a10a3f646f0b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1275 microversion: 2.1 time: 0.278486 Sep 23 03:49:54.624914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1328/2558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:54 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:54.626061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7f6fcfa8-63c0-4692-80ba-f987f461ee46 req-21df93fd-4a6a-47a8-a3ae-19515a47d628 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081509 Sep 23 03:49:54.628803 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1231/2559] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:54.641741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-605004923", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:54.646176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:54.646835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:54.667839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.668316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.669192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.672808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:54.673881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:54.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:54.746450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:49:55.632499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:55.644024 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0bbac2a-dd35-41fe-8d71-f9eec303dee5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 1.015011 Sep 23 03:49:55.644576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1329/2560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:54 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:55.652218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc41f01d-5792-42a0-a520-014873a3171d", "name": "network-vif-deleted", "tag": "45498f70-2486-46a9-8191-3e776d1543fa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:55.663098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:55.663863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:55.668524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:55.683241 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] Creating event network-vif-deleted:45498f70-2486-46a9-8191-3e776d1543fa for instance bc41f01d-5792-42a0-a520-014873a3171d on n-h1-858495-2 Sep 23 03:49:55.694411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-922fbfdd-aa57-4ec4-b859-293b7eff78a8 req-fb0368ca-86b6-421d-826d-10b879b5c879 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041938 Sep 23 03:49:55.695678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1330/2561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:55.702185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:55.703336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:55.711363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:55.712971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:55.713664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:55.715902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:55.716851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:55.717548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:55.935490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:55.944258 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2c44259-c7ac-4079-9ca1-1c55a3a38ab0 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1203 microversion: 2.1 time: 0.247190 Sep 23 03:49:55.945066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1331/2562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:55 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:55.950232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:55.951112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:55.958570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:55.959369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:55.960044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:55.960954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:55.961663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:55.962430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:56.532811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:49:56.534135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:49:56.534632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:49:56.535056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:49:56.535478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:49:56.537665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:49:56.554977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:56.555655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:56.556443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:56.557481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:56.558177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:56.558809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:56.578891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:56.585310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for user 505327a949b74cca88abf6bb709da9c6 and project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:56.614238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:49:56.617158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:49:56.687277 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00139750-4b7c-410c-b217-2612c77460c4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055842 Sep 23 03:49:56.687975 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1232/2563] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:49:56.694414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:56.694414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:56.712552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:56.713014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:56.713503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:56.714218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:56.714671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:56.715097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:57.008383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:57.032004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6e0a02f-1d17-4b5d-820b-16f576670504 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1275 microversion: 2.1 time: 0.341009 Sep 23 03:49:57.057011 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1233/2564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:56 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:57.061955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:57.062568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:57.103977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:57.110201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:57.114589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:57.115243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:57.116321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:57.117898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:57.121381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:57.124379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbd442fd-8f10-4144-bd92-324d1b7551ab tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 1.177858 Sep 23 03:49:57.124991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1332/2565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:55 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:57.139058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b44d7e1-6d8a-4baa-b1d3-15a8a0108505", "name": "network-vif-plugged", "status": "completed", "tag": "cea3de45-5f10-4f68-b65a-062b9f29cc20"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:57.173180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:57.174631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:57.178876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:57.205834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] Creating event network-vif-plugged:cea3de45-5f10-4f68-b65a-062b9f29cc20 for instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 on n-h2-858495-2 Sep 23 03:49:57.219959 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4c94ca4e-852f-4138-bd3d-bb299323309d req-0b41c85b-1684-4d58-81b5-88160eaad3ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093323 Sep 23 03:49:57.223068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1333/2566] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:57.235109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07e7f3b6-dc33-429a-9e20-42c9c79a33d2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:57.236856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07e7f3b6-dc33-429a-9e20-42c9c79a33d2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:57.512140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07e7f3b6-dc33-429a-9e20-42c9c79a33d2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:57.529455 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07e7f3b6-dc33-429a-9e20-42c9c79a33d2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1213 microversion: 2.1 time: 0.294495 Sep 23 03:49:57.554736 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1334/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:57 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1213 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:57.571412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:57.573616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:57.592734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:57.594111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:57.597079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:57.597992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:57.598480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:57.598927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.016790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:58.030561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f25b765d-eafc-40be-bfb0-0e1ea0071154 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1265 microversion: 2.1 time: 0.474520 Sep 23 03:49:58.036101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1335/2568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:57 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:58.047677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2a14d7-7c74-420c-b7ec-18685e3bb192", "tag": "57642fac-4b13-4997-92f8-550a5b4bde92"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:58.072161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.073017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.073735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.124129 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] Creating event network-changed:57642fac-4b13-4997-92f8-550a5b4bde92 for instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 on n-h2-858495-2 Sep 23 03:49:58.140834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8f409239-4e1b-4efc-9ab1-81ede0581c5d req-c7b60151-70db-4f72-8153-64e9d9c4d961 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103156 Sep 23 03:49:58.142063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1336/2569] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:58.358296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:58.373889 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8c4a11f-df74-4535-9048-3f16f087d781 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 1.315653 Sep 23 03:49:58.375421 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1234/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:57 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:58.414308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:58.416485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:58.429767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.431980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.433478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.435308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.436130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.439615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.707925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24a34d2f-1364-43bb-9bea-0917972fc67f tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Action: 'create', calling method: .version_select at 0x7f0c8bcd23a0>, body: {"keypair": {"name": "tempest-keypair-1360023093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3PIB2nRubbziFFEfiHDggsNyNKakamQfpnXScpsGEQ2oRY89+A0pePCRhaiws9kDUfttp7j4wITIOaVY1VPKyYExXs8Au8fosI0IyHX83Ufrj3VMyoDnSy3wQnHGrwQQ=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:49:58.747597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-24a34d2f-1364-43bb-9bea-0917972fc67f tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for project 5b1f02a5548d493483ebcad2e339605c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:49:58.755355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:58.765288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-24a34d2f-1364-43bb-9bea-0917972fc67f tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for user a27d761b90df492e8e5ebfb897d72d22 and project 5b1f02a5548d493483ebcad2e339605c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:49:58.790944 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ac72d1c-cb17-45f8-9cdd-6a66df470e44 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1275 microversion: 2.1 time: 0.402893 Sep 23 03:49:58.799469 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1235/2571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:58 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1275 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:58.820693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:58.821592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:58.847439 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24a34d2f-1364-43bb-9bea-0917972fc67f tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.678594 Sep 23 03:49:58.855447 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1337/2572] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:49:58.866404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:58.867429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:58.873363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.873898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.874354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.876019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.877848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.878304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.891520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.896497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.897717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:58.898973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:58.899714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:58.900376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:59.252725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:49:59.264812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1497310-b755-4cc8-8764-94cd77727c10 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1273 microversion: 2.1 time: 0.407505 Sep 23 03:49:59.280440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1338/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:58 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:49:59.296332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:49:59.298097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:49:59.306257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:59.307006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:59.307659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:49:59.308575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:49:59.309277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:49:59.310013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:00.268491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:00.303193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ed835eb-7534-4fdc-8d5c-1f1a7f35e2a3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1316 microversion: 2.1 time: 1.501644 Sep 23 03:50:00.312314 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1236/2574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:58 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1316 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:00.320952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:00.323602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:00.339141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:00.340085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:00.343503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:00.344606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:00.345853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:00.346981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:00.695792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:00.750256 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfc194bd-42c1-44f3-be48-511f16ea23c7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1307 microversion: 2.1 time: 1.422741 Sep 23 03:50:00.778226 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1339/2575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:49:59 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1307 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:00.793935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:00.795432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:00.807604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:00.808378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:00.809011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:00.810374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:00.811140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:00.811838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.119681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:01.134185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52168a0a-e647-4e7d-b7d2-0406fddc28b9 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.818181 Sep 23 03:50:01.134785 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1237/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:00 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:01.170939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:01.171573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:01.186967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.192440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.193192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.193981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.194453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.194882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.328054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:01.353002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-305d89ee-233c-4beb-aab8-cd6d3c0e7301 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1271 microversion: 2.1 time: 0.193622 Sep 23 03:50:01.359083 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1238/2577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:01 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:01.379510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc87313f-6ab1-45d4-bf69-672ccba2b1e2", "tag": "b4b77d73-0aef-466c-a32d-459b96334899"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:01.432029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.432843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.433679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.471862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] Creating event network-changed:b4b77d73-0aef-466c-a32d-459b96334899 for instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 on n-h1-858495-2 Sep 23 03:50:01.480302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:01.488376 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-84a03002-3456-4e25-ba12-17b26fd0e223 req-3f9b03b9-4ec8-40fa-b01b-cee3249c97a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123107 Sep 23 03:50:01.489929 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1239/2578] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:01.495012 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10c26093-82c5-47b8-bc5e-d09475c96b7f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.703035 Sep 23 03:50:01.495919 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1340/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:00 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:01.498899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:01.502888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:01.521823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.522342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.532271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.532271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.532271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.532271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.778521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:01.779142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:01.799576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.800035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.800476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:01.808658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:01.809154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:01.809636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.343603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:02.351264 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e8eb35e-1531-4af9-97be-f2f8bd6e1c2f tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1504 microversion: 2.1 time: 0.859723 Sep 23 03:50:02.361730 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1240/2580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:01 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1504 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:02.370046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:02.371219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:02.383494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.383990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.384429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.385237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.385707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.386139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.474298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:02.535957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:02.551409 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d652cd27-f44b-401f-a845-df77db130a0b tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1307 microversion: 2.1 time: 0.773669 Sep 23 03:50:02.552556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1341/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:01 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1307 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:02.572786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:02.583315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:02.618755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.619456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.620081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.622515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.623261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.623926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.690054 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1dcba54-60b9-41ab-a2e4-eba3a7a640a7 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips" status: 200 len: 108 microversion: 2.1 time: 0.130905 Sep 23 03:50:02.690978 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1342/2582] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:50:02 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips => generated 108 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:02.697206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:02.697206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:02.714947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.715450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.716700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.716700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:02.717305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:02.717894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:02.988407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:03.005723 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73449568-29f5-4c23-9501-28081f35b578 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1271 microversion: 2.1 time: 0.313514 Sep 23 03:50:03.032423 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1343/2583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:02 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1271 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:03.047454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:03.050971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:03.067975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.068653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.069294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.070301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.071965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.072574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.150550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:03.182932 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb386429-68c0-4aa2-be0d-5f6797906278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.804926 Sep 23 03:50:03.184269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1241/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:02 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:03.196352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:03.197068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:03.223116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.223533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.223988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.224695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.225165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.227045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.305141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61e33cf3-c91d-4399-8584-a2096763cfad tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips" status: 200 len: 108 microversion: 2.1 time: 0.114928 Sep 23 03:50:03.312047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1242/2585] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:50:03 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips => generated 108 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:03.344866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:03.350731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:03.371230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.372148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.374762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.377329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.379145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.379783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.431711 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3084080b-7f07-4f09-931b-57bc3717c0d4 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips/tempest-ServerAddressesTestJSON-757335445-network" status: 200 len: 93 microversion: 2.1 time: 0.097661 Sep 23 03:50:03.435145 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1243/2586] 10.222.0.25 () {58 vars in 1398 bytes} [Fri Sep 23 03:50:03 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505/ips/tempest-ServerAddressesTestJSON-757335445-network => generated 93 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:50:03.472309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:03.473279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:03.496054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.496641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.497419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.498725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.500006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.500871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.541897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:50:03.597104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:03.711560 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fbe68e53-6ee3-4995-844e-9431dbe9bd17 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 204 len: 0 microversion: 2.1 time: 0.258323 Sep 23 03:50:03.712757 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1244/2587] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:03 2022] DELETE /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:03.727187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:03.728564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:03.740741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.741641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.742273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:03.743455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:03.744482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:03.745262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:04.240193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:04.254301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a321738b-31a7-4cf1-807c-aa3727a2ef77 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 1.218397 Sep 23 03:50:04.254900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1344/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:03 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:04.270172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:04.270828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:04.281497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:04.282112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:04.282616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:04.283354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:04.283818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:04.284254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:04.951045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:04.959759 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83d4d680-ca9e-4ae3-894a-1abf6f3108ac tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1307 microversion: 2.1 time: 1.245735 Sep 23 03:50:04.964808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1245/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:03 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1307 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:04.997220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:04.998224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:05.006714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.007742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.008353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:05.009242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.009971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.010694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:05.458582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:05.468535 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06ca78c1-911d-4cf8-9cd3-fca89e5d0252 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1510 microversion: 2.1 time: 1.212522 Sep 23 03:50:05.469244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1345/2590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:04 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1510 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:05.474201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:05.475589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:05.481715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.482204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.483009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:05.484154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.484912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.485340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:05.836717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:05.854851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f83b6a67-0c60-40e3-b73f-197d46f7e655 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1313 microversion: 2.1 time: 0.862053 Sep 23 03:50:05.855756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1246/2591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:04 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:05.870358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:05.870994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:05.880620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.881104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.883984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:05.885165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:05.885841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:05.886277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:06.405782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:06.425990 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adebc1fb-428f-4828-aab0-49b597d372a3 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.950289 Sep 23 03:50:06.428414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1346/2592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:05 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:06.441420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-480998719", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "51a338f0-45f8-474c-91e4-82429e0f2b32"}], "security_groups": [{"name": "tempest-securitygroup--214352095"}], "key_name": "tempest-keypair-1360023093", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:06.569820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:06.602128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:06.783579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:06.796344 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fcbbccbf-eaa0-4b84-9157-06e10348d797 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.938095 Sep 23 03:50:06.797873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1247/2593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:05 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:06.804177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc87313f-6ab1-45d4-bf69-672ccba2b1e2", "name": "network-vif-plugged", "status": "completed", "tag": "b4b77d73-0aef-466c-a32d-459b96334899"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:06.819174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:06.820698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:06.821928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:06.848178 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] Creating event network-vif-plugged:b4b77d73-0aef-466c-a32d-459b96334899 for instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 on n-h1-858495-2 Sep 23 03:50:06.857582 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d973fd8d-73d1-4771-84b3-dad86d312a42 req-71bd4453-bb78-4df8-9a14-ec45c008e941 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057574 Sep 23 03:50:06.859489 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1248/2594] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:06.868281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:06.869384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:06.877438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:06.878243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:06.878909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:06.879983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:06.880698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:06.881316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:07.472454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] validate_networks() for [('51a338f0-45f8-474c-91e4-82429e0f2b32', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:50:08.062448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:08.086334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34f09362-346d-4345-b583-085d8cd3fff1 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1307 microversion: 2.1 time: 1.222938 Sep 23 03:50:08.088618 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1249/2595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:06 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1307 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:08.126677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92b83db-2e76-412e-9bc2-aeb39c34d807", "tag": "cffd7744-dc89-4497-a787-89527dd60f4f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:08.211393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:08.212208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:08.212969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:08.277769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] Creating event network-changed:cffd7744-dc89-4497-a787-89527dd60f4f for instance c92b83db-2e76-412e-9bc2-aeb39c34d807 on n-h1-858495-2 Sep 23 03:50:08.287371 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1e510c10-079a-4492-a62e-9f484096d372 req-49f755c0-5a50-44c6-8fa2-281f14e88e7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182884 Sep 23 03:50:08.289396 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1250/2596] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:08.300024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:08.302046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:08.315795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:08.317318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:08.325303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:08.327049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:08.328860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:08.333554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:08.676802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62715c49f3f14a23b3c3d2dbd3fa2ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12009e256ce4f95b47efc3b5953990d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:08.729046 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a03c7a09-9cd9-4cf1-9e80-fbcc85aa57c3 tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 200 len: 1468 microversion: 2.1 time: 0.436205 Sep 23 03:50:08.733690 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1251/2597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:08 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 1468 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:08.770125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:08.771298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:08.781479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:08.783895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=11 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:08.785669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:08.787199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:08.788496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:08.789204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:08.793272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.374789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:09.390441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0478097-62d0-4272-9590-ffbfb5b6a483 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1313 microversion: 2.1 time: 0.652634 Sep 23 03:50:09.405783 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1252/2598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:08 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:09.421864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:09.422694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:09.440916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.441778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.442841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.444149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.444679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.445444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.510725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for project 5b1f02a5548d493483ebcad2e339605c. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:09.525243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for user a27d761b90df492e8e5ebfb897d72d22 and project 5b1f02a5548d493483ebcad2e339605c. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:09.560153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:50:09.560549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:50:09.563316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:50:09.564058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:50:09.574064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:50:09.584036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.584850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.588760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.589979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.602172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.603021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.642276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for project 5b1f02a5548d493483ebcad2e339605c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:09.649380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Getting quotas for user a27d761b90df492e8e5ebfb897d72d22 and project 5b1f02a5548d493483ebcad2e339605c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:09.681836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:50:09.691577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:50:09.804153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7505acb9-6461-439c-9b86-14273e000778 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.373424 Sep 23 03:50:09.812024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1347/2599] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:50:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:50:09.817884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:09.823819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:09.835811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.836490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.837106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:09.838189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:09.848869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:09.849610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.276337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:10.292593 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f90fbd4d-0d54-43f6-81a8-cc5be7dd97d8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.885290 Sep 23 03:50:10.314658 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1253/2600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:09 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:10.342655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:10.390857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.394370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.403851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.461253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] Creating event network-changed:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:50:10.476411 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-58e0b5d5-b824-4b7c-a7bd-216868aeec3c req-af5c8884-9e62-4d4f-bdf0-e6d718851dee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147540 Sep 23 03:50:10.477759 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1254/2601] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:10.494303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2a14d7-7c74-420c-b7ec-18685e3bb192", "name": "network-vif-plugged", "status": "completed", "tag": "57642fac-4b13-4997-92f8-550a5b4bde92"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:10.520274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:10.526145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.526631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.527069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.533261 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58973ae1-9a9c-459c-b0de-5806ed542011 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.719319 Sep 23 03:50:10.533904 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1348/2602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:09 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:10.543814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:10.558296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:10.575388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.577089 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] Creating event network-vif-plugged:57642fac-4b13-4997-92f8-550a5b4bde92 for instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 on n-h2-858495-2 Sep 23 03:50:10.579834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.585094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.586168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.586900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.587339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.599189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cc7625ba-6130-4701-b757-6fdcd4a6745a req-e2435aa0-c630-44ac-b897-5b9ef9fdd280 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117927 Sep 23 03:50:10.601888 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1255/2603] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:10.619007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:10.624475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] [instance: 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:10.636234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:10.640875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.643533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.644847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.646846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:10.649044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:10.651580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:10.689679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] HTTP exception thrown: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Request method failure captured: Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 HTTP/1.1 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzLmLruSD3Gb0AoqatRYXRUFN8Guqs-Nkk5qBGSvfGGvWrGU2dr-rz-sXxihKJs6O46cm7XDdPNs3TEwFPN_orK5CWB9MCgEgPzP2vOLb7gryf7nJw1NWIOOzs6COc7eGQoFBtkmuD9HPU2arzNqXoKcLpJFxWhx9HTIolsgLsy09Y Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: e12009e256ce4f95b47efc3b5953990d Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerAddressesTestJSON-1857206598 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e12009e256ce4f95b47efc3b5953990d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e12009e256ce4f95b47efc3b5953990d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e12009e256ce4f95b47efc3b5953990d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e12009e256ce4f95b47efc3b5953990d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerAddressesTestJSON-1857206598 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: e12009e256ce4f95b47efc3b5953990d Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1857206598 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerAddressesTestJSON-1857206598-project Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 62715c49f3f14a23b3c3d2dbd3fa2ee0 Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerAddressesTestJSON-1857206598-project Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7b44d7e1-6d8a-4baa-b1d3-15a8a0108505'} Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:10.695617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:10.700146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] Returning 404 to user: Instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:10.701852 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c95646cf-23ea-4f1c-910e-074460ec5e6c tempest-ServerAddressesTestJSON-1857206598 tempest-ServerAddressesTestJSON-1857206598-project] 10.222.0.25 "GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505" status: 404 len: 111 microversion: 2.1 time: 0.091790 Sep 23 03:50:10.702066 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1256/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:10 2022] GET /compute/v2.1/servers/7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:10.713022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e511465-77de-42e7-9db6-6affec9230ce tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:10.714870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e511465-77de-42e7-9db6-6affec9230ce tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:11.129139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2e511465-77de-42e7-9db6-6affec9230ce tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:11.137154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e511465-77de-42e7-9db6-6affec9230ce tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1277 microversion: 2.1 time: 0.433479 Sep 23 03:50:11.140295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1257/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:10 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:11.167341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:11.168541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:11.185585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:11.186312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:11.188854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:11.189911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:11.192994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:11.193819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:11.890463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:11.904461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e37136a1-bcb0-419f-b1d2-d29f6d392d06 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1488 microversion: 2.1 time: 1.364212 Sep 23 03:50:11.906410 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1349/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:10 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1488 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:11.920035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:11.922714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:11.938050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:11.939302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:11.940096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:11.958159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:11.959248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:11.963816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:11.980181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:11.994716 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07bc3d8b-e9cb-4efb-8348-ae765bd23022 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1313 microversion: 2.1 time: 0.852093 Sep 23 03:50:12.003304 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1258/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:11 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:12.008820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:12.009793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:12.027012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.027354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.028070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.028877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.029470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.037424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.446246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:12.481630 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-08a87c04-538c-4483-bc8d-f619b6dc667a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.567718 Sep 23 03:50:12.482299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1350/2608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:11 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:12.488972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2109677230"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:12.491593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:12.506282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.507322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.508330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.510013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.510748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.511402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.526772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:12.558320 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c15d76ba-55d3-4042-9d01-2bd5b0995a91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.553284 Sep 23 03:50:12.569007 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1259/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:12 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:12.584509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:12.588829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:12.619254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.619919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.622934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.623999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.624677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.626280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.853958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:12.881939 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4dbb3977-7361-43cc-a15b-119ec73e791b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1281 microversion: 2.1 time: 0.306929 Sep 23 03:50:12.898550 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1260/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:12 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:12.911155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b44d7e1-6d8a-4baa-b1d3-15a8a0108505", "name": "network-vif-deleted", "tag": "cea3de45-5f10-4f68-b65a-062b9f29cc20"}, {"name": "network-changed", "server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:12.945410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:12.947977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:12.948230 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee82aa2d-e17c-4a30-96e0-d64f4aca753e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "POST /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2/action" status: 202 len: 0 microversion: 2.1 time: 0.464463 Sep 23 03:50:12.950091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:12.961569 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1351/2611] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:50:12 2022] POST /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:50:12.973008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92b83db-2e76-412e-9bc2-aeb39c34d807", "name": "network-vif-plugged", "status": "completed", "tag": "cffd7744-dc89-4497-a787-89527dd60f4f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:12.995031 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Creating event network-vif-deleted:cea3de45-5f10-4f68-b65a-062b9f29cc20 for instance 7b44d7e1-6d8a-4baa-b1d3-15a8a0108505 on n-h2-858495-2 Sep 23 03:50:12.996442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] Creating event network-changed:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:50:13.000438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:13.007010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:13.010748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:13.017829 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-aaa38f1a-63de-4760-b485-f0ee0e6047ef req-0f65f5e2-e21e-4241-af04-89f3bbba8a5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107376 Sep 23 03:50:13.019619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1261/2612] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:13.028453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47dec645-2f8c-4796-ac18-4cd713f84ba5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b79d550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:13.032958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] Creating event network-vif-plugged:cffd7744-dc89-4497-a787-89527dd60f4f for instance c92b83db-2e76-412e-9bc2-aeb39c34d807 on n-h1-858495-2 Sep 23 03:50:13.052188 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2effe761-8e60-4e5c-b25f-bab1fa871109 req-4b88cfcc-f896-4e59-9a0d-282185c2f300 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089082 Sep 23 03:50:13.053030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1352/2613] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:13.059046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:13.062442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:13.081874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:13.082649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:13.083233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:13.084719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:13.085334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:13.085948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:13.192130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47dec645-2f8c-4796-ac18-4cd713f84ba5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377" status: 200 len: 1412 microversion: 2.1 time: 0.169885 Sep 23 03:50:13.205444 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1262/2614] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:13 2022] GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:13.213025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2c14508-eed8-4597-933f-0300eeaa09f2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1fef70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:13.295896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2c14508-eed8-4597-933f-0300eeaa09f2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377" status: 200 len: 1412 microversion: 2.1 time: 0.088643 Sep 23 03:50:13.306350 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1263/2615] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:13 2022] GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:13.322963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47ccdac2-864c-4630-85cb-11e21689becb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b1f8b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:13.587913 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47ccdac2-864c-4630-85cb-11e21689becb tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377" status: 204 len: 0 microversion: 2.1 time: 0.260258 Sep 23 03:50:13.589256 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1264/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:13 2022] DELETE /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:13.596608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:13.597376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:13.613008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:13.613550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:13.614034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:13.615108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:13.615615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:13.616051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.000628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:14.009492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df3ae66a-2fb2-438e-a27f-af3d0a61c4c5 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1313 microversion: 2.1 time: 0.954952 Sep 23 03:50:14.022639 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1353/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:13 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:14.033601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:14.034329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:14.041475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.042115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.043032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.043854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.044412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.045795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.287057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:14.300557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5372830c-5b18-48f4-9724-5ab76e48fcad tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 0.710812 Sep 23 03:50:14.301252 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1265/2618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:13 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:14.306450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd73d170-67c2-4f1a-9ce2-91abd3cede2e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8b3000d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:14.330921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-cd73d170-67c2-4f1a-9ce2-91abd3cede2e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Image not found. Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd73d170-67c2-4f1a-9ce2-91abd3cede2e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 HTTP/1.1 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '91f90e90-84be-45dc-94e2-c5d08b848377'} Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91f90e90-84be-45dc-94e2-c5d08b848377 Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:50:14.332965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f90e90-84be-45dc-94e2-c5d08b848377 could not be found. Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:50:14.337620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:14.340691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd73d170-67c2-4f1a-9ce2-91abd3cede2e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:14.343092 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd73d170-67c2-4f1a-9ce2-91abd3cede2e tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377" status: 404 len: 62 microversion: 2.1 time: 0.038926 Sep 23 03:50:14.343092 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1266/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:14 2022] GET /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:50:14.546943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dab0da32-4feb-4059-bac7-51d0d04f8918 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Action: 'create', calling method: .version_select at 0x7f0c8b1fe040>, body: {"keypair": {"name": "tempest-keypair-1924589938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnl0oO2h5Ncq7Tre0sMZbcZFK7bc1ngBKHZ099EH5oT1Cc5h3dkqR/aFR5Te8CWA8rNERTi1IcO5vFlTSh7NkKLjuVsPnNbIjeRhp9Klpcr7u05qiVJtXPYlkuPgVGrCQ=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:14.587839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dab0da32-4feb-4059-bac7-51d0d04f8918 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:14.599002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dab0da32-4feb-4059-bac7-51d0d04f8918 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for user f3a3a03385ba4c54972c7fbf55dc867b and project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:14.633752 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dab0da32-4feb-4059-bac7-51d0d04f8918 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.290189 Sep 23 03:50:14.634948 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1267/2620] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:14.656856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:14.660197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:14.663782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:14.673282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-033fd6c9-3665-48c3-bc28-23a166486917 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.648784 Sep 23 03:50:14.674780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.675417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.675864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.676814 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1354/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:14 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:14.678229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.678639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.679318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.690212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:14.690851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:14.709231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.709778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.710308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.711932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:14.712785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:14.713341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:14.808247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:14.822554 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a01d67cf-71fd-4bcc-b02b-6c86ed0cfd54 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1335 microversion: 2.1 time: 0.186208 Sep 23 03:50:14.838691 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1268/2622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:14 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:15.039713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:15.040463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:15.052175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:15.052923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:15.053515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:15.054383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:15.054962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:15.055506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:15.184957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:15.200086 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb1aad2f-bbec-4cdd-b44c-30b047ef6520 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1506 microversion: 2.1 time: 0.520066 Sep 23 03:50:15.201780 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1355/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:14 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:15.331419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:15.336319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:15.340949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:15.360331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:15.363902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:15.364393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:15.369073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:15.369667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:15.370126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:16.132415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:16.153591 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58b46263-5db1-46a4-9029-33284327a1af tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1313 microversion: 2.1 time: 1.117969 Sep 23 03:50:16.156002 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1269/2624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:15 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1313 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:16.175609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:16.178295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:16.187188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:16.187990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:16.188678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:16.190441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:16.191141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:16.191732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:16.208732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:17.332237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:17.341154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcbc3591-22d6-442f-8ae4-25dfb0fa56d2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 1.180642 Sep 23 03:50:17.350106 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1270/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:16 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:17.355854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:17.360187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:17.364922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:17.375935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.381880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.383171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.387256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.388416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.389089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.448660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:17.462509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62ccfeba-6063-4db1-a34b-44d374eb7337 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1316 microversion: 2.1 time: 2.140928 Sep 23 03:50:17.463724 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1356/2626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:15 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1316 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:17.470254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:17.471346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:17.492195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.492957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.495258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.497781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.498475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.499611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.564269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:17.577211 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7765998-fe16-4f23-ab13-0431e531bede tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1335 microversion: 2.1 time: 0.225368 Sep 23 03:50:17.578155 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1271/2627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:17 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:17.584933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-plugged", "status": "completed", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:17.624491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.633438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.634173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.687181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] Creating event network-vif-plugged:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:50:17.703527 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e1576d64-bbc5-4efa-b257-b4288e1eab9d req-8deda35d-300e-4441-9050-e03a1565a065 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121432 Sep 23 03:50:17.706900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1272/2628] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:17.723730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:17.738330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:17.761726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.764388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.765383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:17.767352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:17.768082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:17.768774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.106018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:18.118149 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-575081a9-7479-4d61-896e-b3e6dc3b825c tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1488 microversion: 2.1 time: 0.653116 Sep 23 03:50:18.119145 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1357/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:17 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1488 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:18.146668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:18.147624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:18.169970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.183610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.197660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.201809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.212991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.221549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.265234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:50:18.283631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:18.295407 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-483f802f-8f6b-4f8c-a845-366b53cd3e85 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1463 microversion: 2.1 time: 0.585747 Sep 23 03:50:18.296008 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1273/2630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:17 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1463 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:18.319129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:18.319987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:18.332879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.334126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.342418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.343375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.343856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.344862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.417074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d76b33f0-942e-41cf-afed-25051390353f tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 204 len: 0 microversion: 2.1 time: 0.273934 Sep 23 03:50:18.418490 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1358/2631] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:18 2022] DELETE /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:18.434245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:18.435129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:18.447633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.448248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.448785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.471414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.471934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.472385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.726977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:18.736246 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5432f7b-3019-4578-a86c-9a6b11486cce tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1314 microversion: 2.1 time: 0.421210 Sep 23 03:50:18.740334 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1274/2632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:18 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:18.749222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15a6eecf-78cf-4cdf-aa7c-7686e733cdfa tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93490280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:18.799237 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-15a6eecf-78cf-4cdf-aa7c-7686e733cdfa tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Image not found. Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15a6eecf-78cf-4cdf-aa7c-7686e733cdfa tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 HTTP/1.1 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '91f90e90-84be-45dc-94e2-c5d08b848377'} Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91f90e90-84be-45dc-94e2-c5d08b848377 to delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f90e90-84be-45dc-94e2-c5d08b848377 could not be found. Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.801686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:50:18.805953 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:18.808129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15a6eecf-78cf-4cdf-aa7c-7686e733cdfa tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:18.809156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-15a6eecf-78cf-4cdf-aa7c-7686e733cdfa tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377" status: 404 len: 62 microversion: 2.1 time: 0.067618 Sep 23 03:50:18.810009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1275/2633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:18 2022] DELETE /compute/v2.1/images/91f90e90-84be-45dc-94e2-c5d08b848377 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:50:18.815315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:18.822317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:18.840711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.841406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.842073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.844229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:18.844958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:18.847057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:18.961254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:18.983104 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1309faf5-4613-43f8-98f8-6720891f814c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1317 microversion: 2.1 time: 0.562798 Sep 23 03:50:19.001318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1359/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:18 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:19.013468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:19.021941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:19.036851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.037654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.038400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.039763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.040383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.040967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.350102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:19.375550 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd6ebb0d-3043-4808-8de5-b7634d2b263b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1504 microversion: 2.1 time: 0.564112 Sep 23 03:50:19.391305 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1276/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:18 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:19.404363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:19.404732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:19.414490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.415178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.415838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.417226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.417977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.418602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.468825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:50:19.556994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:19.565009 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1eea9090-07d9-4a1c-9348-7cb7591601f0 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.562435 Sep 23 03:50:19.568182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Instance is already in deleting state, ignoring this request Sep 23 03:50:19.569109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1360/2636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:19 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:19.570773 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bfa7483e-3c15-41b2-871b-47f9174df728 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 204 len: 0 microversion: 2.1 time: 0.176498 Sep 23 03:50:19.572539 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1277/2637] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:19 2022] DELETE /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:19.585532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2014095176"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:19.586158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:19.598401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:19.600473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:19.608747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.614282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.614428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.614915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.615778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.616343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.618307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.618957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.620581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.621036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:19.621986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:19.626126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:19.626820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:19.676129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=10 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:20.217909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:20.231478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b61ffb6e-1e02-4c89-8b1b-289eb91bbaba tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1494 microversion: 2.1 time: 0.654684 Sep 23 03:50:20.232162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1278/2638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:19 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1494 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:20.245746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:20.246824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:20.260831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:20.265551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:20.266074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:20.267355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:20.267832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:20.268262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:20.271810 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Adding security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 to port 57642fac-4b13-4997-92f8-550a5b4bde92 Sep 23 03:50:21.567004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:21.598260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a4ad696-f77d-42dd-8f58-42639ef3d294 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1314 microversion: 2.1 time: 1.348596 Sep 23 03:50:21.599312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1279/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:20 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1314 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:21.614914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:21.615354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:21.625886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:21.626661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:21.627302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:21.628921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:21.628921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:21.629145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.343366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:22.353132 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48329d13-382e-4a08-94d4-2eb627266c91 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1466 microversion: 2.1 time: 0.744905 Sep 23 03:50:22.353986 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1280/2640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:21 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1466 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:22.364764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-plugged", "status": "completed", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:22.425907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.427803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.431186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.437657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9152c11-cb48-4f46-95e2-901d34d05e89 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action" status: 202 len: 0 microversion: 2.1 time: 2.865859 Sep 23 03:50:22.439768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1361/2641] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:50:19 2022] POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action => generated 0 bytes in 2870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:22.447148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:22.448515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:22.468214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.469930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.472175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.476029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.477193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.479700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.485793 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] Creating event network-vif-plugged:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:50:22.502596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1536dd81-b9e3-4565-b24b-2e636d8b8437 req-d3a8edb7-6658-43bf-88f2-953b95b632df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146764 Sep 23 03:50:22.503612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1281/2642] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:22.512775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:22.513935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:22.525280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.526273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.526885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.527811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.528442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.529473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.618105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:22.619996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:22.621531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:22.628928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lazy-loading 'fault' on Instance uuid fc87313f-6ab1-45d4-bf69-672ccba2b1e2 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:50:23.159104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20166e829a544516a4adcdd3e0a4945e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc16ad5d64040e49238a855b83dd35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:23.168186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2262cd72-3115-4601-b6ef-30598af97b25 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 200 len: 1297 microversion: 2.1 time: 0.662345 Sep 23 03:50:23.180987 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1282/2643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:22 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 1297 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:23.186123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc87313f-6ab1-45d4-bf69-672ccba2b1e2", "name": "network-vif-deleted", "tag": "b4b77d73-0aef-466c-a32d-459b96334899"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:23.206002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:23.215202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:23.216075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:23.238982 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] Creating event network-vif-deleted:b4b77d73-0aef-466c-a32d-459b96334899 for instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 on n-h1-858495-2 Sep 23 03:50:23.247988 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-359172a9-076d-4c0c-9c25-a29ab6025926 req-01ac1ea9-8704-4e6c-999d-9d9688c29ef2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065354 Sep 23 03:50:23.252171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1283/2644] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:23.261674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1226491238", "metadata": {"image_type": "test"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:23.277786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:23.294498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:23.295192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:23.295793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:23.296690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:23.297378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:23.297963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:23.377424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Getting quotas for project 1703969e99664a7a9b3fb03d1d275740. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:23.389999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Getting quotas for user ee608439593f49a1a368a26f8beb3eb8 and project 1703969e99664a7a9b3fb03d1d275740. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:23.478803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:23.499255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a93c6e7-6fd0-45db-9702-dad7c1cae75b tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 1.058138 Sep 23 03:50:23.503722 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1362/2645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:22 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:23.523722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8bad7ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:23.851177 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1895884c-d6a1-4fa5-83d2-2f80a1d0e52d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "POST /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.597137 Sep 23 03:50:23.854849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1284/2646] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:50:23 2022] POST /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:50:23.868287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:23.869503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:23.890101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:23.890101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:23.890101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:23.890101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:23.890919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:23.890919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:23.900390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use.", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:23.901102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.901102 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 HTTP/1.1 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: exception: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2'} Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:23.905596 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 400 to user: Security Group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 in use. Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7a8a071a-e5b8-48c9-b8f1-9c7a2d362ba9'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a18ac056-df47-46b2-921c-da915a4be24f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2" status: 400 len: 185 microversion: 2.1 time: 0.399307 Sep 23 03:50:23.921070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1363/2647] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:23 2022] DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 => generated 185 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:50:23.935107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-778aa49c-1345-4221-be31-6baac784c181 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b12ed30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.041578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-778aa49c-1345-4221-be31-6baac784c181 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.131886 Sep 23 03:50:24.053835 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1364/2648] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:23 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:24.073593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:24.091067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.122542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.123411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.125318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.128261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:24.128977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.130142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.132434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.138883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81715aa5-32c8-4ddb-8815-773a4fd69101 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1314 microversion: 2.1 time: 0.282575 Sep 23 03:50:24.140136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1285/2649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:23 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:24.196692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.197837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: fc87313f-6ab1-45d4-bf69-672ccba2b1e2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.205441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:24.207092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.207859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.208477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.209201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.209681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.214797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.218796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:24.239714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 HTTP/1.1 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'fc87313f-6ab1-45d4-bf69-672ccba2b1e2'} Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.241944 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. Sep 23 03:50:24.246081 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.247382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance fc87313f-6ab1-45d4-bf69-672ccba2b1e2 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.248412 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d50e7a19-abd1-4b39-baf5-4a09977c48b8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2" status: 404 len: 111 microversion: 2.1 time: 0.056391 Sep 23 03:50:24.249146 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1286/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] GET /compute/v2.1/servers/fc87313f-6ab1-45d4-bf69-672ccba2b1e2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:50:24.265062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb2e240e-9577-4be7-868d-00b9267f7722 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c93490ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.289855 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec5b913d-0584-4d22-8585-7adbae43b1fd tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action" status: 202 len: 0 microversion: 2.1 time: 0.236716 Sep 23 03:50:24.295167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1365/2651] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:50:24 2022] POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:24.313151 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-cb2e240e-9577-4be7-868d-00b9267f7722 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Image not found. Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb2e240e-9577-4be7-868d-00b9267f7722 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 HTTP/1.1 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4a89a7ed-45cb-46d7-a920-4c86cd8b89f7'} Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 to delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 could not be found. Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.315457 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.320056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb2e240e-9577-4be7-868d-00b9267f7722 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.322334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb2e240e-9577-4be7-868d-00b9267f7722 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7" status: 404 len: 62 microversion: 2.1 time: 0.066708 Sep 23 03:50:24.323289 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1287/2652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] DELETE /compute/v2.1/images/4a89a7ed-45cb-46d7-a920-4c86cd8b89f7 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:50:24.329108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.330396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.334947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.335553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.345965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.346604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.347145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.347959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.348519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.349245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.362503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.363381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.366436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d HTTP/1.1 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'bc41f01d-5792-42a0-a520-014873a3171d'} Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:24.368524 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.377506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.379470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.379648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.379797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.379797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.379986 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6edcd8e-07ea-4c84-8ff1-989457565923 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 404 len: 111 microversion: 2.1 time: 0.041665 Sep 23 03:50:24.380080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.380168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1288/2653] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:24 2022] DELETE /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:50:24.386687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.387716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: bc41f01d-5792-42a0-a520-014873a3171d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.395761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.396513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.397263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.398080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.398816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.399270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.420300 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d HTTP/1.1 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'bc41f01d-5792-42a0-a520-014873a3171d'} Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.422348 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance bc41f01d-5792-42a0-a520-014873a3171d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f044c2b-fbff-480e-94d7-13e2c5301ed8 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d" status: 404 len: 111 microversion: 2.1 time: 0.041483 Sep 23 03:50:24.430832 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1289/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] GET /compute/v2.1/servers/bc41f01d-5792-42a0-a520-014873a3171d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:24.435815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0e941fb-1ba7-4c01-91c5-c0364f7b5ee2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c8ab2da60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.475201 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b0e941fb-1ba7-4c01-91c5-c0364f7b5ee2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Image not found. Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0e941fb-1ba7-4c01-91c5-c0364f7b5ee2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa HTTP/1.1 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa'} Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa to delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa could not be found. Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.477169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.486476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0e941fb-1ba7-4c01-91c5-c0364f7b5ee2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.490388 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0e941fb-1ba7-4c01-91c5-c0364f7b5ee2 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa" status: 404 len: 62 microversion: 2.1 time: 0.055788 Sep 23 03:50:24.491515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1290/2655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] DELETE /compute/v2.1/images/120cfd53-4211-4c27-ba1e-b5d9cbb0d4fa => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:50:24.528537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.529211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.540379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.540975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.541521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.542307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.542841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.543348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.561438 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde HTTP/1.1 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd3fd3746-49c4-4ca2-8cff-9fa0ed50acde'} Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:24.564052 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:24.567979 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:24.569775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:24.571085 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c57bd7b9-0eef-4e15-a83e-9f6074678563 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 404 len: 111 microversion: 2.1 time: 0.067286 Sep 23 03:50:24.572018 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1291/2656] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:24 2022] DELETE /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:24.579118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.580590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:24.591710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.592227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.592673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.593489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:24.594478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:24.594922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:24.624367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:24.971546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:24.984671 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ef1ea00-97c5-41a7-811e-ff3b6777b4ff tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.411161 Sep 23 03:50:24.985528 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1292/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:24.990575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:24.991203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: d3fd3746-49c4-4ca2-8cff-9fa0ed50acde] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:25.012266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.012839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.013328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.014096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.014570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.015015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.030824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:25.043529 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde HTTP/1.1 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd3fd3746-49c4-4ca2-8cff-9fa0ed50acde'} Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.046062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. Sep 23 03:50:25.054353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.059006 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adafae91-48e2-4d99-aa14-2b15945aafb2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1575 microversion: 2.1 time: 0.761744 Sep 23 03:50:25.073516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1366/2658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1575 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:25.083562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance d3fd3746-49c4-4ca2-8cff-9fa0ed50acde could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:25.085710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-711f6205-f4fe-43e0-ab24-383e0b933ff7 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde" status: 404 len: 111 microversion: 2.1 time: 0.098861 Sep 23 03:50:25.086308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1293/2659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:24 2022] GET /compute/v2.1/servers/d3fd3746-49c4-4ca2-8cff-9fa0ed50acde => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:25.088700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fcd10f9-cbbc-46d9-aadd-de6ee58ae3cb tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b10a670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:25.102835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0aa60d6-1eb1-46b0-a2b9-de4b8283dce5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '.version_select at 0x7f0c933a6280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:25.181635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a0aa60d6-1eb1-46b0-a2b9-de4b8283dce5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Image not found. Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0aa60d6-1eb1-46b0-a2b9-de4b8283dce5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 HTTP/1.1 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '586aaf9e-1744-4e0e-b3f3-373c32f80e49'} Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 586aaf9e-1744-4e0e-b3f3-373c32f80e49 to delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 586aaf9e-1744-4e0e-b3f3-373c32f80e49 could not be found. Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.186382 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:50:25.191277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.192782 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fcd10f9-cbbc-46d9-aadd-de6ee58ae3cb tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.117065 Sep 23 03:50:25.193614 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1367/2660] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:25 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:25.201510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:25.202093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0aa60d6-1eb1-46b0-a2b9-de4b8283dce5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:25.202585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:25.203753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0aa60d6-1eb1-46b0-a2b9-de4b8283dce5 tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49" status: 404 len: 62 microversion: 2.1 time: 0.111113 Sep 23 03:50:25.207804 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1294/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:25 2022] DELETE /compute/v2.1/images/586aaf9e-1744-4e0e-b3f3-373c32f80e49 => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:50:25.210993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.212155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.213525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.215051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.215213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:25.215729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:25.216098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.216707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.232499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.236476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.238403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.239331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.242181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.244270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.270974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 HTTP/1.1 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'ef044de7-c729-4644-a0b4-0ebfb0984540'} Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:25.273907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.278452 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.280903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:25.283223 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36d3ba22-e105-478e-a3b5-549bb473e6fc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 404 len: 111 microversion: 2.1 time: 0.074392 Sep 23 03:50:25.283992 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1295/2662] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:25 2022] DELETE /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:25.307013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:25.307665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] [instance: ef044de7-c729-4644-a0b4-0ebfb0984540] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:25.328370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.328968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.329489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.330230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.331307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.331949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.360976 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] HTTP exception thrown: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Request method failure captured: Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 HTTP/1.1 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSvp4A-3zsKcelXiebslf_uAEf2nPK8wfiFh5HsN84iKSgBJRECsEBivA3-3g8iEspCWQ_Ns2AnypXbAxDWirSWM-QlrNkpF1FLQ2BtndgWRqJyDvSECfSxjgyif6D3M5nUNIGjoonHsvME97YkCF-6eNx1_V3IiFLuyk0mN3LozKzs Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc16ad5d64040e49238a855b83dd35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8dc16ad5d64040e49238a855b83dd35d Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesTestJSON-533902784 Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 20166e829a544516a4adcdd3e0a4945e Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesTestJSON-533902784-project Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'ef044de7-c729-4644-a0b4-0ebfb0984540'} Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.364757 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. Sep 23 03:50:25.372526 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:25.374257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] Returning 404 to user: Instance ef044de7-c729-4644-a0b4-0ebfb0984540 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:25.376311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87a6b882-12a0-4d7d-944c-3b64c21f52cc tempest-ImagesTestJSON-533902784 tempest-ImagesTestJSON-533902784-project] 10.222.0.25 "GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540" status: 404 len: 111 microversion: 2.1 time: 0.080415 Sep 23 03:50:25.377986 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1296/2663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:25 2022] GET /compute/v2.1/servers/ef044de7-c729-4644-a0b4-0ebfb0984540 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:25.385053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2a14d7-7c74-420c-b7ec-18685e3bb192", "tag": "57642fac-4b13-4997-92f8-550a5b4bde92"}, {"name": "network-changed", "server_uuid": "c0e6bca3-caeb-477b-8b07-e65384e32c7a", "tag": "33bd7132-3bcc-4437-90c0-9a4f018ec3d4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:25.401068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:25.401833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:25.402609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:25.426734 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Creating event network-changed:57642fac-4b13-4997-92f8-550a5b4bde92 for instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 on n-h2-858495-2 Sep 23 03:50:25.428645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] Creating event network-changed:33bd7132-3bcc-4437-90c0-9a4f018ec3d4 for instance c0e6bca3-caeb-477b-8b07-e65384e32c7a on n-h2-858495-2 Sep 23 03:50:25.460770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-73c72780-3eaa-4488-83c8-d3fffe407367 req-ecf6688c-bfd6-43de-b7f4-7978ab7d2551 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072107 Sep 23 03:50:25.461919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1297/2664] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:25.597784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:25.614504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1aebb70-a56c-4679-8a5d-f0418ee0fbb2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1314 microversion: 2.1 time: 0.418492 Sep 23 03:50:25.618007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1368/2665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:25 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:26.012651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:26.013762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:26.028268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.029833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.030299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:26.037088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.039559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.041045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:26.082564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:26.083838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:26.096348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.096481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.096848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:26.097805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.098615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.103620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:26.465672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:26.476400 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a03748a5-11fe-4e67-9587-23dfa24cc5a1 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.469390 Sep 23 03:50:26.478330 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1298/2666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:26 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:26.483458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dc99910-4689-4542-b861-4f0aa1f5b6d7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b3ecca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:26.492380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:26.502975 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e02baf2-e5fb-4740-8d60-515945d4d7a8 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1575 microversion: 2.1 time: 0.424397 Sep 23 03:50:26.503583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1369/2667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:26 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1575 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:26.556195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2dc99910-4689-4542-b861-4f0aa1f5b6d7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.076548 Sep 23 03:50:26.557858 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1299/2668] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:26 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:26.656015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:26.658005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:26.670656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.671577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.672758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:26.673832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:26.674532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:26.676519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:27.064474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:27.074348 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d82d64f-0773-4022-93c7-630fcbc00a4c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1463 microversion: 2.1 time: 0.434566 Sep 23 03:50:27.080118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1370/2669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:26 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1463 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:27.316164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-358989409", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "10edce15-3b09-4f71-b024-2c2f29cf9017"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:27.379920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:50:27.504659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:27.505261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:27.516820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:27.517314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:27.517770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:27.521909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:27.523252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:27.525642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:28.109114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:50:28.110025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:50:28.110790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:50:28.111458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:50:28.112065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:50:28.134031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:28.134524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:28.134965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:28.135701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:28.136426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:28.136860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:28.206864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:28.224984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Getting quotas for user 505327a949b74cca88abf6bb709da9c6 and project c385317083c24b2cae54ebc64c19610e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:28.259960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:50:28.266931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:50:28.316289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:28.335951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88a3a04f-5491-46a3-96ea-a8c341ec9a85 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.833261 Sep 23 03:50:28.338108 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1371/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:27 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:28.351017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:28.359971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:28.379236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:28.380034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:28.380695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:28.381648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:28.382300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:28.382918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:28.503745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-643f70c6-0348-432b-922c-00f67553e7ec tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188288 Sep 23 03:50:28.504491 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1300/2671] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:50:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:50:28.532010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0eeb106-0186-4be3-a4ff-da9862976ecf tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b1fe3a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:28.980066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:29.005601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60f75d3a-2c6b-4a9b-b136-6567b1c9e171 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1575 microversion: 2.1 time: 0.661598 Sep 23 03:50:29.006689 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1372/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:28 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1575 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:29.024368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-plugged", "status": "completed", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:29.056151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:29.057065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:29.058375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:29.102715 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] Creating event network-vif-plugged:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:50:29.119908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5f107826-427b-423f-bad5-952159d04544 req-77f27c93-f4d7-4c52-bd5d-8daaa8e46df1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104679 Sep 23 03:50:29.122550 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1373/2673] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:29.162850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27347ca3-4c24-493d-b874-79493c278d28 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:29.163764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-27347ca3-4c24-493d-b874-79493c278d28 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:29.368780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-27347ca3-4c24-493d-b874-79493c278d28 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:29.393078 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-27347ca3-4c24-493d-b874-79493c278d28 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1213 microversion: 2.1 time: 0.255906 Sep 23 03:50:29.395167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1374/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:29 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:29.407075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:29.408029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:29.431755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:29.439408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:29.441803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:29.442811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:29.449196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:29.450933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:31.069376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:31.087685 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7306360-caaa-4def-9f2d-cc0157e3b89e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 1.685106 Sep 23 03:50:31.102217 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1375/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:29 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:31.153064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:31.161953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:31.209668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:31.214618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:31.216123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:31.224799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:31.227188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:31.242344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:32.791819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:32.822523 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c03338ce-177d-47ae-bba3-72cc90ae7758 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1573 microversion: 2.1 time: 1.718829 Sep 23 03:50:32.842337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1376/2676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:31 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1573 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:32.867292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:32.875696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:32.900693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:32.901567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:32.902691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:32.903991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:32.904814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:32.915088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:33.213298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:33.228644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97a71983-e293-4f28-bca9-61853d76e3de tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1271 microversion: 2.1 time: 0.383517 Sep 23 03:50:33.230183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1377/2677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:32 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1271 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:33.241882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:33.244723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:33.252037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:33.252598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:33.253238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:33.254395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:33.254939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:33.255526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:33.823142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:33.831877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd5a67d6-5da6-437f-bde8-8b3cff161b4e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.599022 Sep 23 03:50:33.848237 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1378/2678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:33 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:33.848237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-337042224"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:33.848237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:33.863122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:33.863628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:33.864067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:33.864804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:33.865251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:33.865679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:35.244065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Adding security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 to port 57642fac-4b13-4997-92f8-550a5b4bde92 Sep 23 03:50:37.982935 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-240e7103-8843-4920-b442-17c8df1238d7 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action" status: 202 len: 0 microversion: 2.1 time: 4.143977 Sep 23 03:50:37.983672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1379/2679] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:50:33 2022] POST /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192/action => generated 0 bytes in 4145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:37.988388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e6bca3-caeb-477b-8b07-e65384e32c7a", "name": "network-vif-plugged", "status": "completed", "tag": "33bd7132-3bcc-4437-90c0-9a4f018ec3d4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:38.018656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:38.020076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:38.022175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:38.058009 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] Creating event network-vif-plugged:33bd7132-3bcc-4437-90c0-9a4f018ec3d4 for instance c0e6bca3-caeb-477b-8b07-e65384e32c7a on n-h2-858495-2 Sep 23 03:50:38.092307 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c34248ae-9166-4e4e-9dfe-6974a3f0f87e req-905a231f-6480-4936-8c32-7e3810e084ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107116 Sep 23 03:50:38.093402 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1380/2680] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:38.119112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:38.120272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:38.138183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:38.139147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:38.141203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:38.142186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:38.144453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:38.146006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:38.165010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:38.167551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=29 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:38.245478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:38.407006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:38.775919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:38.787770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97e331f3-b23f-41f4-b087-c3f467de4cdb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.685972 Sep 23 03:50:38.791467 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1381/2681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:38 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:38.805661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:38.805661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:38.828582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:38.829274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:38.832487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:38.834611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:38.835705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:38.838448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:39.208497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:39.223197 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7040416e-d1e8-421b-b140-dc14ab307688 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1402 microversion: 2.1 time: 0.429425 Sep 23 03:50:39.249773 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1382/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:38 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:39.278514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a9474c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:39.380057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:40.047557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use.", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:40.048774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.048774 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02 HTTP/1.1 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: exception: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd7f6240c-049f-43ab-8dd7-f2cf1a170a02'} Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:40.053504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] Sep 23 03:50:40.058132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:40.063475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 400 to user: Security Group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 in use. Sep 23 03:50:40.063475 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-c9e25716-9b8f-418b-b18a-9d48656d8ca7'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:40.067449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1391dc50-e208-438a-bf7a-b60b946a5990 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02" status: 400 len: 185 microversion: 2.1 time: 0.813481 Sep 23 03:50:40.068529 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1383/2683] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:39 2022] DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02 => generated 185 bytes in 818 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:50:40.077234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2a14d7-7c74-420c-b7ec-18685e3bb192", "tag": "57642fac-4b13-4997-92f8-550a5b4bde92"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:40.091311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:40.096618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:40.097862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:40.117796 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] Creating event network-changed:57642fac-4b13-4997-92f8-550a5b4bde92 for instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 on n-h2-858495-2 Sep 23 03:50:40.127912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9fa05526-ebef-4307-b7b5-9b00a7a2b540 req-233562d4-81ef-4c6a-9a34-3c22dd832ebc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057715 Sep 23 03:50:40.133421 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1384/2684] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:40.718128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-edcfcdce-d746-4f80-a103-918daca17dad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8a947790>, body: {"keypair": {"name": "tempest-keypair-920172024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYDPFO69gQh71Fj5X2CX26ZJ5qxSsp/2HdwblOBUDnMyZLItyqf+rvw9w68/WR5msdiF/tD7Ujt4Pl5NWQfEgDov1tbqmWsdiGYNQW1k8wOBkiSg3dYASI0StrA+4emTQ=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:40.752932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-edcfcdce-d746-4f80-a103-918daca17dad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:40.768172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-edcfcdce-d746-4f80-a103-918daca17dad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:40.812954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-edcfcdce-d746-4f80-a103-918daca17dad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.675184 Sep 23 03:50:40.821657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1385/2685] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:40.834526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:40.835772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:40.848131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:40.849955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:40.850860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:40.852048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:40.852677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:40.853497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:41.795320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:41.807152 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0578ea26-c63f-4872-b85d-f59d7a053da3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.984043 Sep 23 03:50:41.810232 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1386/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:40 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:41.823749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0eeb106-0186-4be3-a4ff-da9862976ecf tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 13.318160 Sep 23 03:50:41.824943 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1301/2687] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:28 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 13320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:41.831268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:41.837763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:41.838702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:41.847056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:41.857233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:41.857762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:41.860968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:41.867378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:41.870214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:41.870913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:41.871736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:41.872790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:41.877673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:41.878952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:41.880205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:41.880897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:41.940410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:50:41.943974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:42.122715 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-715115fb-50ab-4db4-8777-4ac8b5040d2c tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 204 len: 0 microversion: 2.1 time: 0.310904 Sep 23 03:50:42.127036 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1387/2688] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:41 2022] DELETE /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:42.139114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d11d163-c417-4399-82a7-a8e80771c737 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8bd5a820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:42.175031 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d11d163-c417-4399-82a7-a8e80771c737 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-920172024" status: 200 len: 497 microversion: 2.1 time: 0.045780 Sep 23 03:50:42.191726 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1388/2689] 10.222.0.25 () {58 vars in 1215 bytes} [Fri Sep 23 03:50:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-920172024 => generated 497 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:42.219054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:42.225746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:42.246097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:42.247558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:42.249023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:42.251462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:42.254072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:42.260246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:42.718904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:42.740794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36b934df-895b-4f0b-a8c4-d5b00b12762b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1647 microversion: 2.1 time: 0.547518 Sep 23 03:50:42.742009 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1389/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:42 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1647 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:42.748207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9eea26d0-adb6-4769-bba7-1ee5aa624d1e tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8b18fc10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:42.815225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9eea26d0-adb6-4769-bba7-1ee5aa624d1e tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920172024" status: 202 len: 0 microversion: 2.1 time: 0.070894 Sep 23 03:50:42.824807 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1390/2691] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920172024 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:42.838032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8", "tag": "57af964f-eebb-4fff-8519-ac4601e7442b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:42.865701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:42.866313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:42.866606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:42.891858 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] Creating event network-changed:57af964f-eebb-4fff-8519-ac4601e7442b for instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 on n-h2-858495-2 Sep 23 03:50:42.908502 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-20a22b75-5aed-42a6-9459-d554d16cab69 req-f6597e39-5be4-4cc2-8ba6-7f31a1cee42e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081859 Sep 23 03:50:42.915505 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1391/2692] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:42.940746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73c96340-d0d3-47b0-bc58-dbbc4138b5db tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8aa5c280>, body: {"keypair": {"name": "tempest-keypair-1819611151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWYJ7lnu+FEbkgbsm4V36jt8pYZRVTu1Po0KJ402MC+AnpsHDAKOnDKNp+3amba/bwFyiTtenn0ZP1rBhfDVZ++aWSBh0aQM71auTFjavJNiTm+Qr2Ob2qenyJK0leUTQ=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:42.964474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-73c96340-d0d3-47b0-bc58-dbbc4138b5db tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:42.971709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-73c96340-d0d3-47b0-bc58-dbbc4138b5db tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:42.998537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:43.010301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73c96340-d0d3-47b0-bc58-dbbc4138b5db tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089684 Sep 23 03:50:43.011784 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1392/2693] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:43.024807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.031527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:43.055679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:43.058592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.059096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.059538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:43.060255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.060703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.061125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:43.069473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-672230db-9c23-45f3-bc2b-52c665ebeed3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1589 microversion: 2.1 time: 1.242652 Sep 23 03:50:43.073210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1302/2694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:41 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1589 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:43.086740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df1558f3-1612-4af6-bf04-13c0183e3425 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b1fe9d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.212199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df1558f3-1612-4af6-bf04-13c0183e3425 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.137453 Sep 23 03:50:43.212794 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1303/2695] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:43 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:43.219564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f2f7c4b-bc23-48f3-b17e-2cf391a464ef tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8a7d2ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.254078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f2f7c4b-bc23-48f3-b17e-2cf391a464ef tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819611151" status: 202 len: 0 microversion: 2.1 time: 0.039295 Sep 23 03:50:43.256138 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1304/2696] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819611151 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:43.266954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.267929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:43.281262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.281851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.282333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:43.283095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.286625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.288229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:43.546268 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18fe2b42-e5bc-4809-bc35-ed30434774a5 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288645 Sep 23 03:50:43.556325 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1305/2697] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:50:43 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:43.562252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ce5e1ca-5284-4d05-a9a3-d8381dcfea20 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8b848550>, body: {"keypair": {"name": "tempest-keypair-839205777", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:43.607899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6ce5e1ca-5284-4d05-a9a3-d8381dcfea20 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:43.616160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-6ce5e1ca-5284-4d05-a9a3-d8381dcfea20 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:43.670838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ce5e1ca-5284-4d05-a9a3-d8381dcfea20 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.112414 Sep 23 03:50:43.671747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1306/2698] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:43 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:43.685166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7eeae833-fc4b-4102-895a-a179e1377398 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8a7ee4c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.711965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7eeae833-fc4b-4102-895a-a179e1377398 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839205777" status: 202 len: 0 microversion: 2.1 time: 0.032301 Sep 23 03:50:43.722942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1307/2699] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839205777 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:50:43.728905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75a37159-6224-4f20-9561-eb5ec05f91ad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8a7deca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1391590203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvkyRb1l89qswyeHLsDEXWbjUEC3KJO3wzj0O0Tpp/e82g8D9joHyeYwEyK6miINl1415dG0ofSwjDIBRTGAvpSKvGfdK7SdwOIouIhldtDe80HuLkH/iw/JHx4DNHM6g=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:43.759749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-75a37159-6224-4f20-9561-eb5ec05f91ad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:43.767536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-75a37159-6224-4f20-9561-eb5ec05f91ad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:43.804263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75a37159-6224-4f20-9561-eb5ec05f91ad tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.079676 Sep 23 03:50:43.830087 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1308/2700] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:43.852730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:43.856716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:43.885223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.886400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.887063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:43.888015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:43.890656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:43.893479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:44.608118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:44.619986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69ecb6e2-e0c7-45c7-ad39-9ffc84d7d047 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 1.599793 Sep 23 03:50:44.621412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1393/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:43 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:44.643608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97086a12-7b10-4fe3-837e-58733daa4ea2 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8a8d0790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1272408138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA07GiDQ7/fNcR4xmz12Xw//qrGztCOy4eEXA5n6FTg8as9kdmHnGROyU9u9Tbx8pNRy5SrZAHnmpj/5No8Xu2ohg3LDrzONWgf3TU2ZTKkr4VXKmmXPXPK2toXbOcMJiw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:44.674165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-97086a12-7b10-4fe3-837e-58733daa4ea2 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:44.687509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-97086a12-7b10-4fe3-837e-58733daa4ea2 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:44.753764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97086a12-7b10-4fe3-837e-58733daa4ea2 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.131022 Sep 23 03:50:44.754635 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1394/2702] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:44.770901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2df8ae5d-ef6d-40c3-b7e8-4fc3c8481738 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d0dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:44.887828 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2df8ae5d-ef6d-40c3-b7e8-4fc3c8481738 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.131980 Sep 23 03:50:44.897605 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1395/2703] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:44 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:44.908061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7045407-b802-4f28-ad0d-5c2a67184a38 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Action: 'create', calling method: .version_select at 0x7f0c8a941820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1919773148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2rQz+6ZDuv+vQObblRHg4ZWHA3hYpYYtpWnyWh1pFEuTh8nxdKhgiu6EWUi+8rdZ2ebJq8AoIISpWTZ5ry7be/BBBzCrUbFup0wEpLxZJ3RiJ6nS6E+Mdf0axMCkz/Lw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:44.947553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f7045407-b802-4f28-ad0d-5c2a67184a38 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:44.961010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f7045407-b802-4f28-ad0d-5c2a67184a38 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Getting quotas for user 38260b1ea981446aa21d9e1ab0314f13 and project 4691f143479d4b5e877759fbcbe370d4. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:45.013901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7045407-b802-4f28-ad0d-5c2a67184a38 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.114780 Sep 23 03:50:45.017492 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1396/2704] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:50:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:45.035111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc03500d-d43d-45a6-b2f3-2e10b95698d0 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8a8cbc10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:45.042964 n-d-858495-2 devstack@n-api.service[128724]: WARNING oslo_db.sqlalchemy.utils [None req-fc03500d-d43d-45a6-b2f3-2e10b95698d0 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:50:45.078232 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc03500d-d43d-45a6-b2f3-2e10b95698d0 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.037088 Sep 23 03:50:45.083072 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1397/2705] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:50:45 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:45.117084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36c75f8e-173d-46c2-ad9c-80b7bf941860 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8a8d01f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:45.198741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36c75f8e-173d-46c2-ad9c-80b7bf941860 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1919773148" status: 202 len: 0 microversion: 2.1 time: 0.108494 Sep 23 03:50:45.200100 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1398/2706] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 03:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1919773148 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:50:45.209197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d13d25c-b2fd-4eaa-9240-befe78dfb1c1 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8b1b2820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:45.257995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d13d25c-b2fd-4eaa-9240-befe78dfb1c1 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1272408138" status: 202 len: 0 microversion: 2.1 time: 0.052933 Sep 23 03:50:45.260564 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1399/2707] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 03:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1272408138 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:45.274471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03215bad-2ca7-4ab9-ba02-8dab3b070ad8 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] Calling method '.version_select at 0x7f0c8a9414c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:45.313824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03215bad-2ca7-4ab9-ba02-8dab3b070ad8 tempest-KeyPairsV2TestJSON-1879059945 tempest-KeyPairsV2TestJSON-1879059945-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1391590203" status: 202 len: 0 microversion: 2.1 time: 0.043720 Sep 23 03:50:45.314737 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1400/2708] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 03:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1391590203 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:45.650995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:45.651666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:45.669823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:45.671276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:45.672551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:45.679121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:45.683901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:45.683901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:46.425032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:46.433793 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5eddccf7-bddf-4626-a667-10ea4f2a89b5 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1647 microversion: 2.1 time: 2.602033 Sep 23 03:50:46.439043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1309/2709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:43 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1647 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:46.444162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-570e577c-9c1d-4569-abaa-c06cf29abe00 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7d2ca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:46.565312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-570e577c-9c1d-4569-abaa-c06cf29abe00 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.122449 Sep 23 03:50:46.566718 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1310/2710] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:46 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:46.894747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2a14d7-7c74-420c-b7ec-18685e3bb192", "name": "network-vif-deleted", "tag": "57642fac-4b13-4997-92f8-550a5b4bde92"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:46.904884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:46.924120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4cc25261-6c68-46cc-88a0-15f747b3895f tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 1.279747 Sep 23 03:50:46.924982 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1401/2711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:45 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:47.008444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.009700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.010449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.055745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] Creating event network-vif-deleted:57642fac-4b13-4997-92f8-550a5b4bde92 for instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 on n-h2-858495-2 Sep 23 03:50:47.075138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-27f74e5d-e86b-4859-b3fa-ef4241ef3e7c req-64f67ce3-1dd1-4e00-bf2e-aa9267b25e7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221895 Sep 23 03:50:47.077056 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1311/2712] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:47.470683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:47.471317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:47.480424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.486737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.487406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.489100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.491480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.492790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.583734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b251f77c-10f0-46da-a36e-dd42b143a750 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7e8040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:47.595737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.596432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.596897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.597453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lazy-loading 'fault' on Instance uuid fd2a14d7-7c74-420c-b7ec-18685e3bb192 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:50:47.784492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b251f77c-10f0-46da-a36e-dd42b143a750 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.204857 Sep 23 03:50:47.801128 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1312/2713] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:47 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:47.805235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:47.830194 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90e64142-b041-4cfc-a18e-22c2ff0ebd99 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 200 len: 1306 microversion: 2.1 time: 0.355317 Sep 23 03:50:47.832320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:47.833317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:47.848661 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1402/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:47 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 1306 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:47.864180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.865190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.866612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.868870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e6bca3-caeb-477b-8b07-e65384e32c7a", "tag": "33bd7132-3bcc-4437-90c0-9a4f018ec3d4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:47.869633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.870906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.873601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.916019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:47.916569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:47.916980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:47.958377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] Creating event network-changed:33bd7132-3bcc-4437-90c0-9a4f018ec3d4 for instance c0e6bca3-caeb-477b-8b07-e65384e32c7a on n-h2-858495-2 Sep 23 03:50:47.991305 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6cbf0ee1-711a-42b9-959e-53b9f9ab95c3 req-a11c8d2b-5858-4a10-8cea-15758f25f861 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126633 Sep 23 03:50:47.991505 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1403/2715] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:50:48.006598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:48.007391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:48.061965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:48.062643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:48.065467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:48.066603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:48.067091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:48.067538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:49.192859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:49.201229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a098ab3-a6a0-4ad7-9be5-e891ed7c25db tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1589 microversion: 2.1 time: 1.379662 Sep 23 03:50:49.201901 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1313/2716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:47 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1589 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:49.216610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f710bb3f-b394-4395-91a2-69de3808c632 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c93490790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:49.313757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f710bb3f-b394-4395-91a2-69de3808c632 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.110676 Sep 23 03:50:49.314757 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1314/2717] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:49 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:49.333468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:49.334479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:49.356622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:49.357899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:49.359142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:49.360662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:49.361370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:49.364263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:49.400371 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 HTTP/1.1 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'fd2a14d7-7c74-420c-b7ec-18685e3bb192'} Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:49.409875 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:49.414649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3cf6f2fe-7dca-40ef-a599-d8f4d3fc9568 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 404 len: 111 microversion: 2.1 time: 0.094135 Sep 23 03:50:49.416435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1315/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:49 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:49.422668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d617fc49-62bc-4e45-a603-f3441f7b47a4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a7e81f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:49.783918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:49.800113 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b84970ca-fa08-4ac2-8831-14a5cbff4981 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 1.796762 Sep 23 03:50:49.801530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1404/2719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:47 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:50.350015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4acb8d3-3964-4993-843a-6f8e8b6b8043 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d0d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:50.482379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4acb8d3-3964-4993-843a-6f8e8b6b8043 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.149659 Sep 23 03:50:50.484595 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1405/2720] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:50 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:50:50.943725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c2821c53-3019-47a8-93d6-d45842846442 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8b10a670>, body: {"keypair": {"name": "tempest-keypair-345874343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnDJD8YdZaboeUedxSC1fqlbnxjjjfhGsCiusUU5G1oDkQPEJ2QOB0QsTMoHVzIpMINmPT0Po7MeH3yi17xIm5QWpwHs/DXgnkDFusgP4PX//IuiE/gEkw4/xJwvZ601g=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:50.984055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c2821c53-3019-47a8-93d6-d45842846442 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:51.013756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c2821c53-3019-47a8-93d6-d45842846442 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:51.090979 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c2821c53-3019-47a8-93d6-d45842846442 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.444120 Sep 23 03:50:51.095969 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1406/2721] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 452 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:51.107400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.117745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:51.143554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:51.145300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:51.150261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:51.151860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:51.152361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:51.152819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:51.415139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d617fc49-62bc-4e45-a603-f3441f7b47a4 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2" status: 202 len: 0 microversion: 2.1 time: 1.997838 Sep 23 03:50:51.415710 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1316/2722] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:49 2022] DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 => generated 0 bytes in 1999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:51.424441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98d9517d-2e3f-4952-9f6e-ccf79f9cc09e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b1fe820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.454814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98d9517d-2e3f-4952-9f6e-ccf79f9cc09e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-345874343" status: 200 len: 512 microversion: 2.2 time: 0.037042 Sep 23 03:50:51.459727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1317/2723] 10.222.0.25 () {60 vars in 1255 bytes} [Fri Sep 23 03:50:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-345874343 => generated 512 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:51.484237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93761317-c78b-41c9-a6a9-b51fdda00caa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a7e8040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.591606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:51.600360 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87220a50-665f-4c89-aa39-9cfa5e0a07a3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.502915 Sep 23 03:50:51.600905 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1407/2724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:51 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:51.618457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1007588d-87b8-4e1a-9d1e-112a423b7703 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b184e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.658467 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1007588d-87b8-4e1a-9d1e-112a423b7703 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345874343" status: 204 len: 0 microversion: 2.2 time: 0.056484 Sep 23 03:50:51.659055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1408/2725] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Sep 23 03:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345874343 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:51.672726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e95f2f8b-7491-4724-9d93-2c7aba531256 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d1f70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.763636 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e95f2f8b-7491-4724-9d93-2c7aba531256 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.100433 Sep 23 03:50:51.775703 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1409/2726] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:51 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:51.780667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d424be8-57e7-4af2-8d00-6d71f77e178a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a8d0af0>, body: {"keypair": {"name": "tempest-keypair-526779954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNxrfNWYPzCpFsxH50YLB2FXisp7fTIIM57qEhbHgIH/zU7hehdkXggNTWMhe2Nrd2Oon7P5JQ1LA34MgR0nd7nrPcqv7auvUg8aKWC3UwPf+KCbaydpZKhP6d0Fsx1Yw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:51.818953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0d424be8-57e7-4af2-8d00-6d71f77e178a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:51.830060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0d424be8-57e7-4af2-8d00-6d71f77e178a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:51.897251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d424be8-57e7-4af2-8d00-6d71f77e178a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.120000 Sep 23 03:50:51.898794 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1410/2727] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:51.916834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2187a318-8bf9-4d78-8fd3-0493091465ac tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a8d1550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:51.960283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2187a318-8bf9-4d78-8fd3-0493091465ac tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526779954" status: 204 len: 0 microversion: 2.2 time: 0.053195 Sep 23 03:50:51.962845 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1411/2728] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Sep 23 03:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526779954 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:51.980674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-769e52d5-dec7-4aee-a2b3-a9427d06e462 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a8e2f70>, body: {"keypair": {"name": "tempest-keypair-168456553", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:52.055545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-769e52d5-dec7-4aee-a2b3-a9427d06e462 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:52.068040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-769e52d5-dec7-4aee-a2b3-a9427d06e462 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:52.154252 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-769e52d5-dec7-4aee-a2b3-a9427d06e462 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.185039 Sep 23 03:50:52.156017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1412/2729] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:51 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:52.169306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7254c5b-2502-41b8-97d3-1ec693e22903 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a8e23a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:52.218862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93761317-c78b-41c9-a6a9-b51fdda00caa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02" status: 202 len: 0 microversion: 2.1 time: 0.757519 Sep 23 03:50:52.219557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1318/2730] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:51 2022] DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:52.219907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:52.234842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d1566f6-b596-4bc9-bf73-12453dddc6f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'create', calling method: .version_select at 0x7f0c8b79dc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1428108026", "description": "tempest-description-1375037040"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:52.247498 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7254c5b-2502-41b8-97d3-1ec693e22903 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-168456553" status: 204 len: 0 microversion: 2.2 time: 0.084271 Sep 23 03:50:52.259904 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1413/2731] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Sep 23 03:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-168456553 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:50:52.271523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2883b195-7dc7-4f55-8582-2bbd6e7cc63e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a8d10d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2010291547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy1SgLk14bQj3pvC2hR6cpjHjryF7CtvWqbQ66Es+l8M2eC+u2OYg/QQYmgVWzb7VJarLVDmpoBCxDB0cNty483jpq6w7kE5OfNNszhzmnGoh+t/E6OwBSxkbvfEmNQ/Q=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:52.332385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-2883b195-7dc7-4f55-8582-2bbd6e7cc63e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:52.354616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-2883b195-7dc7-4f55-8582-2bbd6e7cc63e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:52.435701 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2883b195-7dc7-4f55-8582-2bbd6e7cc63e tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.169766 Sep 23 03:50:52.439672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1414/2732] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:52 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:52.773863 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d1566f6-b596-4bc9-bf73-12453dddc6f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.543622 Sep 23 03:50:52.775235 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1319/2733] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:50:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:52.797421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2a0c594-10d6-4aa6-b2ca-7d4b3984e23a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a7e3c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-482607806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrU53f7eMr3l/WTVaiOnR//vauIUWRZREBmnvQDmpZKA792iqNnxeRn2A0YRyfoSXEvlNLc8rQs8QaSzwXzo/Fa+mdpi5JdSljIlS3yG6gxzBAODQ9KE9EIGDc4/LEHFw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:52.909968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f2a0c594-10d6-4aa6-b2ca-7d4b3984e23a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:52.924782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f2a0c594-10d6-4aa6-b2ca-7d4b3984e23a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:52.978621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2a0c594-10d6-4aa6-b2ca-7d4b3984e23a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.198859 Sep 23 03:50:52.993979 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1320/2734] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:52 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:53.006983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:53.009603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:53.022037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:53.024524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:53.026467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:53.028907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:53.032193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:53.035029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:53.278998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2146692823", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1437a479-489a-4171-8416-a7aa7032bc4d"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:53.423908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] validate_networks() for [('1437a479-489a-4171-8416-a7aa7032bc4d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:50:53.496560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:53.508359 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24a344d1-b0c0-4aad-b8bd-0e0d0c025c5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.510754 Sep 23 03:50:53.509312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1321/2735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:52 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:53.520001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c2c7fb3-7ea2-42d8-9072-a783ae214d92 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a839670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:53.583853 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c2c7fb3-7ea2-42d8-9072-a783ae214d92 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.073307 Sep 23 03:50:53.585151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1322/2736] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:53 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:53.602740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6b717b7-2a60-4bb2-b796-5be7e3d3be41 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Action: 'update', calling method: .version_select at 0x7f0c8a7d6f70>, body: {"security_group": {"name": "tempest-sg-hth-1161556657", "description": "tempest-description-hth-271714002"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:54.147620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6b717b7-2a60-4bb2-b796-5be7e3d3be41 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8" status: 200 len: 217 microversion: 2.1 time: 0.548868 Sep 23 03:50:54.148563 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1323/2737] 10.222.0.25 () {60 vars in 1290 bytes} [Fri Sep 23 03:50:53 2022] PUT /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8 => generated 217 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:54.155477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4209b35-1a02-4bff-a68f-17a4c06611dc tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a7e8310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2138969767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxVeUgQx76zdiTTJ2+qqNv1iJmzIUtXsKVfYpVZHzeknrkb8qqCX689VLBvZS9sG6kspEGdZWGSZ5mfug9r6fx2kIvzZkOkAuRcX4RwJq0OpjuIQYqWG48+sfYD1xbEhQ=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:54.227297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d4209b35-1a02-4bff-a68f-17a4c06611dc tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:54.246780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d4209b35-1a02-4bff-a68f-17a4c06611dc tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:54.304131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4209b35-1a02-4bff-a68f-17a4c06611dc tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.152800 Sep 23 03:50:54.305628 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1324/2738] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:54 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:54.320347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2de8be70-5ae3-4643-97cd-d6382af4696b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a7e8040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.416674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2de8be70-5ae3-4643-97cd-d6382af4696b tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8" status: 200 len: 217 microversion: 2.1 time: 0.109945 Sep 23 03:50:54.417572 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1325/2739] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:50:54 2022] GET /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8 => generated 217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:54.430848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9eb25ac4-2b38-467c-bfec-36d6e9c084b3 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b3ec700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.435740 n-d-858495-2 devstack@n-api.service[128723]: WARNING oslo_db.sqlalchemy.utils [None req-9eb25ac4-2b38-467c-bfec-36d6e9c084b3 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:50:54.447075 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9eb25ac4-2b38-467c-bfec-36d6e9c084b3 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.028107 Sep 23 03:50:54.450123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1326/2740] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Sep 23 03:50:54 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:54.480037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-03527ae6-e443-43ac-93a2-a6dffedda428 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a7d6d30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.535111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:50:54.536259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:50:54.536951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:50:54.537672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:50:54.538327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:50:54.552003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.553524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:54.558389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:54.559531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.560238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:54.560902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:54.611678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Getting quotas for project cc7903a3610044f78837f466cb02607c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:54.631458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Getting quotas for user 1d6e5b387939455090625f78736f9748 and project cc7903a3610044f78837f466cb02607c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:54.664339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:50:54.671241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:50:54.805134 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-03527ae6-e443-43ac-93a2-a6dffedda428 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8" status: 202 len: 0 microversion: 2.1 time: 0.351844 Sep 23 03:50:54.806154 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1327/2741] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:54 2022] DELETE /compute/v2.1/os-security-groups/b6f5bc2f-d7b5-48fc-a5e2-d96c8929c0e8 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:50:54.808505 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62913cb6-629a-453b-9669-ddce2f67fb0d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359774 Sep 23 03:50:54.815971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fab6ecd1-9169-48b8-ab7e-699de98ec860 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a7e91f0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.829467 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1415/2742] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:50:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:50:54.837477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.839145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:54.854004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fab6ecd1-9169-48b8-ab7e-699de98ec860 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138969767" status: 204 len: 0 microversion: 2.2 time: 0.045881 Sep 23 03:50:54.856198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1328/2743] 10.222.0.25 () {60 vars in 1321 bytes} [Fri Sep 23 03:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138969767 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:54.862438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6bddd391-56f4-493f-bf46-00816a7ca19a tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7d6dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.866688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.867901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:54.869833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:54.871732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.894488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:54.894961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:54.954176 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6bddd391-56f4-493f-bf46-00816a7ca19a tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.096576 Sep 23 03:50:54.955095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1329/2744] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:54 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:54.960001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:54.960501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:54.982395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.983706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:54.984539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:54.985620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:54.986842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:55.002077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:55.064781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 HTTP/1.1 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'fd2a14d7-7c74-420c-b7ec-18685e3bb192'} Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:55.066398 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:55.070645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f3381f9-d8fc-4cb1-a40a-48cfae271c34 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 404 len: 111 microversion: 2.1 time: 0.111750 Sep 23 03:50:55.082023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1330/2745] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:54 2022] DELETE /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:55.099977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05526667-e22f-4191-9856-1bd09ee7a645 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.100615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05526667-e22f-4191-9856-1bd09ee7a645 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:55.221567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05526667-e22f-4191-9856-1bd09ee7a645 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:55.239542 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05526667-e22f-4191-9856-1bd09ee7a645 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1225 microversion: 2.1 time: 0.138803 Sep 23 03:50:55.245778 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1331/2746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:55 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:55.256908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e95c89ac-9742-4732-b072-aab2aa7b87ab tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b169e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.350318 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e95c89ac-9742-4732-b072-aab2aa7b87ab tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-482607806" status: 204 len: 0 microversion: 2.2 time: 0.102058 Sep 23 03:50:55.352553 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1332/2747] 10.222.0.25 () {60 vars in 1318 bytes} [Fri Sep 23 03:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-482607806 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:55.353433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:55.363644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76180294-bc3f-4513-baa2-04e79aa9bc15 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.532091 Sep 23 03:50:55.366631 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1416/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:54 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:55.379335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-74307612", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "74b012df-a8e1-46a0-804a-813c35e271f3"}], "security_groups": [{"name": "tempest-securitygroup--2007228785"}], "key_name": "tempest-keypair-1924589938", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ae817b59-b928-4858-a2b1-1e36875d7ed8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:55.385395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.390733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: fd2a14d7-7c74-420c-b7ec-18685e3bb192] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:55.406881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:55.407384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:55.407831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:55.408548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:55.409012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:55.409478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:55.481922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 HTTP/1.1 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'fd2a14d7-7c74-420c-b7ec-18685e3bb192'} Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.485814 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Instance fd2a14d7-7c74-420c-b7ec-18685e3bb192 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1458aefa-b056-4ac7-9bc0-cce713ce7111 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192" status: 404 len: 111 microversion: 2.1 time: 0.134507 Sep 23 03:50:55.490801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1333/2749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:55 2022] GET /compute/v2.1/servers/fd2a14d7-7c74-420c-b7ec-18685e3bb192 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:55.495125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea9c768c-72be-4999-9424-b20a79134b49 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b3ecca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.531398 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea9c768c-72be-4999-9424-b20a79134b49 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2010291547" status: 204 len: 0 microversion: 2.2 time: 0.041277 Sep 23 03:50:55.531993 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1334/2750] 10.222.0.25 () {60 vars in 1321 bytes} [Fri Sep 23 03:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2010291547 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:55.560810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a7e1dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.672383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:55.673057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:55.674049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.674049 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02 HTTP/1.1 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd7f6240c-049f-43ab-8dd7-f2cf1a170a02'} Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:55.675911 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group d7f6240c-049f-43ab-8dd7-f2cf1a170a02 does not exist Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-988bdaf1-1eca-4c16-bbf0-18f4b8abe20e'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ffa4b776-704c-4b16-88e4-bcce4ab105ea tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02" status: 404 len: 194 microversion: 2.1 time: 0.130123 Sep 23 03:50:55.680951 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1335/2751] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:55 2022] DELETE /compute/v2.1/os-security-groups/d7f6240c-049f-43ab-8dd7-f2cf1a170a02 => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:55.693442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1af27ab3-0c77-49de-9812-75e70f43e2aa tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8a7e1700>, body: {"keypair": {"name": "tempest-keypair-1894055802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7JGPCqQCxIZ/KrHucp+ispWylEUXf3oYWYzbrX0nj4ZjXEvqgND97iu9weQ0gnqStH51b4HQWs/k7giZkWW21yW1Pz/r6ys0lsPYhhELZ40zM2k0hGp+LL45mNC2w04w=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:55.751597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1af27ab3-0c77-49de-9812-75e70f43e2aa tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:55.754419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:50:55.771532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1af27ab3-0c77-49de-9812-75e70f43e2aa tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:55.804258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] validate_networks() for [('74b012df-a8e1-46a0-804a-813c35e271f3', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:50:55.835682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1af27ab3-0c77-49de-9812-75e70f43e2aa tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.155652 Sep 23 03:50:55.839009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1336/2752] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Sep 23 03:50:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 03:50:55.852142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b3ecee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:55.994885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:55.995794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:55.996542 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:55.996542 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 HTTP/1.1 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2'} Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:55.999269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] Sep 23 03:50:56.002882 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.008066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 does not exist Sep 23 03:50:56.008066 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c02c1060-1cf3-4d99-83ad-2ff90087d2f1'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:56.009280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4b146d0-0e0e-4582-8d0d-cdf08594e9f2 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2" status: 404 len: 194 microversion: 2.1 time: 0.168949 Sep 23 03:50:56.010958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1337/2753] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:55 2022] DELETE /compute/v2.1/os-security-groups/286ae2bb-822d-4cd5-b8cf-a7cb3504c3c2 => generated 194 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:56.022431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74f5ce75-3f94-4bb1-b6eb-c43083bc6610 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a839d30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.048597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74f5ce75-3f94-4bb1-b6eb-c43083bc6610 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1894055802" status: 200 len: 513 microversion: 2.2 time: 0.036206 Sep 23 03:50:56.049606 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1338/2754] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Sep 23 03:50:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1894055802 => generated 513 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:56.069321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e0dc478-c41b-499f-9d32-e56812c1e597 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b259160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.134166 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e0dc478-c41b-499f-9d32-e56812c1e597 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1424 microversion: 2.1 time: 0.071983 Sep 23 03:50:56.144833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1339/2755] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:56 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:56.149883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b848280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.208341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:56.209446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 4dbe8688-9144-463e-b578-4625c23923a7 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7 HTTP/1.1 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4dbe8688-9144-463e-b578-4625c23923a7'} Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:56.239287 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 4dbe8688-9144-463e-b578-4625c23923a7 does not exist Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-86eaadb6-6cbe-485f-b881-f4b8f8fe825f'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e448e1ea-bba6-4647-ba0e-64b6107e4744 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7" status: 404 len: 194 microversion: 2.1 time: 0.067983 Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1340/2756] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:56 2022] DELETE /compute/v2.1/os-security-groups/4dbe8688-9144-463e-b578-4625c23923a7 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e26b1c44-f03c-40a7-b1bf-6c7b1fef1b65 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a7e9160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.243864 n-d-858495-2 devstack@n-api.service[128723]: WARNING oslo_db.sqlalchemy.utils [None req-e26b1c44-f03c-40a7-b1bf-6c7b1fef1b65 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:50:56.247736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e26b1c44-f03c-40a7-b1bf-6c7b1fef1b65 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016745 Sep 23 03:50:56.247736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1341/2757] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Sep 23 03:50:56 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:56.257064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a9d2a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.316044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:56.316806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 89e2dc85-800f-4bc3-833f-96b176978d43 not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:56.317621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.317621 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43 HTTP/1.1 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '89e2dc85-800f-4bc3-833f-96b176978d43'} Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:56.319818 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 89e2dc85-800f-4bc3-833f-96b176978d43 does not exist Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-c56c7287-91a6-46ea-9b40-e8bee548e9dd'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:56.324762 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-92a7a446-958a-44a2-9fbd-03219209a219 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43" status: 404 len: 194 microversion: 2.1 time: 0.071466 Sep 23 03:50:56.330833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1342/2758] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:56 2022] DELETE /compute/v2.1/os-security-groups/89e2dc85-800f-4bc3-833f-96b176978d43 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:56.338538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48122321-e93c-412f-96cb-ec20c0b5b99a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a7e90d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.386005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48122321-e93c-412f-96cb-ec20c0b5b99a tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894055802" status: 204 len: 0 microversion: 2.2 time: 0.056220 Sep 23 03:50:56.390788 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1343/2759] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Sep 23 03:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894055802 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:56.396361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.398008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:56.416147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:56.418296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:56.418728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:56.419925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:56.423303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:56.424930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:56.652927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:56.675170 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6696a119-b731-4b78-a37e-41eb2099f47c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1277 microversion: 2.1 time: 0.284609 Sep 23 03:50:56.676188 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1344/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:56 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:56.690004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b848f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.829246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:56.830090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:56.831049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.831049 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa HTTP/1.1 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa'} Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:56.833640 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa does not exist Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-3fd78922-0d09-4acb-8466-2a929de19a7f'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:56.837377 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a2f5589-8796-4edd-8754-505787a346f1 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa" status: 404 len: 194 microversion: 2.1 time: 0.157709 Sep 23 03:50:56.840487 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1345/2761] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:56 2022] DELETE /compute/v2.1/os-security-groups/2b116756-4eb8-45ee-8d8f-1ae68d2fd6aa => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:56.851200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:56.851890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:56.867923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:56.868162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:56.868617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:56.869441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:56.869847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:56.870287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:56.959280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:56.979897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for user f3a3a03385ba4c54972c7fbf55dc867b and project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:57.015120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:50:57.020448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:50:57.022880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:50:57.023582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:50:57.025734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:50:57.049829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:57.050738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:57.051419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:57.052652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:57.054551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:57.057277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:57.086278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:57.109017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b44da4a6-08de-4a0a-9f4f-ec15848d44df tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.268775 Sep 23 03:50:57.110787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:57.111286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1346/2762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:56 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:57.121947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Action: 'create', calling method: .version_select at 0x7f0c8b169d30>, body: {"keypair": {"name": "tempest-keypair-1902672726", "type": "x509"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:57.137125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Getting quotas for user f3a3a03385ba4c54972c7fbf55dc867b and project 2e44577f9f2d4ae3a0301069b9b6ae2b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:57.181445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:57.194849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:57.247233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.processutils [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpllux37oy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpllux37oy/temp.key -subj /CN=d9da74fbb1504e1291269d90873374a7 -extensions v3_req_client {{(pid=128723) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 23 03:50:57.271466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:50:57.273869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae817b59-b928-4858-a2b1-1e36875d7ed8',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:50:57.572793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36958fce-c627-4995-bdeb-a7029d2cc37d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.202880 Sep 23 03:50:57.579946 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1417/2763] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:50:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:50:57.589815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8a8e29d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:57.721712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:50:57.722326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Neutron security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:50:57.722971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.722971 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 HTTP/1.1 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3be74278-6851-4fa4-afa1-4be4c3ddb7a8'} Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:50:57.726082 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] Sep 23 03:50:57.730565 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:50:57.735171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Security group 3be74278-6851-4fa4-afa1-4be4c3ddb7a8 does not exist Sep 23 03:50:57.735171 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-8d19e99f-a666-4c84-9ebd-272b54f9537a'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:50:57.736993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9125e24b-9e15-4d17-a02c-ad522518cc06 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8" status: 404 len: 194 microversion: 2.1 time: 0.155567 Sep 23 03:50:57.737750 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1418/2764] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:50:57 2022] DELETE /compute/v2.1/os-security-groups/3be74278-6851-4fa4-afa1-4be4c3ddb7a8 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:50:57.744553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e2361e6-5d67-450d-b348-79e2a4b63dc7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b263e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:57.832567 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e2361e6-5d67-450d-b348-79e2a4b63dc7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1433 microversion: 2.1 time: 0.092278 Sep 23 03:50:57.834375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1419/2765] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:57 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:57.837658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.processutils [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpllux37oy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpllux37oy/temp.key -subj /CN=d9da74fbb1504e1291269d90873374a7 -extensions v3_req_client" returned: 0 in 0.590s {{(pid=128723) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 23 03:50:57.839353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.processutils [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpllux37oy/temp.key -password pass: {{(pid=128723) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 23 03:50:57.848788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6818f957-871d-4e1e-a35a-511198b4a813 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:57.850003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6818f957-871d-4e1e-a35a-511198b4a813 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:57.928471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.processutils [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpllux37oy/temp.key -password pass:" returned: 0 in 0.088s {{(pid=128723) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 23 03:50:57.968752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6818f957-871d-4e1e-a35a-511198b4a813 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:57.990303 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6818f957-871d-4e1e-a35a-511198b4a813 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1120 microversion: 2.1 time: 0.152940 Sep 23 03:50:58.017938 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1420/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:57 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1120 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.034231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.039990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:58.058561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.060265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.060647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.063458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:50:58.063881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.064580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.065942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.085009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Getting quotas for user d9da74fbb1504e1291269d90873374a7 and project c203aec22053430ab7a9918707e33550. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:50:58.141489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7613022c-ef5b-400d-b707-c180de9fcfbd tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.028802 Sep 23 03:50:58.144465 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1347/2767] 10.222.0.25 () {62 vars in 1198 bytes} [Fri Sep 23 03:50:57 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1032 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:58.161531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.162131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:58.173762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.174726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.175488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.177242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.177973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.178763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.217540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:50:58.347954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:58.364437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3c53a14-23f1-4bb9-9641-f448aa5483a3 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1283 microversion: 2.1 time: 0.343807 Sep 23 03:50:58.366329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1421/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1283 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.375753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8c9a08d-1600-46ca-a1ba-7b52eb9777e5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8e25e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.390217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39583e29-b9f0-4a62-b619-ddfaf4d56a31 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 204 len: 0 microversion: 2.1 time: 0.242591 Sep 23 03:50:58.393179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1348/2769] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:50:58 2022] DELETE /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:50:58.400478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8", "name": "network-vif-plugged", "status": "completed", "tag": "57af964f-eebb-4fff-8519-ac4601e7442b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:50:58.414835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.415553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.416149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.435378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] Creating event network-vif-plugged:57af964f-eebb-4fff-8519-ac4601e7442b for instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 on n-h2-858495-2 Sep 23 03:50:58.449044 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9e0c63cc-b2d4-4e26-86be-0a7fff96cf34 req-0699d76c-11a8-4505-8f04-8942f1d6f213 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054340 Sep 23 03:50:58.449700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1349/2770] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:58.461186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.466094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:58.466395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8c9a08d-1600-46ca-a1ba-7b52eb9777e5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 200 len: 1433 microversion: 2.1 time: 0.097681 Sep 23 03:50:58.466976 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1422/2771] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 1433 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.477739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-457d0b8c-3630-48b0-bc0d-02f1b2e244e7 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a8d0af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.481956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.482455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.484478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.485717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.486438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.487033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.512975 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-457d0b8c-3630-48b0-bc0d-02f1b2e244e7 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1902672726" status: 200 len: 1534 microversion: 2.2 time: 0.041462 Sep 23 03:50:58.513599 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1423/2772] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1902672726 => generated 1534 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.533289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.533936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:58.544187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.545509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.545509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.545800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.546254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.546682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.900470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:58.913383 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b749aa2-9c2c-40a5-b0ca-43e081690d5c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.462303 Sep 23 03:50:58.914818 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1350/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.920517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.921333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:58.939578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.940318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.941536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.942790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:58.944164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:58.945000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:58.963667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:58.975483 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0dd122ec-1a69-47b7-a6c7-0508bf4a5c1d tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1648 microversion: 2.1 time: 0.446579 Sep 23 03:50:58.976759 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1424/2774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1648 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:58.983044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aad3dc72-cbf4-4a21-aa13-77d1d1ca5566 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8a8d7e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:58.987686 n-d-858495-2 devstack@n-api.service[128724]: WARNING oslo_db.sqlalchemy.utils [None req-aad3dc72-cbf4-4a21-aa13-77d1d1ca5566 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:50:58.993266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aad3dc72-cbf4-4a21-aa13-77d1d1ca5566 tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015314 Sep 23 03:50:58.994440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1425/2775] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:59.006359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad1b771f-a12a-4aa2-9563-1aa02d6d765f tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] Calling method '.version_select at 0x7f0c8b0ff3a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.030703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad1b771f-a12a-4aa2-9563-1aa02d6d765f tempest-KeyPairsV22TestJSON-879907504 tempest-KeyPairsV22TestJSON-879907504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902672726" status: 204 len: 0 microversion: 2.2 time: 0.028880 Sep 23 03:50:59.031749 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1426/2776] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Sep 23 03:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902672726 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:50:59.038267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.039031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:59.048540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.049267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.050597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:59.051386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.051922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.052435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:59.184402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:59.211361 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-351c613b-2c18-4e2d-87b2-188f1c64237c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1218 microversion: 2.1 time: 0.178142 Sep 23 03:50:59.226289 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1427/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:59 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:59.264697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:59.273064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-461a3802-48ac-42d0-b142-ceb300650bf5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1466 microversion: 2.1 time: 0.356708 Sep 23 03:50:59.273699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1351/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:58 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1466 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:59.296522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-968988d5-6ae0-48c4-a2de-f1a869fb053c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b5f4430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.346061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-968988d5-6ae0-48c4-a2de-f1a869fb053c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda" status: 200 len: 784 microversion: 2.1 time: 0.053971 Sep 23 03:50:59.346956 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1428/2779] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:50:59 2022] GET /compute/v2.1/images/e4f75334-b417-4681-8bb0-50f45fb07fda => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:59.372390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c701a353-4448-4617-a84c-1eb557bc915e tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.383582 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c701a353-4448-4617-a84c-1eb557bc915e tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023717 Sep 23 03:50:59.384213 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1352/2780] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:50:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:50:59.396243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.398483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16f01d1b-e4a9-4930-92e0-4d6f7cfa66ee tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b1fe310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.400739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:59.415159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.416678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.419109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:59.420438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.421208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.423487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:59.616513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:50:59.630467 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2cc5771-0f8b-4ed4-ad31-b08eef52b89c tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.241587 Sep 23 03:50:59.631598 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1429/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:59 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:50:59.943005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:50:59.943931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:50:59.954688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.957964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.959739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:50:59.963248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:50:59.964238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:50:59.966417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:00.342638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:00.359732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3cb2667-3f93-4533-93eb-1e8eb347a4d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1313 microversion: 2.1 time: 0.422003 Sep 23 03:51:00.361040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1430/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:59 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:00.368256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:00.369542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:00.377850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:00.378771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:00.379374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:00.380622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:00.381508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:00.382112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:00.591305 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16f01d1b-e4a9-4930-92e0-4d6f7cfa66ee tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "DELETE /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 204 len: 0 microversion: 2.1 time: 1.197491 Sep 23 03:51:00.593009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1353/2783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:50:59 2022] DELETE /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:51:00.599514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:00.600430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:00.615505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:00.618884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:00.619439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:00.620429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:00.622612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:00.623301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:01.491135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:01.516382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35421873-8adb-4a46-92e6-b19e504f154e tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1226 microversion: 2.1 time: 0.921928 Sep 23 03:51:01.535515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1354/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:00 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1226 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:01.553903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2768130a-ab43-4790-9bf3-e22a71fe7ad8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b169e50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:01.590202 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2768130a-ab43-4790-9bf3-e22a71fe7ad8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] HTTP exception thrown: Image not found. Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2768130a-ab43-4790-9bf3-e22a71fe7ad8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Request method failure captured: Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 HTTP/1.1 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzcVfFBnL2uEC91Fy2D-p5P2rdxgWqGTSJYKiiDpgGJdM7fbPPUHxRPgn5aHspO6r4pkUpzKi5GjrO_OXqv8XQndAgAFIXNs7cJZuxdD2ARSf4Z5iygXBjy3GNL248eOaCq67-CZodH-EA06gwTLQtMRGFHj4OE8wazjehlYxbAfxU Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: ee608439593f49a1a368a26f8beb3eb8 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6e5ec345-8f0e-4b07-b54d-0d2a01807440'} Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6e5ec345-8f0e-4b07-b54d-0d2a01807440 Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:51:01.596432 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e5ec345-8f0e-4b07-b54d-0d2a01807440 could not be found. Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:51:01.601779 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:01.608473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2768130a-ab43-4790-9bf3-e22a71fe7ad8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:01.611417 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2768130a-ab43-4790-9bf3-e22a71fe7ad8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 404 len: 62 microversion: 2.1 time: 0.070524 Sep 23 03:51:01.613753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1355/2785] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:01 2022] GET /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:51:01.626201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:01.634356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:01.652650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:01.653668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:01.657502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:01.658722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:01.659420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:01.660081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:01.845073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:01.865711 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86c9c99f-0250-4e9a-ae05-ebb84ee15278 tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1648 microversion: 2.1 time: 1.500481 Sep 23 03:51:01.866751 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1431/2786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:00 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1648 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:01.878480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0682afe-60fd-42cb-bc0d-e36592e2a564", "name": "network-vif-deleted", "tag": "dc76eac9-ee54-4d3b-af63-a50f59674ae6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:01.906061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:01.908443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:01.909370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:01.921675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:01.949170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] Creating event network-vif-deleted:dc76eac9-ee54-4d3b-af63-a50f59674ae6 for instance e0682afe-60fd-42cb-bc0d-e36592e2a564 on n-h1-858495-2 Sep 23 03:51:01.961993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-95f97441-e040-4a61-b2aa-75590174451f req-e2a017c5-52d7-4222-8737-f3f66d65c047 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091598 Sep 23 03:51:01.963669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1432/2787] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:01.971986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:01.977779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:01.997595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:01.998102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.003277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:02.003767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.006662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.007170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.007613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.022463 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58ffd628-f439-4739-a0ae-7f8981cc7759 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.407346 Sep 23 03:51:02.027547 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1356/2788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:01 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:02.042292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-853686397"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:02.044839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:02.067358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.068007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.068464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.070169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.070637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.071072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.484630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:02.526945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d35efd4-63c0-403f-8192-95bc2508277f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "POST /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.497861 Sep 23 03:51:02.528859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1357/2789] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:02 2022] POST /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:51:02.536258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:02.551249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.552413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.553098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.567892 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] Creating event network-vif-unplugged:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:51:02.573836 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-548b0cad-007f-4d3a-91e2-5250e6205d51 req-d1c824db-cd62-4400-b5ad-8dc1253f3cda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042473 Sep 23 03:51:02.578382 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1358/2790] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:02.585861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd047e79-9e8b-4cb7-b3e2-1f1b692a8141", "tag": "9ec8164d-17b4-4e05-9dc6-7bb573c2a224"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:02.597875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.599023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.599628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.614806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] Creating event network-changed:9ec8164d-17b4-4e05-9dc6-7bb573c2a224 for instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 on n-h1-858495-2 Sep 23 03:51:02.621505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b6c7f39b-79d0-47f0-87e5-3d2d6fc7d729 req-de07b6b2-b7fc-4222-bd5a-237a6e93479b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041284 Sep 23 03:51:02.622453 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1359/2791] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:02.630685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8261d535-739d-4e9e-90d8-3761969bfe33 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7d2ee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:02.755667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8261d535-739d-4e9e-90d8-3761969bfe33 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.128974 Sep 23 03:51:02.757273 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1360/2792] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:02 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:02.763520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:02.765790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:02.779919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.780412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.780853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.781735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:02.783146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.783505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.784325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.794111 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7999c334-f71c-42c7-8ea7-eca0a75ad7cd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1462 microversion: 2.1 time: 0.828619 Sep 23 03:51:02.796000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1433/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:01 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1462 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:02.922831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:02.940450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcaf811a-9da0-4190-b0f7-46ad18eac04f tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1236 microversion: 2.1 time: 0.181907 Sep 23 03:51:02.941418 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1361/2794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:02 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1236 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:02.946293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:02.947157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:02.963806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.964703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.965474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:02.966437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:02.967160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:02.967816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.057436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.058133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.059422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.061715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lazy-loading 'fault' on Instance uuid e0682afe-60fd-42cb-bc0d-e36592e2a564 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:51:03.168556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad7dd5d0d4715b21e6777c2b3fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac755d23fcc4ec08edc0a67571fea93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:03.181649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4b8e1fa-5834-4358-a6b1-a932e83d82ca tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 200 len: 1306 microversion: 2.1 time: 0.238122 Sep 23 03:51:03.193695 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1362/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:02 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:03.201663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:03.202537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:03.217327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.218108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.218528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.219253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.219767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.220253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.346819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:03.356517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'deleted': False, 'project_id': '1eaaa9ca54eb43a790b03ae733b0c45b'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:03.372374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.373934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.374630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.375870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.376708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.377449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.521126 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-467e81ce-b616-40be-b59b-a41f5b7f1527 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.695882 Sep 23 03:51:03.541440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1434/2796] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:51:02 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:51:03.549879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:03.558166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'deleted': False} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:03.565872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.566484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.567014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.567922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.568452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.569461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.639059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:03.648378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14837ef9-b48e-4432-8810-c280b42dae58 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.453229 Sep 23 03:51:03.657906 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1363/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:03 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:03.713478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:51:03.773209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e3faf77-2cdb-4d23-999c-90cc78590c58 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c90219a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:03.832574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.833164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.834084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.850560 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e3faf77-2cdb-4d23-999c-90cc78590c58 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.081287 Sep 23 03:51:03.857052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1364/2798] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:03 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:03.975377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:03.976534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:03.991908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.993845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.994766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:03.996723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:03.997629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:03.999879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:04.604308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:04.621733 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4e2a6bf-1dde-4eac-baf6-4da25d5b7bf0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1304 microversion: 2.1 time: 0.652704 Sep 23 03:51:04.622594 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1365/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:03 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1304 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:04.634846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:04.639501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] [instance: e0682afe-60fd-42cb-bc0d-e36592e2a564] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:04.649406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:04.650593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:04.651439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:04.652456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:04.653867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:04.655368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:04.694705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] HTTP exception thrown: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Request method failure captured: Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 HTTP/1.1 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSyWz3cjPANyhqQZboKaaY20dD808nRWekaFJ8Qf3lJK9R9O0oPmdcdRDAiyB9ttF-QXCZBp-6AaCrhep0fXqbyRzuFLCbmCjYMlu_c3lNZ4OgXEJFzdrf8T9XKUoV1E8VFwX50gzfe_fV0DH__6z6iw2mmxEHeaf2F4j6EBys2zMpk Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ac755d23fcc4ec08edc0a67571fea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6ac755d23fcc4ec08edc0a67571fea93 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295633755 Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 252ad7dd5d0d4715b21e6777c2b3fa3f Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsTestJSON-1295633755-project Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e0682afe-60fd-42cb-bc0d-e36592e2a564'} Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:04.696896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. Sep 23 03:51:04.700726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:04.703372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Returning 404 to user: Instance e0682afe-60fd-42cb-bc0d-e36592e2a564 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:04.704908 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38402abb-2f0b-43f9-8560-386af1306baa tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564" status: 404 len: 111 microversion: 2.1 time: 0.080712 Sep 23 03:51:04.706303 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1366/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:04 2022] GET /compute/v2.1/servers/e0682afe-60fd-42cb-bc0d-e36592e2a564 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:51:04.714296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:04.717540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:04.740137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:04.742284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:04.744574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:04.745845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:04.749936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:04.750483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:04.964971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e494c26-40fb-45b3-95d5-41a90dad0fa2 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11203 microversion: 2.1 time: 1.420004 Sep 23 03:51:04.966250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1435/2801] 10.222.0.25 () {58 vars in 1171 bytes} [Fri Sep 23 03:51:03 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11203 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:51:04.972076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdda5f46-6562-4bf8-aeef-69c17b16515a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b8014c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:05.179805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:05.205928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7eaaf16-c56e-4e62-87b2-95e0a894d5b6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.486135 Sep 23 03:51:05.217420 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1367/2802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:04 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:05.217420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e69b200-bd37-4363-a114-7a2e2017d54c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7de9d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:05.271943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e69b200-bd37-4363-a114-7a2e2017d54c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.063752 Sep 23 03:51:05.273971 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1368/2803] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:05 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:05.283856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:05.297793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'deleted': False, 'project_id': '1eaaa9ca54eb43a790b03ae733b0c45b'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:05.311901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:05.312400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:05.312865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:05.313663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:05.314141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:05.314540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:05.470951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b21bb65a-4408-4944-afb7-ee3af95494cb tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=c385317083c24b2cae54ebc64c19610e" status: 200 len: 15 microversion: 2.1 time: 0.195616 Sep 23 03:51:05.472247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1369/2804] 10.222.0.25 () {58 vars in 1231 bytes} [Fri Sep 23 03:51:05 2022] GET /compute/v2.1/servers/detail?tenant_id=c385317083c24b2cae54ebc64c19610e => generated 15 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:51:05.497274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:05.507338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'tenant_id': 'c385317083c24b2cae54ebc64c19610e', 'deleted': False} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:05.513626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:05.514355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:05.515012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:05.516115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:05.516812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:05.517501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:05.576808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:51:05.697332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:05.699519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:05.701939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:06.013035 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fdda5f46-6562-4bf8-aeef-69c17b16515a tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/756803e8-3375-4fb3-b328-d8c24157ce94" status: 202 len: 0 microversion: 2.1 time: 1.044243 Sep 23 03:51:06.015286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1436/2805] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:51:04 2022] DELETE /compute/v2.1/os-security-groups/756803e8-3375-4fb3-b328-d8c24157ce94 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:51:06.027908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:06.034196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:06.057323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:06.063288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:06.065022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:06.066328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:06.067074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:06.068849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:06.215939 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe89b906-d778-406b-9617-fa68069f3223 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c385317083c24b2cae54ebc64c19610e" status: 200 len: 4824 microversion: 2.1 time: 0.723737 Sep 23 03:51:06.216362 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1370/2806] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 03:51:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c385317083c24b2cae54ebc64c19610e => generated 4824 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:06.230435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbaf8747-5483-4b2a-a634-2fdc2486f71f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] Calling method '.version_select at 0x7f0c8b1ed790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:07.018690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:07.037202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92806113-78be-4ebd-9c5a-5451c0b86561 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1304 microversion: 2.1 time: 1.020367 Sep 23 03:51:07.045619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1437/2807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:06 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1304 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:07.045619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:07.045619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:07.063507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.064012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.064663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.065581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.066204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.066644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.604903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbaf8747-5483-4b2a-a634-2fdc2486f71f tempest-SecurityGroupsTestJSON-1295633755 tempest-SecurityGroupsTestJSON-1295633755-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/58602791-2995-4407-ad9b-a570797a4fad" status: 202 len: 0 microversion: 2.1 time: 1.387378 Sep 23 03:51:07.606133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1371/2808] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:51:06 2022] DELETE /compute/v2.1/os-security-groups/58602791-2995-4407-ad9b-a570797a4fad => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:51:07.614002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:07.625815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:07.636663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'tenant_id': '1eaaa9ca54eb43a790b03ae733b0c45b', 'deleted': False} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:07.642961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbe36d0d-4bae-44f0-bbd2-19b1f314a6f6 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.603590 Sep 23 03:51:07.643897 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1438/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:07 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:07.657506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eef6cff2-0e45-4ff5-812e-6a4ae9cd5655 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8dbd30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:07.664278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.664779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.665439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.666505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.666972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.667410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.735298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-901fb667-5807-4bfd-8f00-7cb01a35976b tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1eaaa9ca54eb43a790b03ae733b0c45b" status: 200 len: 15 microversion: 2.1 time: 0.127877 Sep 23 03:51:07.735927 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1372/2810] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 03:51:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1eaaa9ca54eb43a790b03ae733b0c45b => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:51:07.748556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eef6cff2-0e45-4ff5-812e-6a4ae9cd5655 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.103500 Sep 23 03:51:07.753786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5907bb-2adf-4192-b903-fe9bbdf8ca37", "tag": "48efa0fc-3ca4-418d-9207-8dd17dc234ea"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:07.757914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1439/2811] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:07 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:07.773711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-211bfcaa-026b-43a2-b529-1b9dc91e2e78 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:07.784321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.784805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.785241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.787306 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-211bfcaa-026b-43a2-b529-1b9dc91e2e78 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.025641 Sep 23 03:51:07.788103 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1440/2812] 10.222.0.25 () {58 vars in 1189 bytes} [Fri Sep 23 03:51:07 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:51:07.816642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:07.823943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:07.832551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.833309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.841221 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] Creating event network-changed:48efa0fc-3ca4-418d-9207-8dd17dc234ea for instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 on n-h2-858495-2 Sep 23 03:51:07.846950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.849464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:07.850508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:07.852893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:07.854492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c64de155-c30c-43ae-8863-2fb913450961 req-b7119dd1-5db5-43c7-8062-9c9ecd5121cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117283 Sep 23 03:51:07.855653 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1373/2813] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:08.031800 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-edd72cf7-9f7d-46de-a2e4-cd273ddacc6c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 0 microversion: 2.1 time: 0.222398 Sep 23 03:51:08.032836 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1441/2814] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:07 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:51:08.047900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:08.054933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:08.067878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:08.072890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c385317083c24b2cae54ebc64c19610e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:08.078897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:08.086702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:08.102248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.102791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.103242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.104329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.104503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.106575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.109263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.119269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.120955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.127219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.128153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.128795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.403594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:51:08.555652 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc61082d-b752-4f9f-bd62-58a447d23335 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.516176 Sep 23 03:51:08.556550 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1374/2815] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Sep 23 03:51:08 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:08.587996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:08.591244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:08.598295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.599026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.599620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.600723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.601367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.601963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.801540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-efdb8fe9-5870-4f9c-80bf-a43d5cd5aeae tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 0 microversion: 2.1 time: 0.216631 Sep 23 03:51:08.803494 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1375/2816] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:08 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:51:08.807598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:08.819687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8332faaf-b6e4-4ccb-bd8a-6ddb8b92aace tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1304 microversion: 2.1 time: 0.762433 Sep 23 03:51:08.823920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:08.829676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:08.835543 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1442/2817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:08 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1304 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:08.854222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e47f0494-1140-47d6-af80-4e16a569357d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a789040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:08.856641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:08.861976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.863514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.872962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.873911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.874496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.874862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.941297 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e47f0494-1140-47d6-af80-4e16a569357d tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.104350 Sep 23 03:51:08.944363 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1443/2818] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:08 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:08.952499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:08.966042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:08.983770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.986619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.987309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:08.988537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:08.993166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:08.993987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.427178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:09.440941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8736e047-efe6-4c72-a4df-b648a0f430de tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.636299 Sep 23 03:51:09.441588 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1376/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:08 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:09.444948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3ecaa13-69bf-443b-ba04-9a8604b2f45c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1614 microversion: 2.1 time: 0.499300 Sep 23 03:51:09.467228 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1444/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:08 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1614 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:09.479685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:09.480297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:09.496067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.496566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.497322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.498859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.499522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.504832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.824945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c1f6ca0-8935-4a51-a382-e0d4bac68025 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1614 microversion: 2.1 time: 0.348589 Sep 23 03:51:09.826599 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1377/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:09 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1614 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:09.855776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:09.860147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:09.861029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:09.868631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'host': 'n-h2-858495-2', 'deleted': False} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:09.870837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.872402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.879560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.879871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.880362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.880857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.881068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.881665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:09.881813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.882166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:09.882567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:09.883461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.153033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:51:10.286493 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46845afc-130b-4e39-b496-a97bc9efa41c tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h2-858495-2&all_tenants=1" status: 200 len: 1319 microversion: 2.1 time: 0.439893 Sep 23 03:51:10.287695 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1445/2822] 10.222.0.25 () {58 vars in 1190 bytes} [Fri Sep 23 03:51:09 2022] GET /compute/v2.1/servers?host=n-h2-858495-2&all_tenants=1 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:10.292744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e559d230-9d3b-4913-bc4d-d8dddb9c1287 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7899d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:10.371764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e559d230-9d3b-4913-bc4d-d8dddb9c1287 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.082759 Sep 23 03:51:10.373030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1446/2823] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:10 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:10.381808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:10.391601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:51:10.405268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.410190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.412551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.420305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.420979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.421557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.447524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:10.461909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43dad5a7-1186-472e-9ebd-ad0da6ed9416 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1304 microversion: 2.1 time: 0.606101 Sep 23 03:51:10.486065 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1378/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:09 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1304 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:10.502778 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db567523-a343-465d-b3f9-79cb088196cc tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.128314 Sep 23 03:51:10.514537 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1447/2825] 10.222.0.25 () {58 vars in 1196 bytes} [Fri Sep 23 03:51:10 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:51:10.518428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd047e79-9e8b-4cb7-b3e2-1f1b692a8141", "name": "network-vif-plugged", "status": "completed", "tag": "9ec8164d-17b4-4e05-9dc6-7bb573c2a224"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:10.523788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:10.524720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:10.545844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.546633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.548641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.549665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.550374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.551220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.551579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.554334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.555249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.589701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:10.594751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] Creating event network-vif-plugged:9ec8164d-17b4-4e05-9dc6-7bb573c2a224 for instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 on n-h1-858495-2 Sep 23 03:51:10.609598 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ab634139-f010-46b8-b6a9-18bee409b1ed req-f503e4ea-3afc-4e88-9d1d-e53df1245e1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119026 Sep 23 03:51:10.613274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1379/2826] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:10.624941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:10.633694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:10.658542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.660214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.661993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.663815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.666887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.668213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.885685 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6212bcd6-0f25-43c3-9a03-0272c03bdb30 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 0 microversion: 2.1 time: 0.270541 Sep 23 03:51:10.887274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1380/2827] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:10 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:51:10.897172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:10.903546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:10.925086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.926590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.927470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.929538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:10.932738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:10.938184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:10.996897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:11.006539 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a969be2b-fddb-497d-a442-e04360fed9e8 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.490629 Sep 23 03:51:11.008043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1448/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:10 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:11.127767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:51:11.129615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:51:11.130207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:51:11.132045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:51:11.132946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:51:11.322480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:11.342506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.347905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.353036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.359107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.365626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.368053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.387644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf5702a6-17bd-4257-8159-be153825499b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8b735af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:11.486297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95dee20a-e4c4-4931-8af8-777f8b8f66d7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 1067 microversion: 2.1 time: 0.593763 Sep 23 03:51:11.487625 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1381/2829] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:10 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 1067 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 23 03:51:11.493470 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf5702a6-17bd-4257-8159-be153825499b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.109745 Sep 23 03:51:11.494226 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1449/2830] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:11 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:11.507478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:11.508217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:11.521880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.522563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:11.523918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.524385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:11.527720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.533637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.547527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.548257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.550502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.551008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.553774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.556822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:11.559663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:11.563123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:11.911990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:11.926864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-362c9fce-e165-41c0-bf5f-947766f653bf tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.422381 Sep 23 03:51:11.927502 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1450/2831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:11 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:11.991002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:12.009238 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14be1c6a-b75b-4249-b91a-de693a161c90 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.510096 Sep 23 03:51:12.025804 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1382/2832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:11 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:12.032441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:12.033217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:12.040972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:12.045839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:12.046496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:12.047522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:12.049122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:12.061933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:12.492849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:12.501812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-120b1b9c-c603-4532-8954-fddb3e45d8e4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1325 microversion: 2.1 time: 0.473775 Sep 23 03:51:12.514062 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1451/2833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:12 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1325 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:12.514588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41a87906-144e-4c7d-b528-f5d6afa8c25f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6b45e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:12.643733 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41a87906-144e-4c7d-b528-f5d6afa8c25f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.137116 Sep 23 03:51:12.646699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1383/2834] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:12 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:12.955302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:12.956901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:12.983061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:12.984450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:12.985022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:12.988023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:12.988626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:12.989690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.041703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:13.042915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:13.057650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:13.058141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:13.060587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.061373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:13.078046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:13.079940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.608066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:13.623421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3568795-c1cd-4146-a973-941351096577 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.589459 Sep 23 03:51:13.624751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1384/2835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:13 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:13.625525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:13.633475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-plugged", "status": "completed", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:13.639532 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c37f2cd0-3b87-4210-aa6c-4dd9c7aa5006 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.688807 Sep 23 03:51:13.647668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:13.649405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:13.650074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.656534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1452/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:12 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:13.661310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:13.666367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] Creating event network-vif-plugged:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:51:13.667678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:13.675438 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-dd1ddea0-b38f-44e1-9df2-a10a99dfc890 req-b6ff3dec-4111-4248-9a85-538bc61450f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048159 Sep 23 03:51:13.677000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1385/2837] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:13.681843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:13.683853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b8df6182-0154-469e-b3fb-77f4aa78afa8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6b4550>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:13.684534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:13.686185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.687464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:13.689243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:13.691442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:13.775751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b8df6182-0154-469e-b3fb-77f4aa78afa8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.097240 Sep 23 03:51:13.777122 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1386/2838] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:13 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:13.813463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=52 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:13.956321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:13.971826 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-620c6f0d-8843-4a36-afa6-545038c84494 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1522 microversion: 2.1 time: 0.314012 Sep 23 03:51:13.973281 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1453/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:13 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:14.002579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:14.003674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:14.014730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.019555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.026106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.027748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.028465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.032141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.113975 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] HTTP exception thrown: Instance is not a member of specified network Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Request method failure captured: Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141/ips/invalid HTTP/1.1 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS0c6xOUufk0Od9Mtt0Kq4PveWdPpiJkp7VCkW-TwrYmqcI0VhYiXrFssMSNPmUJA57SJuTTOTPQONcr1w5LXUEXEHWI_cncADKRzcXsj1Ok0cuYbaggtt8wy2lNuOLmETLzJgadVvGLlZj3z2dn0qlJ499V_JOryRrh7lP9n_Br5_k Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc7903a3610044f78837f466cb02607c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc7903a3610044f78837f466cb02607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d6e5b387939455090625f78736f9748 Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance is not a member of specified network Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': 'bd047e79-9e8b-4cb7-b3e2-1f1b692a8141', 'id': 'invalid'} Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 23 03:51:14.123331 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.127482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:14.127482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ba7c86f-388f-403a-96fc-38a3e71a7582 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.129940 Sep 23 03:51:14.131306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1387/2840] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:51:13 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141/ips/invalid => generated 91 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:51:14.144296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:14.144823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Failed to fetch instance by id 999 {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:51:14.145460 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] HTTP exception thrown: Instance 999 could not be found. Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Request method failure captured: Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS0c6xOUufk0Od9Mtt0Kq4PveWdPpiJkp7VCkW-TwrYmqcI0VhYiXrFssMSNPmUJA57SJuTTOTPQONcr1w5LXUEXEHWI_cncADKRzcXsj1Ok0cuYbaggtt8wy2lNuOLmETLzJgadVvGLlZj3z2dn0qlJ499V_JOryRrh7lP9n_Br5_k Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc7903a3610044f78837f466cb02607c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc7903a3610044f78837f466cb02607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1d6e5b387939455090625f78736f9748 Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 999 could not be found. Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '999'} Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 23 03:51:14.151141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:14.155150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:14.155967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7fe4642-14c8-4c97-9e96-e0d8b6fd9326 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017854 Sep 23 03:51:14.167555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:14.167555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:14.169779 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1454/2841] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 03:51:14 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:51:14.176974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.186339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.187816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.190254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.193740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.194329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.295135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:51:14.555353 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f70021dc-2a0e-44fc-9a4e-51424cb76e32 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 204 len: 0 microversion: 2.1 time: 0.393368 Sep 23 03:51:14.562450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1388/2842] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:51:14 2022] DELETE /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:51:14.573618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:14.574247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:14.585589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.596294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.596902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.602577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.603079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.603525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.659623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:14.662429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:14.671983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:14.679017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.687288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.687875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:14.688900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:14.689120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:14.689589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:15.129886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:15.139949 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a4c35f6-0ed2-48e6-a177-5cddf5f72b7c tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.491984 Sep 23 03:51:15.157446 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1389/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:14 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:15.158039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:15.158796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:15.172480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:15.173321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:15.175572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:15.176405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:15.177801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:15.180448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:15.362574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:15.371908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc96d358-3116-44dc-bd47-7b907c773d1f tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1528 microversion: 2.1 time: 0.803011 Sep 23 03:51:15.376592 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1455/2844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:14 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1528 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:15.391463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de6a501f-5da5-44df-bffd-23f727ee138b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6e78b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:15.506469 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de6a501f-5da5-44df-bffd-23f727ee138b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.127875 Sep 23 03:51:15.507548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1456/2845] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:15 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:15.657225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:15.672476 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1feadad7-4824-43c6-9c77-fd9c4c566bae tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.526024 Sep 23 03:51:15.692895 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1390/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:15 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:16.173828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:16.175155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:16.189322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:16.193819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:16.194885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:16.195833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:16.196617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:16.198853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:16.401028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:16.403287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:16.412291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=32 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:16.418553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:16.419981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:16.420791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:16.421782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:16.423313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:16.424247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:16.934530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:16.956680 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b2bdaef-6ec7-48a9-b2a2-e40f6ce825d3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.788460 Sep 23 03:51:16.977159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1457/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:16 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:16.985441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dc7c86d-41ba-403c-9b9b-8acd946770b8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6ed040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:17.079742 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8dc7c86d-41ba-403c-9b9b-8acd946770b8 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.100722 Sep 23 03:51:17.110033 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1458/2848] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:16 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:17.131801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:17.132420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:17.155380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:17.155963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:17.156827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:17.157819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:17.161965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:17.162656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:17.174226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:17.185869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-062b6544-0c12-489c-8d9a-91cac40877a4 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1528 microversion: 2.1 time: 0.789195 Sep 23 03:51:17.189813 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1391/2849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:16 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1528 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:17.813526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:17.821374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cbe2345-22c7-4a4f-bda5-afffd31fb828 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.709933 Sep 23 03:51:17.821953 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1459/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:17 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:17.843384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd047e79-9e8b-4cb7-b3e2-1f1b692a8141", "name": "network-vif-deleted", "tag": "9ec8164d-17b4-4e05-9dc6-7bb573c2a224"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:17.844145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca7ff3ce-ea29-41dc-a568-d151f95c9302 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Action: 'create', calling method: .version_select at 0x7f0c8a6b4670>, body: {"keypair": {"name": "tempest-keypair-2023870339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl5SScVdgWgWY3ahBTBdpg7o98zL6sisRl+4jClz2X0Z9PD6AxDcMaXXOujeEhJinSBpABBQHmF3W/3pGd/jCvoyugUeVnHCQd8VItVw+vd/2rn0wSV9hwhOldwNSAT9g=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:17.883070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:17.883332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ca7ff3ce-ea29-41dc-a568-d151f95c9302 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for project 80f277bc73c74769a96f2d5e83a599fd. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:51:17.887379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:17.890936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:17.906694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ca7ff3ce-ea29-41dc-a568-d151f95c9302 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for user d50d4aa75ead43cdb41b06e044e01a87 and project 80f277bc73c74769a96f2d5e83a599fd. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:51:17.940215 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] Creating event network-vif-deleted:9ec8164d-17b4-4e05-9dc6-7bb573c2a224 for instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 on n-h1-858495-2 Sep 23 03:51:17.953576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-88c5192c-cdac-42fb-b8a8-1aa4e290e0c6 req-57ac43be-cf61-4a5d-9bfe-11e8083064f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117405 Sep 23 03:51:17.957304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1460/2851] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:17.986947 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca7ff3ce-ea29-41dc-a568-d151f95c9302 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.790181 Sep 23 03:51:17.987291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:17.988139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1392/2852] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:51:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:17.988392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:17.999055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.002518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.005703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.006769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.009136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.012091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.100625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59ebf64d-24ff-4cf5-9545-4af2db062693 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a61f040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:18.187741 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-59ebf64d-24ff-4cf5-9545-4af2db062693 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.091439 Sep 23 03:51:18.190377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1393/2853] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:18 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:18.220135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:18.221220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:18.232778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.233864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.236220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.237194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.238872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.252172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.288185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:18.304033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.304753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.305430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.306227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lazy-loading 'fault' on Instance uuid bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:51:18.370865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6e5b387939455090625f78736f9748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc7903a3610044f78837f466cb02607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:18.384048 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-69af2a2d-3591-4fea-8cf0-43f62472c80d tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 200 len: 1315 microversion: 2.1 time: 0.168893 Sep 23 03:51:18.389281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1394/2854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:18 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:18.606100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:18.632901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2562c2f8-8cb6-4d7f-878e-0ae3eb054140 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.651694 Sep 23 03:51:18.646630 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1461/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:17 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:18.844922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:18.845569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:18.858959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.859745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.860240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:18.860922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:18.861449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:18.861826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:19.172856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:19.179609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:19.182053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58def3eb-5025-48b9-9429-9179d07fb46a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.341709 Sep 23 03:51:19.182649 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1395/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:18 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:19.204059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cbbcf39-6775-4a7f-9783-a8e0950691ea tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d7790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:19.292212 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cbbcf39-6775-4a7f-9783-a8e0950691ea tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.092691 Sep 23 03:51:19.292803 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1462/2857] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:19 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:19.413282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:19.413817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] [instance: bd047e79-9e8b-4cb7-b3e2-1f1b692a8141] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:19.431457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:19.432485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:19.433154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:19.434201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:19.435528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:19.436228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:19.480884 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] HTTP exception thrown: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Request method failure captured: Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 HTTP/1.1 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS0c6xOUufk0Od9Mtt0Kq4PveWdPpiJkp7VCkW-TwrYmqcI0VhYiXrFssMSNPmUJA57SJuTTOTPQONcr1w5LXUEXEHWI_cncADKRzcXsj1Ok0cuYbaggtt8wy2lNuOLmETLzJgadVvGLlZj3z2dn0qlJ499V_JOryRrh7lP9n_Br5_k Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc7903a3610044f78837f466cb02607c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc7903a3610044f78837f466cb02607c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc7903a3610044f78837f466cb02607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: cc7903a3610044f78837f466cb02607c Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1962280972 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 1d6e5b387939455090625f78736f9748 Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1962280972-project Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'bd047e79-9e8b-4cb7-b3e2-1f1b692a8141'} Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:19.484277 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. Sep 23 03:51:19.489062 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:19.490720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] Returning 404 to user: Instance bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:19.492115 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8995a271-4dbf-482c-9c20-68ce0e36b716 tempest-ServerAddressesNegativeTestJSON-1962280972 tempest-ServerAddressesNegativeTestJSON-1962280972-project] 10.222.0.25 "GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141" status: 404 len: 111 microversion: 2.1 time: 0.083281 Sep 23 03:51:19.493669 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1396/2858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:19 2022] GET /compute/v2.1/servers/bd047e79-9e8b-4cb7-b3e2-1f1b692a8141 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:51:19.660262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:19.661269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:19.679350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:19.682533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:19.687044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:19.688052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:19.688715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:19.689329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:20.210807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:20.212367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:20.231269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:20.232855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:20.236396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:20.237390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:20.238725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:20.239355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:20.435977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:20.839388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:20.850869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:20.854088 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ee04114-4b54-4205-bc4f-c516990acb29 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.648229 Sep 23 03:51:20.855384 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1397/2859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:20 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:20.862930 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b3067ec-6d41-4ff8-bd9d-28f4417ca5be tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 1.206712 Sep 23 03:51:20.863819 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1463/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:19 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:20.865856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d4c1333-39c9-4bf7-bbd9-b51411e3d037 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a65bc10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:20.963241 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d4c1333-39c9-4bf7-bbd9-b51411e3d037 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.106429 Sep 23 03:51:20.964199 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1398/2861] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:20 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:21.879709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:21.880679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:21.893610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:21.894561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:21.895358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:21.895903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:21.897843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:21.898817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:21.900924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:21.901494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:21.915455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:21.924825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:21.925417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:21.926264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:21.926823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:21.927895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:22.331309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:22.347342 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-130ff778-d970-4887-8b35-2ab8c0545071 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.471930 Sep 23 03:51:22.361380 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1464/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:21 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:22.361380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a419ca1-72c4-4654-8c53-4c40aa846b2b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d1d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:22.592704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a419ca1-72c4-4654-8c53-4c40aa846b2b tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.242918 Sep 23 03:51:22.595408 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1465/2863] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:22 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:22.635598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:22.654453 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e916788-8e35-43c0-b543-5e74e26343cf tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.765049 Sep 23 03:51:22.675801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1399/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:21 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:23.324588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1474199229", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0e3b5ed7-6899-4781-890a-8d7e80c167e8"}], "security_groups": [{"name": "tempest-securitygroup--1750708418"}], "key_name": "tempest-keypair-2023870339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:23.372896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:23.374298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:23.393083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:23.397781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:23.401764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:23.403214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:23.406141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:23.412414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:24.027602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] validate_networks() for [('0e3b5ed7-6899-4781-890a-8d7e80c167e8', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:51:24.230833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:24.249495 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ab11520-475a-472c-85aa-9725833bcb1e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1471 microversion: 2.1 time: 0.876790 Sep 23 03:51:24.258976 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1400/2865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:23 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1471 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:24.282180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5647a2fa-c09c-4eda-b8ca-fff9e4f202ca tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a645b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:24.353912 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5647a2fa-c09c-4eda-b8ca-fff9e4f202ca tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.092907 Sep 23 03:51:24.354737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1401/2866] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:24 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:24.365165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:24.365812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:24.382100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:24.382770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:24.383004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:24.390172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:24.390822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:24.392296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:24.805209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:24.816529 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de1c0b06-1b81-40ce-a098-c7c7e912729a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.459388 Sep 23 03:51:24.817147 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1402/2867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:24 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:24.847378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5907bb-2adf-4192-b903-fe9bbdf8ca37", "name": "network-vif-plugged", "status": "completed", "tag": "48efa0fc-3ca4-418d-9207-8dd17dc234ea"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:24.884022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:24.891616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:24.892727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:24.921434 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] Creating event network-vif-plugged:48efa0fc-3ca4-418d-9207-8dd17dc234ea for instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 on n-h2-858495-2 Sep 23 03:51:24.927749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-50185475-c357-46ae-99c1-8a8cae2eee76 req-eaf2f862-3e56-42c3-9969-232231fc207a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087270 Sep 23 03:51:24.929082 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1403/2868] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:25.279858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:25.280856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:25.287612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:25.288420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:25.289741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:25.290665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:25.291339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:25.291960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:25.442760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for project 80f277bc73c74769a96f2d5e83a599fd. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:51:25.450727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for user d50d4aa75ead43cdb41b06e044e01a87 and project 80f277bc73c74769a96f2d5e83a599fd. Resources: dict_keys(['metadata_items']) {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:51:25.472911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:51:25.473675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:51:25.474379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:51:25.475012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:51:25.476310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:51:25.490671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:25.491681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:25.493497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:25.497915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:25.499288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:25.500084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:25.576985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for project 80f277bc73c74769a96f2d5e83a599fd. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:51:25.586487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Getting quotas for user d50d4aa75ead43cdb41b06e044e01a87 and project 80f277bc73c74769a96f2d5e83a599fd. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:51:25.615414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:51:25.618412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:51:25.732379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa1d647d-9c48-427d-be11-efa89513e787 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.416224 Sep 23 03:51:25.733740 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1466/2869] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:51:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:51:25.743848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7ccf899-bb99-4022-8d49-8b61e69496ae tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8d0310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:25.851732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7ccf899-bb99-4022-8d49-8b61e69496ae tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.115367 Sep 23 03:51:25.855296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1467/2870] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:25 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:25.874338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df4fa524-ed26-4afc-940c-e804c7285470 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:25.879228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df4fa524-ed26-4afc-940c-e804c7285470 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:26.595404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df4fa524-ed26-4afc-940c-e804c7285470 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:26.604248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df4fa524-ed26-4afc-940c-e804c7285470 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1270 microversion: 2.1 time: 0.747830 Sep 23 03:51:26.610034 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1468/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:25 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1270 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:26.621496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:26.630656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:26.652498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:26.653004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:26.653524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:26.665603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:26.666091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:26.666541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:26.738459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:26.766107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45a83173-afed-41dc-afd1-32b0a2f3f797 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1489 microversion: 2.1 time: 1.494293 Sep 23 03:51:26.768916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1404/2872] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:25 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1489 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:26.868422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b36434f8-8393-419b-a4da-13351450a94c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a61a280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:27.016120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:27.028402 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31e7f598-5d65-40ce-b294-e6e9e6204872 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.415014 Sep 23 03:51:27.029004 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1469/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:26 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:27.634061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:27.635150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:27.666247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:27.666760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:27.667211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:27.667948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:27.668411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:27.668914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:27.855734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:27.867410 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55e5c9c9-0105-4ca3-acb6-61c39ee116e5 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1322 microversion: 2.1 time: 0.238948 Sep 23 03:51:27.871738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b36434f8-8393-419b-a4da-13351450a94c tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 1.007828 Sep 23 03:51:27.873532 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1470/2874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:27 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:27.874635 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1405/2875] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:26 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:27.887365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:27.888041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:27.898213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:27.898710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:27.899156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:27.899866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:27.900383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:27.900806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:28.050188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:28.054843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:28.055860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:28.086542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:28.087090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:28.087556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:28.088320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:28.088792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:28.098402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:28.628293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:28.677085 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86d66054-acef-492e-a880-4e144fd5bf56 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 0.802249 Sep 23 03:51:28.683152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1471/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:27 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:28.883326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:28.892511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-524ed7c1-a0fc-4216-bbab-cc8ced2669fc tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a7b59d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:28.896444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eff33a75-f771-4c3d-b913-9848c1bfcea5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.847940 Sep 23 03:51:28.923780 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1406/2877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:28 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:28.932830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:28.947169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:28.965662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:28.968599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:28.969063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:28.970158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:28.970636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:28.971209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:28.982888 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-524ed7c1-a0fc-4216-bbab-cc8ced2669fc tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.095566 Sep 23 03:51:28.984884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1472/2878] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:28 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:29.000057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-unplugged", "status": "completed", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:29.033118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:29.034624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:29.036098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:29.076863 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] Creating event network-vif-unplugged:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:51:29.099868 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-54299385-2bd6-4f3a-9e2c-67fd9bcd3155 req-dbf7caef-45f4-430c-be93-3d821a2be205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108896 Sep 23 03:51:29.100710 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1473/2879] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:29.278651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:29.298295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6c5d64f6-b4c3-45d0-8f64-330dbd38eb7e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1328 microversion: 2.1 time: 0.372765 Sep 23 03:51:29.301286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1407/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:28 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:29.702186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:29.703400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:29.717963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:29.718681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:29.719288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:29.720164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:29.724604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:29.725248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:29.920105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:29.921473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:29.933679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:29.938245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:29.938996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:29.942708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:29.943461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:29.944146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:30.589912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:30.599791 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42901956-7296-4628-852c-cb0c77042020 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 0.903388 Sep 23 03:51:30.600383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1474/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:29 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:30.611924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1af90be-70ec-4707-a265-9afab65a708f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a68e1f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:30.681410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:30.693919 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd3aecc4-90eb-442a-8270-3685127db0c7 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1292 microversion: 2.1 time: 0.778306 Sep 23 03:51:30.698548 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1408/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:29 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1292 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:30.718584 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1af90be-70ec-4707-a265-9afab65a708f tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.117131 Sep 23 03:51:30.719180 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1475/2883] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:30 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:30.722481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:30.728237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:30.752685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:30.757659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:30.758629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:30.760115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:30.762228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:30.763900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:31.418526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:31.429894 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-004b4f3c-8e8e-471d-840c-e0e139d522f7 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.729933 Sep 23 03:51:31.430827 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1409/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:30 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:31.630389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:31.631130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:31.640847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:31.642269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:31.642949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:31.643873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:31.644705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:31.645238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:31.724484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:31.725523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:31.734358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:31.735169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:31.735876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:31.736811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:31.737532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:31.738752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:32.203317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:32.216654 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a2ae76d-936d-428b-b6a9-d3b88570e03e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 0.593264 Sep 23 03:51:32.217990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1476/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:31 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:32.222947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4b2758d-cd4a-4d5f-8535-2f8be4467c13 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6ad790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:32.326411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:32.341264 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4b2758d-cd4a-4d5f-8535-2f8be4467c13 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.121294 Sep 23 03:51:32.347586 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93bc938c-111b-4fb4-a7ae-d02afa7b62c1 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1483 microversion: 2.1 time: 0.629644 Sep 23 03:51:32.348144 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1477/2886] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:32 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:32.349213 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1410/2887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:31 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1483 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:32.373293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:32.374263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:32.383876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:32.386969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:32.388174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:32.390195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:32.393939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:32.394641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:32.456333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:32.457931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:32.468412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:32.471783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:32.472538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:32.473574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:32.474265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:32.477009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:32.603047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2813cda6-93be-446c-a5c9-817f1b4f0f9a tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233707 Sep 23 03:51:32.603798 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1478/2888] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:51:32 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:33.244868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:33.246327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:33.260447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:33.289115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:33.290852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:33.291640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:33.292119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:33.293253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:35.082941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:35.134035 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54c4325f-d033-432d-afd3-2406fbdbb0c9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 2.652516 Sep 23 03:51:35.134035 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1411/2889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:32 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:35.134494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:35.134494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-975dc872-fdec-41d7-abf0-fcdb32c10960 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 1.891012 Sep 23 03:51:35.135889 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1479/2890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:33 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:35.139358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2728e32-2d06-4f14-bfa4-8a91a2421c63 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6b40d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:35.279551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2728e32-2d06-4f14-bfa4-8a91a2421c63 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1428 microversion: 2.1 time: 0.165895 Sep 23 03:51:35.281898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1412/2891] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:35 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1428 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:35.527457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:35.643001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d71c2cd-e0c9-4a39-838b-e65a88156dd4", "tag": "23193385-e71a-4b3f-a74c-db39fe3f0e47"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:35.674472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:35.674975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:35.675419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:35.726094 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] Creating event network-changed:23193385-e71a-4b3f-a74c-db39fe3f0e47 for instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 on n-h1-858495-2 Sep 23 03:51:35.746915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3b0b48d6-4200-4804-abb4-9cd1244ccaec req-15154798-8a3d-44fd-acc8-fc2d2736729c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107140 Sep 23 03:51:35.750041 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1413/2892] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:36.049418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Calling method '.version_select at 0x7f0c8a8dbd30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:36.158856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:36.159393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:36.166246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:36.166852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:36.167300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:36.168006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:36.168497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:36.168923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:36.475510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:51:36.476809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Neutron security group 255d39c7-5f43-4016-b7a5-939cbbead632 not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:51:36.477578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] HTTP exception thrown: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.477578 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Request method failure captured: Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-groups/255d39c7-5f43-4016-b7a5-939cbbead632 HTTP/1.1 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1Gm25WZdMDnNVOxHnJlO3Lca19PTgT54rk_G6pk7H3Dy7aZW3hp24e_nOFStr170n5gPKUyJj5U1KlFUgGunFbOeFVoHopUA2165e7ZkJYP_wZz4T4s38MQaX9k5Iog2l6bao6XTLEIBaCcDyCSaE2ytPcBLdQwSj-Al-oD5A1cUo Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c7283a27e35f4555b76b8563d64cbb0a Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '255d39c7-5f43-4016-b7a5-939cbbead632'} Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:51:36.481716 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] Sep 23 03:51:36.486100 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:36.491457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Returning 404 to user: Security group 255d39c7-5f43-4016-b7a5-939cbbead632 does not exist Sep 23 03:51:36.491457 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-7b3c4934-a995-45b9-968b-fa2d0b24f87c'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:36.492586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-887f4b59-1bfc-4b29-8e9b-b22e58d5158d tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/255d39c7-5f43-4016-b7a5-939cbbead632" status: 404 len: 194 microversion: 2.1 time: 1.122516 Sep 23 03:51:36.493473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1480/2893] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:51:35 2022] DELETE /compute/v2.1/os-security-groups/255d39c7-5f43-4016-b7a5-939cbbead632 => generated 194 bytes in 1124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:51:36.511165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:36.515763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:36.527843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:36.529923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:36.531644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:36.537720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:36.538476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:36.539116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:36.601128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:37.427596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:37.446645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a10bc690-3635-4a26-9277-3edb1e2b28b0 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 1.292125 Sep 23 03:51:37.483786 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1414/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:36 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:37.498729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-plugged", "status": "completed", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:37.504593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:37.516136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:37.516364 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f4d786f6-6c46-44d9-97c3-40c2a9378add tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 1.021474 Sep 23 03:51:37.517476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:37.518143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:37.522412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1481/2895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:36 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:37.533132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3148b0a-5036-47f5-8cb2-9ba2d2844ff2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a8dbaf0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:37.541931 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] Creating event network-vif-plugged:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:51:37.554057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-dff6d8a6-23ec-4bc0-9fd4-4ee5ea4c09d2 req-bc46bbc5-9030-4bce-a23e-39a571dc882d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059611 Sep 23 03:51:37.560059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1415/2896] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:37.583266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-616a232a-f5d5-47ec-bfdc-99ea1a08de82 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.017450 Sep 23 03:51:37.584808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1416/2897] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Sep 23 03:51:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 03:51:37.615098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-33571941-2f5c-4048-b673-d0d4c7e957c9 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Calling method '.version_select at 0x7f0c8a7e1820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:37.756669 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3148b0a-5036-47f5-8cb2-9ba2d2844ff2 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1437 microversion: 2.1 time: 0.233025 Sep 23 03:51:37.758135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1482/2898] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:37 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1437 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:37.773135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76d38764-6048-48a1-a515-4b43b8b06feb tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6e7e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:37.874142 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76d38764-6048-48a1-a515-4b43b8b06feb tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 200 len: 1437 microversion: 2.1 time: 0.105547 Sep 23 03:51:37.877259 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1483/2899] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:51:37 2022] GET /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:37.892725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:37.893395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:37.908798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:37.910209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:37.911765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:37.915682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:37.917820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:37.918652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.383150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-33571941-2f5c-4048-b673-d0d4c7e957c9 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.788325 Sep 23 03:51:38.384157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1417/2900] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:51:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:38.390052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:38.390805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:38.400369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.400867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.401313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.402060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.402556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.402995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.424733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:38.439710 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5854e39-a4aa-428f-824a-c14d80e3cfe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1479 microversion: 2.1 time: 0.552344 Sep 23 03:51:38.441237 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1484/2901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:37 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1479 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:38.459071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5907bb-2adf-4192-b903-fe9bbdf8ca37", "tag": "48efa0fc-3ca4-418d-9207-8dd17dc234ea"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:38.481147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:38.488212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.490011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.491803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.522814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] Creating event network-changed:48efa0fc-3ca4-418d-9207-8dd17dc234ea for instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 on n-h2-858495-2 Sep 23 03:51:38.532437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-96dc84be-c070-4001-acaa-d7a1a20754d3 req-67df8d18-4ced-43c5-a044-5d9fdb84bad2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089282 Sep 23 03:51:38.535955 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1485/2902] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:38.548379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Calling method '.version_select at 0x7f0c8a8e2550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:38.738952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:38.757310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:51:38.758121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 23 03:51:38.758121 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Request method failure captured: Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-security-groups/3553cd98-2f4b-4047-a3f6-114bfcc991ea HTTP/1.1 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1Gm25WZdMDnNVOxHnJlO3Lca19PTgT54rk_G6pk7H3Dy7aZW3hp24e_nOFStr170n5gPKUyJj5U1KlFUgGunFbOeFVoHopUA2165e7ZkJYP_wZz4T4s38MQaX9k5Iog2l6bao6XTLEIBaCcDyCSaE2ytPcBLdQwSj-Al-oD5A1cUo Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c7283a27e35f4555b76b8563d64cbb0a Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: exception: Insufficient rights for removing default security group. Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3553cd98-2f4b-4047-a3f6-114bfcc991ea'} Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:51:38.761094 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] Sep 23 03:51:38.765850 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:38.769750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 23 03:51:38.769750 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-fbc03781-d50f-4704-a253-27c39551af56'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:38.770653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae4080fe-a690-4044-9064-56a689e588f3 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3553cd98-2f4b-4047-a3f6-114bfcc991ea" status: 400 len: 182 microversion: 2.1 time: 0.230821 Sep 23 03:51:38.771241 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1486/2903] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:51:38 2022] DELETE /compute/v2.1/os-security-groups/3553cd98-2f4b-4047-a3f6-114bfcc991ea => generated 182 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:51:38.774710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87e2f3f9-a8a4-465c-b4bc-af45d426b664 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1483 microversion: 2.1 time: 0.388953 Sep 23 03:51:38.775652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1418/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:38 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1483 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:38.781691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:38.786230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:38.793278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:38.794186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:38.797436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.798141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.798731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.799622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.800338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.800925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.801633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.802242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.802795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:38.803619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:38.804195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:38.804737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:39.363460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:39.373672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73020c3c-3afc-4460-928a-39605e131c4b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.601284 Sep 23 03:51:39.378809 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1487/2905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:38 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:39.391843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Calling method '.version_select at 0x7f0c8a947700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:39.471309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:51:39.471964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.security_group_api [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Neutron security group dd77ab79-4c34-4d6e-b673-77218efb93c5 not found {{(pid=128724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:51:39.472451 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] HTTP exception thrown: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.472451 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Request method failure captured: Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-security-groups/dd77ab79-4c34-4d6e-b673-77218efb93c5 HTTP/1.1 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1Gm25WZdMDnNVOxHnJlO3Lca19PTgT54rk_G6pk7H3Dy7aZW3hp24e_nOFStr170n5gPKUyJj5U1KlFUgGunFbOeFVoHopUA2165e7ZkJYP_wZz4T4s38MQaX9k5Iog2l6bao6XTLEIBaCcDyCSaE2ytPcBLdQwSj-Al-oD5A1cUo Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: c7283a27e35f4555b76b8563d64cbb0a Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: exception: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'dd77ab79-4c34-4d6e-b673-77218efb93c5'} Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:51:39.479442 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Returning 404 to user: Security group dd77ab79-4c34-4d6e-b673-77218efb93c5 does not exist Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-6553ce9b-51ee-4a01-9a45-66ac0167a0b2'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:39.483416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9546919b-4f63-4336-9cf7-fbfca5198ae6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/dd77ab79-4c34-4d6e-b673-77218efb93c5" status: 404 len: 194 microversion: 2.1 time: 0.099862 Sep 23 03:51:39.488887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1488/2906] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:51:39 2022] GET /compute/v2.1/os-security-groups/dd77ab79-4c34-4d6e-b673-77218efb93c5 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:51:39.492632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:39.493217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:39.513557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:39.514131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:39.514589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:39.515332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:39.515787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:39.516214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:39.533553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:39.631398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:39.646108 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ed478eb-06e2-4922-a1a6-8aea675458d0 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1477 microversion: 2.1 time: 0.869142 Sep 23 03:51:39.648421 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1419/2907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:38 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1477 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:39.663700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Action: 'update', calling method: .version_select at 0x7f0c8a603b80>, body: {"security_group": {"name": "tempest-sg-1434339231", "description": "tempest-description-2052563785"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:39.790903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG neutronclient.v2_0.client [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist", "detail": ""}} {{(pid=128723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:51:39.792236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Neutron security group 50e48fe3-1003-4b3d-938d-f55db09fd18b not found {{(pid=128723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 03:51:39.793849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] HTTP exception thrown: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.793849 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Request method failure captured: Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/os-security-groups/50e48fe3-1003-4b3d-938d-f55db09fd18b HTTP/1.1 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 102 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1Gm25WZdMDnNVOxHnJlO3Lca19PTgT54rk_G6pk7H3Dy7aZW3hp24e_nOFStr170n5gPKUyJj5U1KlFUgGunFbOeFVoHopUA2165e7ZkJYP_wZz4T4s38MQaX9k5Iog2l6bao6XTLEIBaCcDyCSaE2ytPcBLdQwSj-Al-oD5A1cUo Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9068e027667d4b7aa5e7509de72c5f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 9068e027667d4b7aa5e7509de72c5f0d Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-615148430 Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: c7283a27e35f4555b76b8563d64cbb0a Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-615148430-project Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: {"security_group": {"name": "tempest-sg-1434339231", "description": "tempest-description-2052563785"}} Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: exception: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '50e48fe3-1003-4b3d-938d-f55db09fd18b', 'body': {'security_group': {'name': 'tempest-sg-1434339231', 'description': 'tempest-description-2052563785'}}} Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:51:39.796353 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] Sep 23 03:51:39.800825 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:39.810713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] Returning 404 to user: Security group 50e48fe3-1003-4b3d-938d-f55db09fd18b does not exist Sep 23 03:51:39.810713 n-d-858495-2 devstack@n-api.service[128723]: Neutron server returns request_ids: ['req-581fcb53-9628-4b99-964d-280ec274b9a9'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:39.812044 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2f03088-d9c1-4f3e-a312-69a95ac973c6 tempest-SecurityGroupsNegativeTestJSON-615148430 tempest-SecurityGroupsNegativeTestJSON-615148430-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/50e48fe3-1003-4b3d-938d-f55db09fd18b" status: 404 len: 194 microversion: 2.1 time: 0.162652 Sep 23 03:51:39.826214 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1420/2908] 10.222.0.25 () {60 vars in 1290 bytes} [Fri Sep 23 03:51:39 2022] PUT /compute/v2.1/os-security-groups/50e48fe3-1003-4b3d-938d-f55db09fd18b => generated 194 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:51:39.951327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:39.967842 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d00cc80-ff89-4844-8f42-8a65aa9aec21 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1466 microversion: 2.1 time: 0.479019 Sep 23 03:51:39.968586 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1489/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:39 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1466 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:39.998113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4dbf36ed-3633-4333-9150-5defa2167fe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a6b4c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:40.403812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:40.404500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:40.421321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:40.421849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:40.426732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:40.427800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:40.436690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:40.437245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:40.939570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:40.953804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67d262d8-64d2-4aa5-a0ee-451176f79905 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.551303 Sep 23 03:51:40.954460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1490/2910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:40 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:40.960215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:40.960852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:40.983303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:40.983866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:40.984280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:40.984978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:40.985472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:40.985910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.493756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:41.513770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e1710e4-2352-4e07-a099-79a082f8f1f7 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1463 microversion: 2.1 time: 0.557963 Sep 23 03:51:41.514738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1491/2911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:40 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1463 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:41.519982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:41.563409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:41.564339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:41.564784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.592336 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] Creating event network-vif-unplugged:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:51:41.614084 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b1b5d057-ba87-487b-b4e3-ddc23a16940f req-5fbfd9a3-19ca-4989-a661-5e91d6295c45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097663 Sep 23 03:51:41.616932 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1492/2912] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:41.631616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:41.632432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:41.645453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:41.650579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:41.651332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.652101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:41.654775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:41.655236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.681889 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4dbf36ed-3633-4333-9150-5defa2167fe4 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "DELETE /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff" status: 204 len: 0 microversion: 2.1 time: 1.688370 Sep 23 03:51:41.685513 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1421/2913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:39 2022] DELETE /compute/v2.1/images/9ebc2b0a-1433-4d17-acf0-7a1f96d78aff => generated 0 bytes in 1690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:51:41.690416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccf14af5-a41f-41dd-b5b1-fefb91689400 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '.version_select at 0x7f0c8a79c430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:41.749490 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ccf14af5-a41f-41dd-b5b1-fefb91689400 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] HTTP exception thrown: Image not found. Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccf14af5-a41f-41dd-b5b1-fefb91689400 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Request method failure captured: Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 HTTP/1.1 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzcVfFBnL2uEC91Fy2D-p5P2rdxgWqGTSJYKiiDpgGJdM7fbPPUHxRPgn5aHspO6r4pkUpzKi5GjrO_OXqv8XQndAgAFIXNs7cJZuxdD2ARSf4Z5iygXBjy3GNL248eOaCq67-CZodH-EA06gwTLQtMRGFHj4OE8wazjehlYxbAfxU Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: ee608439593f49a1a368a26f8beb3eb8 Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: exception: Image not found. Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6e5ec345-8f0e-4b07-b54d-0d2a01807440'} Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6e5ec345-8f0e-4b07-b54d-0d2a01807440 to delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e5ec345-8f0e-4b07-b54d-0d2a01807440 could not be found. Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.751551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccf14af5-a41f-41dd-b5b1-fefb91689400 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Returning 404 to user: Image not found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ccf14af5-a41f-41dd-b5b1-fefb91689400 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "DELETE /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440" status: 404 len: 62 microversion: 2.1 time: 0.067756 Sep 23 03:51:41.757581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1422/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:41 2022] DELETE /compute/v2.1/images/6e5ec345-8f0e-4b07-b54d-0d2a01807440 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:51:41.765608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:41.768376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:41.774988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:41.785419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:41.786021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:41.787467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.788276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:41.802168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:41.802708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:41.851144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:51:41.888689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:41.949828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:41.961674 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ed3eaaa-3a52-4a9c-a346-c48333b13dff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1463 microversion: 2.1 time: 0.340956 Sep 23 03:51:41.962368 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1493/2915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:41 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1463 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:42.000153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:42.003807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:42.010391 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39d5b1c3-5a82-451b-b645-921716ee54f7 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "DELETE /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 204 len: 0 microversion: 2.1 time: 0.248339 Sep 23 03:51:42.011386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1423/2916] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:51:41 2022] DELETE /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:51:42.017550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.019766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.020517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.021209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:42.021703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.022440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.023185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.025585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:42.039835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.040714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.041685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.043362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.044164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.044818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.160053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:51:42.160661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:51:42.161267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:51:42.161812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:51:42.163707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:51:42.250319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:42.268727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.269227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.273030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:42.274344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.275942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.276649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.277203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.284773 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c82d93fd-a970-41d4-b8b4-aa723bd37172 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.301254 Sep 23 03:51:42.288089 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1494/2917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:41 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:42.295669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:42.297641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:42.306597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.308127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.308960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.311362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.312196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.312861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.340512 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-852d9a35-595f-469c-bb43-f232040c9d50 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 1067 microversion: 2.1 time: 0.326222 Sep 23 03:51:42.355607 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1424/2918] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:51:42 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 1067 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 03:51:42.376244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:42.377202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:42.388759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.389532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.390328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.391278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:42.391813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:42.392316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:42.670795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:42.685904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-270c07ac-89a8-46c5-a3d2-096a21092a31 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1472 microversion: 2.1 time: 0.395123 Sep 23 03:51:42.686815 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1495/2919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:42 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:42.792286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:42.801229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d87f58f-399d-40b3-bff4-ed0ac6c1eb49 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.437085 Sep 23 03:51:42.804853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1425/2920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:42 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:43.319171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:43.320366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:43.331862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.334916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.337444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:43.338829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.339650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.344507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:43.711175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:43.716807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:43.717657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:43.728332 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0831db93-afdd-4367-8388-3b30fd62ab6a tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.413677 Sep 23 03:51:43.731298 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1496/2921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:43 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:43.735920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.737578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.739818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:43.740896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.742498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.745169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:43.827506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:43.829219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:43.841471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.842274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.843890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:43.845449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:43.846692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:43.847398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:44.946150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:44.955643 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6ee8e21-88e9-471f-8c6c-e5298d1cdac1 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1472 microversion: 2.1 time: 1.244099 Sep 23 03:51:44.956250 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1426/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:43 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1472 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:44.970164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:44.978823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:44.978823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:44.982735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31d18e29-79d4-4cf0-9f0e-b63305907ecc tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 1.161160 Sep 23 03:51:44.983340 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1497/2923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:43 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:44.998200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:44.998886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:44.999500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:45.000215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:45.000677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:45.001108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:45.050872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d71c2cd-e0c9-4a39-838b-e65a88156dd4", "name": "network-vif-plugged", "status": "completed", "tag": "23193385-e71a-4b3f-a74c-db39fe3f0e47"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:45.073681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:45.073986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:45.074982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:45.094469 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] Creating event network-vif-plugged:23193385-e71a-4b3f-a74c-db39fe3f0e47 for instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 on n-h1-858495-2 Sep 23 03:51:45.100671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-408b8fe9-0f2c-4a52-95ee-1ecef5e606a5 req-ee05d8c4-2af4-4256-ad61-32805cb41b94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053295 Sep 23 03:51:45.102147 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1498/2924] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:51:45.554846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:45.567969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a850617-f747-482a-a9f2-4546ae0a992e tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.595266 Sep 23 03:51:45.597136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1427/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:44 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:45.993290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:45.994044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:46.010600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:46.013269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:46.023489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.024510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.027268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.028036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.033925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.034513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.036507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.036939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.040038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.041577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.048927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.049931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.290527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:46.316118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8f40a2b-aeb1-4864-af9b-6487716b44a5 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1430 microversion: 2.1 time: 0.318305 Sep 23 03:51:46.316804 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1499/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:45 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1430 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:46.366100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719020e0-a1f5-4139-b917-a349b44c2dc1", "name": "network-vif-deleted", "tag": "c2dd339a-186d-4f39-a88a-aeda59e73bd6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:46.381686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.382535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.383757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.424755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] Creating event network-vif-deleted:c2dd339a-186d-4f39-a88a-aeda59e73bd6 for instance 719020e0-a1f5-4139-b917-a349b44c2dc1 on n-h1-858495-2 Sep 23 03:51:46.452963 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-43f54082-8496-4549-95a6-fcbebcedda9a req-4b0037d4-6462-4bda-b0a5-499ec673ac16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087545 Sep 23 03:51:46.454097 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1500/2927] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:46.599115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:46.600182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:46.618381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.619193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.620014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.622479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:46.625891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:46.628773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:46.922815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:46.936583 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e2d6269-4956-4bdc-915b-5cccad351d2e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.933073 Sep 23 03:51:46.948864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1428/2928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:46 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:47.107536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:47.120082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55adee07-36b2-4705-9e70-c0eef38cb042 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1396 microversion: 2.1 time: 0.527041 Sep 23 03:51:47.122690 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1501/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:46 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1396 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:47.344655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:47.345273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:47.356464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:47.357254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:47.357907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:47.359112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:47.359733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:47.360424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:47.457505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:47.458464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:47.459332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:47.460098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lazy-loading 'fault' on Instance uuid 719020e0-a1f5-4139-b917-a349b44c2dc1 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:51:47.613711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee608439593f49a1a368a26f8beb3eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1703969e99664a7a9b3fb03d1d275740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:47.624081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b1ee008-25d0-4e8e-94ad-01cd240cf9f6 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 200 len: 1307 microversion: 2.1 time: 0.284917 Sep 23 03:51:47.640122 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1429/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:47 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:47.973204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:47.975085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:47.990150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:47.993840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:47.994651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:47.995624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:47.996406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:47.997019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.147862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:48.149106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:48.155569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.156528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.157916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:48.158552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.162493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.163651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.164437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.172229 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51a2f9d3-4b1a-476a-8227-724c777eeddd tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.201883 Sep 23 03:51:48.190950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1502/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:47 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:48.367038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:48.382401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce7a0d65-7cd6-46d3-b451-2f87460551bc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1577 microversion: 2.1 time: 0.239252 Sep 23 03:51:48.383802 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1430/2932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:48 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:51:48.410701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:48.411310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:48.420472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.421058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.421606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.422445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.423045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.423481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.545203 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7de6020b-0aca-4711-b00b-6286cacaf877 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139898 Sep 23 03:51:48.546870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1431/2933] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:51:48 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:48.621973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-306613661", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "0d8acad8-87bb-4f8d-972a-f563d6ef031b"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:48.651188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:48.652502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] [instance: 719020e0-a1f5-4139-b917-a349b44c2dc1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:48.660705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.663280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.664896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.666723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:48.672045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:48.673306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:48.708846 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] HTTP exception thrown: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Request method failure captured: Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 HTTP/1.1 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzcVfFBnL2uEC91Fy2D-p5P2rdxgWqGTSJYKiiDpgGJdM7fbPPUHxRPgn5aHspO6r4pkUpzKi5GjrO_OXqv8XQndAgAFIXNs7cJZuxdD2ARSf4Z5iygXBjy3GNL248eOaCq67-CZodH-EA06gwTLQtMRGFHj4OE8wazjehlYxbAfxU Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1703969e99664a7a9b3fb03d1d275740"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1703969e99664a7a9b3fb03d1d275740 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1651398614 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: ee608439593f49a1a368a26f8beb3eb8 Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerTestJSON-1651398614-project Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '719020e0-a1f5-4139-b917-a349b44c2dc1'} Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:51:48.712044 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] Returning 404 to user: Instance 719020e0-a1f5-4139-b917-a349b44c2dc1 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:51:48.716553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4303382-5630-4644-a9db-3372370647f9 tempest-ImagesOneServerTestJSON-1651398614 tempest-ImagesOneServerTestJSON-1651398614-project] 10.222.0.25 "GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1" status: 404 len: 111 microversion: 2.1 time: 0.072062 Sep 23 03:51:48.717263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1432/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:48 2022] GET /compute/v2.1/servers/719020e0-a1f5-4139-b917-a349b44c2dc1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:51:48.730292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] validate_networks() for [('0d8acad8-87bb-4f8d-972a-f563d6ef031b', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:51:49.203934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:49.207016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:49.219862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:49.222021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:49.222679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:49.223380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:49.223841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:49.226644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:49.388429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:51:49.389731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:51:49.390214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:51:49.390655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:51:49.391037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:51:49.416338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:49.416961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:49.417781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:49.418726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:49.419588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:49.420171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:49.460981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Getting quotas for project 89faa549323046e1822043f0fa88077e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:51:49.478119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Getting quotas for user a04439d6d5d04321a2c619e11d936a69 and project 89faa549323046e1822043f0fa88077e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:51:49.491962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:49.501728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f739323-37dd-4184-8f45-f1f2386bff9d tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.307840 Sep 23 03:51:49.502629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1433/2935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:49 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:49.526622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:51:49.530572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:51:49.615843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62af39c5-0945-446b-9d52-543ed48f2ac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.412676 Sep 23 03:51:49.620244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1503/2936] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 03:51:49.628866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:49.629618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:49.719241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:49.733306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:49.739775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:49.741425 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47587052-1f09-4f33-9744-b2ea1ad1f0d3 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1261 microversion: 2.26 time: 0.116761 Sep 23 03:51:49.749080 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1434/2937] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:49 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:51:50.531522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:50.533602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:50.545343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:50.546414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:50.547086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:50.548345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:50.549037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:50.549827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:50.732224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:50.733022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:50.747223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:50.747716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:50.748154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:50.748863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:50.749317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:50.749777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:51.472486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:51.486011 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cc4af87-8b0e-4af7-aa8d-a4a2357a87e9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.956219 Sep 23 03:51:51.488043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1504/2938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:50 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:51.501844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d71c2cd-e0c9-4a39-838b-e65a88156dd4", "tag": "23193385-e71a-4b3f-a74c-db39fe3f0e47"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:51.528236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:51.529966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:51.530735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:51.584453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] Creating event network-changed:23193385-e71a-4b3f-a74c-db39fe3f0e47 for instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 on n-h1-858495-2 Sep 23 03:51:51.599924 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-261ed602-966d-4078-af92-be0fb7e1fec9 req-c4be6d0b-60d0-414d-bfbe-ceeb6aa6818e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109662 Sep 23 03:51:51.601222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1505/2939] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:51.620499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:51.622700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:51.640805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:51.643440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:51.644221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:51.647078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:51.647796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:51.650166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:51.720478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:51.735545 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7dc6370e-c192-408b-82db-3ac7377aa618 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1577 microversion: 2.1 time: 1.008076 Sep 23 03:51:51.743403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1435/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:50 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1577 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:51.854204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:51.872912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:51.874896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:51.882775 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-362d1c28-43bb-476e-bcf2-82d8894a38f1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1321 microversion: 2.26 time: 0.280014 Sep 23 03:51:51.899874 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1506/2941] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:51 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:51:52.515365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:52.516252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:52.534010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:52.534501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:52.535124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:52.536004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:52.536728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:52.537421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:52.911265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:52.912458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:52.921496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:52.922352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:52.923053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:52.924003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:52.924667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:52.930676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:53.043786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:53.065469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:53.068154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:53.069831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5a02346-c913-4ca4-a313-1c11f79028ec tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1319 microversion: 2.26 time: 0.162880 Sep 23 03:51:53.070052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:53.071779 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1507/2942] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:52 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:51:53.080180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2035dccb-e872-4235-bb61-187582757654 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.569324 Sep 23 03:51:53.095159 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1436/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:52 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:54.101073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:54.104066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:54.111170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:54.112482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:54.114914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:54.115406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:54.115912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:54.116916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:54.117332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:54.117926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:54.123169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:54.124279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:54.125230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:54.126464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:54.127016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:54.127541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:54.444743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:54.450007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:54.469276 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b4453c9-df34-4e27-aef0-4fb27e4717da tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.362530 Sep 23 03:51:54.490993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:54.505819 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1437/2944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:54 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:54.507283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:54.511000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ab14ac8-ccef-46e8-9ed5-12761c8f971b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.414569 Sep 23 03:51:54.531718 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1508/2945] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:54 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:51:55.497758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:55.499951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:55.516505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:55.517013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:55.519163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:55.519971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:55.520444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:55.520879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:55.539780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:55.540492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:55.569509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:55.570030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:55.575007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:55.577096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:55.578959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:55.580746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:55.600921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:55.854078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:55.871465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:55.873905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:55.875285 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09c14196-7440-4ce4-abe8-4653691684b7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.340111 Sep 23 03:51:55.882935 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1509/2946] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:55 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:51:56.029194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:56.035237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:56.069394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10d71d24-92c9-4444-96ec-e40cda4333fb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.576733 Sep 23 03:51:56.088197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1438/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:55 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:56.909724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:56.910498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:56.924015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:56.924901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:56.925618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:56.926612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:56.927102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:56.927510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:57.102346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:57.104572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:57.128626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:57.130533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:57.131250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:57.132333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:57.133548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:57.134479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:57.316862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:57.335730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:57.342336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:57.348155 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ac4f411-0b05-4bb0-b2bd-cce588a3b9db tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.442415 Sep 23 03:51:57.360371 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1510/2948] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:56 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:51:57.365090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2fd219-f882-44d2-86a2-76ff167ac61c", "tag": "1f7eadf7-73e6-4e92-914d-dd785169fab3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:51:57.385096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:57.391575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:57.392367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:57.408857 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] Creating event network-changed:1f7eadf7-73e6-4e92-914d-dd785169fab3 for instance cd2fd219-f882-44d2-86a2-76ff167ac61c on n-h1-858495-2 Sep 23 03:51:57.425846 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7c497eaa-12c2-40c0-988d-e62c59080464 req-8aa5d4d5-a584-4622-986e-e5afbb520a5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060057 Sep 23 03:51:57.427114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1511/2949] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:51:57.550173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:57.562201 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c51a430a-7971-4d7b-9fec-adc8741a2a32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.465784 Sep 23 03:51:57.563128 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1439/2950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:57 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:51:58.388199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:58.388918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:58.409120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:58.409717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:58.410166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:58.410889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:58.411352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:58.411783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:58.592481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:51:58.595797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:51:58.620046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:58.622856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:58.625724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:58.626866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:51:58.629753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:51:58.630514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:51:59.433969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:59.491615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:51:59.552746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:59.573533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:59.573533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:59.594862 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f7c68c5-4186-472f-936c-6adfd3ce86c1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 1.211779 Sep 23 03:51:59.595520 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1512/2951] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:51:58 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:51:59.613765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:51:59.630213 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5752d2c-faa8-4fc9-b055-ec885fb96be8 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 1.047994 Sep 23 03:51:59.631528 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1440/2952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:51:58 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:00.635942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:00.637791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:00.660813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:00.661782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:00.664756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:00.667898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:00.668795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:00.669459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:00.670828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:00.671576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:00.672381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:00.680963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:00.688073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:00.688685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:00.689731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:00.690224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:00.690922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:01.291530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:01.300405 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62e22c41-c633-4e0f-86da-63715ce8f904 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.643188 Sep 23 03:52:01.302073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1441/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:00 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:01.544916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:01.567194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:01.571118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:01.572632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0a64b29-d338-4c82-ac7d-632843809076 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.944201 Sep 23 03:52:01.573811 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1513/2954] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:00 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:02.332668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:02.333638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:02.346465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:02.347125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:02.348877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:02.349857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:02.350326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:02.350771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:02.608593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:02.609221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:02.618720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:02.618990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:02.619265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:02.620027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:02.621616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:02.622287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:03.291623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:03.306464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf65be26-dfd8-4418-95d9-44dfa23604f9 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.982103 Sep 23 03:52:03.307071 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1442/2955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:02 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:03.316195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2fd219-f882-44d2-86a2-76ff167ac61c", "name": "network-vif-plugged", "status": "completed", "tag": "1f7eadf7-73e6-4e92-914d-dd785169fab3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:03.333809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:03.334998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:03.335844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:03.354112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] Creating event network-vif-plugged:1f7eadf7-73e6-4e92-914d-dd785169fab3 for instance cd2fd219-f882-44d2-86a2-76ff167ac61c on n-h1-858495-2 Sep 23 03:52:03.362951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-50dc525a-0867-418b-b0cf-2bf63ec371da req-97fe076b-b5d9-402b-b1dd-4cdd02b5c334 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053268 Sep 23 03:52:03.364009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1443/2956] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:03.431561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:03.449495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:03.455338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:03.460840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a964db4-1e8b-4bdd-be3e-6016beb86ac7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.857121 Sep 23 03:52:03.487776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1514/2957] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:02 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:04.333383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:04.334468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:04.357450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:04.358301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:04.359010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:04.359897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:04.360592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:04.361557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:04.605145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:04.616190 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-acdb7fd2-1dd2-4b58-a2f6-92fa2600cea2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.287669 Sep 23 03:52:04.617400 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1444/2958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:04 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:04.627220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:04.633462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:04.645712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1858016974", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "5f98c5c4-b534-48ba-a077-43b45820e902"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:04.646662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:04.647355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:04.647992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:04.649145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:04.649866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:04.650583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:04.813154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] validate_networks() for [('5f98c5c4-b534-48ba-a077-43b45820e902', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:52:05.007945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:05.033754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:05.035909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:05.041077 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3117e225-a98b-455a-868c-d5bf3cc9665e tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1361 microversion: 2.26 time: 0.419921 Sep 23 03:52:05.059518 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1445/2959] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:04 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:05.080558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:05.086436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:05.092329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Searching by: {'deleted': False, 'project_id': '5b1f02a5548d493483ebcad2e339605c'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:05.106449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.107210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.107791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.109040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.110511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.112030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.224056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:05.315141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ceb4850-8e44-4668-ac1f-da56e8883707 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.253613 Sep 23 03:52:05.316116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1446/2960] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:52:05 2022] GET /compute/v2.1/servers => generated 339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:05.591488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:05.591923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:05.592404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:05.592837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:05.593232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:05.605478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.606036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.606702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.608964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.609552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.610914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.663852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:05.676810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for user bb763b81c4da4dea80f92bf1de1d2d54 and project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:05.696762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-532133928", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fadce686-cfb9-45b5-8a6f-428d20302907"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:05.724991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:52:05.727411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:52:05.793527 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0fe3550-3635-4f97-843d-48be39b55879 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368402 Sep 23 03:52:05.801715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] validate_networks() for [('fadce686-cfb9-45b5-8a6f-428d20302907', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:52:05.803253 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1515/2961] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:52:05.821382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:05.826775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:05.827653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Searching by: {'deleted': False, 'project_id': '5b1f02a5548d493483ebcad2e339605c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:05.836746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.837242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.837717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.855054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:05.855726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:05.856190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:05.921512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:06.067957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:06.079862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:06.080468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:06.080774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:06.590698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7e1d549-68c8-4718-8a79-eda776710425 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.786270 Sep 23 03:52:06.591276 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1516/2962] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:52:05 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:06.610640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:06.611547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:06.624891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:06.625760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:06.626205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:06.626958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:06.627377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:06.627809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:06.733686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:06.734692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:06.735420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:06.736069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:06.736639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:06.752534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:06.762770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:06.763535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:06.766964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:06.767755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:06.768617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:06.827976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:06.835840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for user 4b4d19ac638246b1954cb2d2b2b54bce and project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:06.878237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:52:06.884995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:52:06.996672 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7088fce2-17d5-4f0b-80d8-8e1b70da0840 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678966 Sep 23 03:52:06.997989 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1447/2963] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:52:07.002484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.017382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f984e25a-44c7-4179-a3bb-bdd25b79f41c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.424833 Sep 23 03:52:07.018766 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1517/2964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:06 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:07.024128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.024989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.029107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.029772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.052669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.054157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.054355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.055120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.057995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.058183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.058978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.059472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.059925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.060294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.061100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.063019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.275346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.297094 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a532958-f8b3-44cb-b3c1-49e52ca9d44f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1214 microversion: 2.1 time: 0.297584 Sep 23 03:52:07.297751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1448/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:06 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:07.319145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31c5c0d5-9e6b-4122-ae68-191fb11d78b7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.362416 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31c5c0d5-9e6b-4122-ae68-191fb11d78b7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.056452 Sep 23 03:52:07.365500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1449/2966] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:52:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:07.374935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f6e1afe-4c96-470f-83ce-a3e80ccf1603 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.376054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9f6e1afe-4c96-470f-83ce-a3e80ccf1603 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.435152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.455310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.458284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.461548 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79a93bdf-7fe7-42ef-b6dd-0812f1879842 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1545 microversion: 2.26 time: 0.441335 Sep 23 03:52:07.467375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1518/2967] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:07 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1545 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:07.496419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a8d7c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.506611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.507103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.507575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.508039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.515094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.515573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.516018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.516794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.517258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.517711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.537334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f6e1afe-4c96-470f-83ce-a3e80ccf1603 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:07.549255 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f6e1afe-4c96-470f-83ce-a3e80ccf1603 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1224 microversion: 2.1 time: 0.182576 Sep 23 03:52:07.549902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1450/2968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:07 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:07.579293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.579776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.580739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.600260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.601010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.601648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.650650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:07.699690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd8caa64-596e-46fc-b2e2-6406923334c9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1838583834" status: 201 len: 0 microversion: 2.26 time: 0.207838 Sep 23 03:52:07.699882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.700218 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1519/2969] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:07 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1838583834 => generated 0 bytes in 209 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:07.706415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.720282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c06273c0-5a57-41c6-917e-b0b0847a330d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a74c310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.724035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.724750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.725197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.725954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.726429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.726951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.780182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c06273c0-5a57-41c6-917e-b0b0847a330d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.781701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c06273c0-5a57-41c6-917e-b0b0847a330d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.782746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c06273c0-5a57-41c6-917e-b0b0847a330d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.800025 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c06273c0-5a57-41c6-917e-b0b0847a330d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1838583834" status: 204 len: 0 microversion: 2.26 time: 0.085300 Sep 23 03:52:07.801329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1520/2970] 10.222.0.25 () {60 vars in 1361 bytes} [Fri Sep 23 03:52:07 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1838583834 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:07.814196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a6e7820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:07.822266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:07.828056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.830370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:07.831118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.831922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.832738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:07.878935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.881985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.886021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.888027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.892311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.893036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.969009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:07.969564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:07.971399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:07.998951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:08.044938 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd3c022e-b791-4577-a9ee-ad4a04767277 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 204 len: 0 microversion: 2.26 time: 0.225399 Sep 23 03:52:08.046139 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1521/2971] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Sep 23 03:52:07 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 03:52:08.057093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.059314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:08.068054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.069937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.071119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.072213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.073186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.073835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.078111 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8de91064-5147-4e8d-b387-5af1eb100bc6 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 204 len: 0 microversion: 2.1 time: 0.383802 Sep 23 03:52:08.091119 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1451/2972] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:07 2022] DELETE /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:52:08.105799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4074ce6-5352-4567-950a-d64c2e217f99 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a6304c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.126004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4074ce6-5352-4567-950a-d64c2e217f99 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.130071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4074ce6-5352-4567-950a-d64c2e217f99 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.130871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4074ce6-5352-4567-950a-d64c2e217f99 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.173970 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4074ce6-5352-4567-950a-d64c2e217f99 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 12 microversion: 2.26 time: 0.080840 Sep 23 03:52:08.174660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1452/2973] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 12 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:08.192031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.193328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:08.212101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.213183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.214227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.215114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.215782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.216428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.571492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:08.580375 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1bdda634-b894-458a-83bb-cdb0903a3dc7 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1714 microversion: 2.1 time: 0.401187 Sep 23 03:52:08.581681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1453/2974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1714 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:08.587294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a79c430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.606694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:08.609545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.610050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.610503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.611638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:08.621457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:08.623718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.624679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.625328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.626323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.627063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.627825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.645070 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13140f41-92bd-4906-8e48-037f7bb4ec12 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.597023 Sep 23 03:52:08.645898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1522/2975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:08.691782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.692110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.692716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.707416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.708791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:08.733120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.733644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.736759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.741733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.742801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.747714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.751469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.752859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.754665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.825766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:08.865497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3cfc440-6f6a-441c-9baf-c8ad172a874a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1944372466" status: 201 len: 0 microversion: 2.26 time: 0.282109 Sep 23 03:52:08.866174 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1454/2976] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:08 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1944372466 => generated 0 bytes in 284 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:08.877089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.877797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:08.885047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.885511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.885958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.886669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.887133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.887756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.911994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:08.928690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:08.939934 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-247f6479-f297-4e5e-b022-ba8db39dee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1276 microversion: 2.1 time: 0.292601 Sep 23 03:52:08.943003 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1523/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:08.967654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c64630fb-7e1c-42f5-8fc9-047646ff922f tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8b10a4c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:08.977919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c64630fb-7e1c-42f5-8fc9-047646ff922f tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:08.981959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c64630fb-7e1c-42f5-8fc9-047646ff922f tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:08.982674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c64630fb-7e1c-42f5-8fc9-047646ff922f tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:08.993419 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c64630fb-7e1c-42f5-8fc9-047646ff922f tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 36 microversion: 2.26 time: 0.034384 Sep 23 03:52:08.994169 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1524/2978] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 36 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:09.005720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a6a3ca0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.018414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.019453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.020475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.021336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.027847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:09.032266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.032956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.034520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.035305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.035787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.036229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.040812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:09.044940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2701ed86-eefb-4e31-b703-8036d99ff3e4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1276 microversion: 2.1 time: 0.172158 Sep 23 03:52:09.054092 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1455/2979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:08 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:09.070743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.071302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.071953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.106284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:09.137485 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a0df2af-e57a-423e-b6fa-8eb57cfcdf59 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1944372466" status: 204 len: 0 microversion: 2.26 time: 0.135879 Sep 23 03:52:09.138726 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1525/2980] 10.222.0.25 () {60 vars in 1364 bytes} [Fri Sep 23 03:52:08 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1944372466 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:09.149305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a2754b4-ead8-432f-86d0-ec8b83216194 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a6304c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.159610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a2754b4-ead8-432f-86d0-ec8b83216194 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.160112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a2754b4-ead8-432f-86d0-ec8b83216194 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.160608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a2754b4-ead8-432f-86d0-ec8b83216194 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.183426 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a2754b4-ead8-432f-86d0-ec8b83216194 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 12 microversion: 2.26 time: 0.039537 Sep 23 03:52:09.184909 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1456/2981] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:52:09 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:09.197060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a6a3a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.213412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.215970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.217212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.217212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.234396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.237563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.238097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.238867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.239346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.243977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.303823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.304377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.304970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.322441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:09.372873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-250cb288-3b06-4ad5-b5a8-c7ea45847429 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 204 len: 0 microversion: 2.26 time: 0.180285 Sep 23 03:52:09.374042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1526/2982] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Sep 23 03:52:09 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:09.387351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a595700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.411671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.417262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.417262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.417994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.436095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.436915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.437478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.438305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.438850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.440418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.490377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.490979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.491592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.504170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.504914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.505540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.540723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:09.562128 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf8f361e-b3ba-4035-8aa5-a27dd733b40a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-2127665468" status: 201 len: 0 microversion: 2.26 time: 0.181347 Sep 23 03:52:09.564466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1457/2983] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:09 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-2127665468 => generated 0 bytes in 184 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:09.577379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a74c280>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.588308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.589401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.589864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.590320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.596824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.597382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.605113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.605811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.609095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.609959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.610451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.610902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.615915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.616406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.616846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.617599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.618067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.618504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.703774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.705655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.708194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.735748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.736625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.737464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.794803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:09.818849 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6dc41684-0ba7-4dd6-ae8b-1e50129c28a9 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1244312702" status: 201 len: 0 microversion: 2.26 time: 0.247560 Sep 23 03:52:09.820026 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1527/2984] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:09 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1244312702 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:09.826291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:09.827065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:09.834723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.835559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.836387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:09.837294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:09.837853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:09.838358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.587691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:10.602049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aafe3b31-1fa3-44f6-b35f-616015117dc9 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1714 microversion: 2.1 time: 1.001778 Sep 23 03:52:10.602592 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1458/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:09 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1714 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:10.631452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8baeddc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:10.654266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.659228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.659928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.660695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:10.679930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.681433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.682852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.684136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.686353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.686917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.766973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.767486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.768047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.821477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:10.846938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-914e1739-160f-49f4-ae8f-543c51029816 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 204 len: 0 microversion: 2.26 time: 0.232684 Sep 23 03:52:10.848721 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1459/2986] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Sep 23 03:52:10 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:10.855300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:10.856098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:10.863309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.864351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.864351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.865463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.866067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.866654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.907090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:10.915549 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d6eeaf6-153b-418d-9a85-a35a63c9596e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 1.094205 Sep 23 03:52:10.916396 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1528/2987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:09 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:10.921636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:10.922606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:10.929919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.930786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.931461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:10.933099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:10.933833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:10.934366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.443204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:11.454830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7efe07f-a1fb-4fe0-a6c5-42c575fa4207 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.537056 Sep 23 03:52:11.457734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:11.474140 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1529/2988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:10 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:11.481461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72d4560d-4157-4b9f-b349-a44e4a881b88 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8b0ff040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:11.493698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72d4560d-4157-4b9f-b349-a44e4a881b88 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.495181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72d4560d-4157-4b9f-b349-a44e4a881b88 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.495468 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-301391f0-737d-4ecf-8307-7f60af3451f2 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.644559 Sep 23 03:52:11.502751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1460/2989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:10 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:11.505769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72d4560d-4157-4b9f-b349-a44e4a881b88 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.514474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:11.527130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:11.528098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Searching by: {'deleted': False, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:11.534151 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72d4560d-4157-4b9f-b349-a44e4a881b88 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 12 microversion: 2.26 time: 0.058628 Sep 23 03:52:11.534694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.535192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.535637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.536375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.536832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.537623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.546007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1530/2990] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:52:11 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:11.561958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8b0ff790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:11.579051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:11.586390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.587788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.588267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.590779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:11.607255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.607911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.608449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.609556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.610329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.611096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.622363 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9c669573-716d-4c6a-bada-1322cd86ad97 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.122567 Sep 23 03:52:11.623351 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1461/2991] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:52:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:11.636529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:11.641569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.642191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:11.642435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.643034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.643401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Searching by: {'deleted': False, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:11.649441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.650586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.651642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.652829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.653323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.653760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.659023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:11.680271 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-110131d0-eaaa-498a-a270-108a719336e8 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 204 len: 0 microversion: 2.26 time: 0.130826 Sep 23 03:52:11.685719 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1531/2992] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Sep 23 03:52:11 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:11.692674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:11.693709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:11.706710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.707837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.708973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:11.711777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:11.713171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:11.715161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.009208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:12.065688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:12.073867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.074364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.074807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.191156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:12.205777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4eff053-1e9b-44d5-aac1-32fc1d6ab5a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1714 microversion: 2.1 time: 0.513268 Sep 23 03:52:12.207093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1532/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:11 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1714 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:12.213454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8b184820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.225371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.226206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.226659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.227139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:12.233044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.233902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.234347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.235055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.235505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.236260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.273460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.274112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.274561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.286713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.287337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.287964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.323411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:12.350180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd9daaef-0799-4155-a561-3a263d3e38a7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1587849435" status: 201 len: 0 microversion: 2.26 time: 0.141624 Sep 23 03:52:12.353450 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1533/2994] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:12 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1587849435 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:12.362875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09e620c-ae84-4bcc-a4ec-b1631f82520b", "tag": "fe55ca6d-c648-4351-9517-8159273c4656"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:12.374577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.375070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.375510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.388472 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] Creating event network-changed:fe55ca6d-c648-4351-9517-8159273c4656 for instance d09e620c-ae84-4bcc-a4ec-b1631f82520b on n-h1-858495-2 Sep 23 03:52:12.393901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0682bae2-090f-49bb-8e76-7fa1b540ae65 req-bf5991ff-bd2b-4661-93dd-f55ef30a347b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 Sep 23 03:52:12.394674 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1534/2995] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:12.395145 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-afd7dc5a-1255-48b5-b8d1-a48c16e8fbe3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.763265 Sep 23 03:52:12.395727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1462/2996] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:52:11 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:12.401157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a5de280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.401685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.402617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:12.410103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.410752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.411271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.412062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.412601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.413159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.419672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.420429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.420863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.421588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:12.428902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.429942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.430788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.431881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.433091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.433752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.475919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.476916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.477815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.494038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.495124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.495776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.525840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:12.551714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e5822ad-83c7-460e-933c-0dd7f81a3f4d tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1160505194" status: 201 len: 0 microversion: 2.26 time: 0.152776 Sep 23 03:52:12.553094 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1463/2997] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Sep 23 03:52:12 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags/tempest-tag-1160505194 => generated 0 bytes in 156 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 03:52:12.560529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08c484ce-a1ab-42dc-889a-a227521d15da tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.571463 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08c484ce-a1ab-42dc-889a-a227521d15da tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016386 Sep 23 03:52:12.572672 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1464/2998] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:52:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:12.582870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.585624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:12.597230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.605020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.605845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.607344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.608915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.609585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.880740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:12.894677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a208a6fc-4760-446c-976b-545a80394a11 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.498942 Sep 23 03:52:12.909753 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1535/2999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:12 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:12.909753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:12.909753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:12.934532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.935389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.935808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:12.936544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:12.937198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:12.937484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.014397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.023260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-69656c20-6f5b-45a5-80d7-d12bfcf5dbae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.448116 Sep 23 03:52:13.024373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1465/3000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:12 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.042774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Action: 'update_all', calling method: .version_select at 0x7f0c8a5d9b80>, body: {"tags": ["tempest-tag-1480616458", "tempest-tag-1147149825"]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:13.058858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.059754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.061321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.062114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.073851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.074621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.075066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.076009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.076475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.076909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.111401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.114030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.114823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.139714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:13.159249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ef566466-e08d-45dd-b6da-cfcc93a5876a tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 62 microversion: 2.26 time: 0.133473 Sep 23 03:52:13.160747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1466/3001] 10.222.0.25 () {62 vars in 1312 bytes} [Fri Sep 23 03:52:13 2022] PUT /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 62 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.167422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e7d614-1a2f-4299-8bbd-2ed5a4d89068", "tag": "cc997a48-0266-42f0-8de0-0251b90e930a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:13.179558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.180379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.181209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.198958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] Creating event network-changed:cc997a48-0266-42f0-8de0-0251b90e930a for instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 on n-h1-858495-2 Sep 23 03:52:13.204911 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c03dfe56-269c-4a84-846a-1dda00858264 req-c9edb613-a396-48ce-b5ff-c2f05630c678 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042599 Sep 23 03:52:13.206316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1467/3002] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:13.213079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.214396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.222218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.223164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.224482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.225546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.226440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.227259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.264452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:13.271947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:13.278248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.287423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e4e7730e-ad6d-4cd4-a5b4-224a19653986 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.389314 Sep 23 03:52:13.288018 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1536/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:12 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.304538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49909266-4e14-4254-9901-8f650ed716bc tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a8e9160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.330558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49909266-4e14-4254-9901-8f650ed716bc tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.331231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49909266-4e14-4254-9901-8f650ed716bc tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.331956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49909266-4e14-4254-9901-8f650ed716bc tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.337270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:13.354752 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49909266-4e14-4254-9901-8f650ed716bc tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 200 len: 62 microversion: 2.26 time: 0.053744 Sep 23 03:52:13.355393 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1537/3004] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 23 03:52:13 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 62 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.367606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.368230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.368994 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ee218ad-b3f8-4318-9f96-f9f45cef68b3 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 204 len: 0 microversion: 2.1 time: 0.160370 Sep 23 03:52:13.370698 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1468/3005] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:13 2022] DELETE /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:13.377585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.377980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '.version_select at 0x7f0c8a61f040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.378206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.378715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.379769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.380236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.380673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.388163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.388798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.389301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.389963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.396424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.396919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.397431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.398148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.398601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.399170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.439437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.439937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.441039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.472247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.472861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'flavor' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:13.481573 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c41c3607-a67b-4299-9af8-f2cc575322cf tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1647 microversion: 2.1 time: 0.119599 Sep 23 03:52:13.482900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1538/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:13 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1647 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.487860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.488405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.493998 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6133861-8551-417c-9eaa-be69f02b184b tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags" status: 204 len: 0 microversion: 2.26 time: 0.121646 Sep 23 03:52:13.494275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.495337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.499546 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1469/3007] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Sep 23 03:52:13 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:13.499676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.499676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.499676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.499676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.508506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.509431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.516531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.517037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.517511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.518231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.519320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.519763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.558731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:13.665725 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a9c6235-0508-4487-9d42-c4e3598cfada tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 204 len: 0 microversion: 2.26 time: 0.160429 Sep 23 03:52:13.669789 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1470/3008] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:52:13 2022] DELETE /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:52:13.679473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.680662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.690051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.690933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.692592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.692720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.694275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.694752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.695191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.701634 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17e1cc74-1998-4a6e-b43c-bc159ff6812d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1608 microversion: 2.1 time: 0.217403 Sep 23 03:52:13.702601 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1539/3009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:13 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1608 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:13.892394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.902838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.904627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:13.906868 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-363a0e8e-c9bc-479b-a1fe-9dc020089ec7 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1551 microversion: 2.26 time: 0.235252 Sep 23 03:52:13.907607 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1471/3010] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:13 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1551 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:13.936492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:13.937434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:13.943807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.944372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.944904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:13.945704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:13.946225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:13.946712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.054792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:14.055547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:14.064364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.064819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.065274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.066025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.066616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.066957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.127063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:14.135849 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f209deb-0c2e-4f96-a541-db7034a99b32 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.208147 Sep 23 03:52:14.136689 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1540/3011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:13 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:14.297269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:14.306972 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7efaf9b5-9589-4bea-8eea-4d15af72b973 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.256541 Sep 23 03:52:14.314888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:14.315529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:14.323361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.324048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.324917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.325820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.326452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.326888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.329656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1472/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:14 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:14.507524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:14.508160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:14.517717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.518374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.519020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.520084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.520542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.521008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.648498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:14.650274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:14.658752 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24540a1b-6b15-4ea5-9b07-85241459fb04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.348083 Sep 23 03:52:14.658975 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-622aaf94-cd87-42d7-a74a-1f78ee3ed1c4 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1362 microversion: 2.1 time: 0.155673 Sep 23 03:52:14.659907 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1473/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:14 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:14.660439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1541/3014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:14 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:14.728632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:14.729299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:14.735752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.736512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.736971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.737858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.738325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.738764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.944489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:14.945485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:14.954474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.955832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.956480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.957464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:14.958455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:14.959198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:14.990283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.003378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c39a1362-4777-40fb-b76d-f62fd5c20719 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1608 microversion: 2.1 time: 0.279016 Sep 23 03:52:15.004012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1474/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:14 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1608 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:15.159800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:15.160479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:15.168442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.169277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.170067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.171177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.172172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.172803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.242933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.255038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.258030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.260304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-154db0b9-e939-4e1c-b12c-e7255aca0bf1 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1551 microversion: 2.26 time: 0.320179 Sep 23 03:52:15.260898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1542/3016] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:14 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1551 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:52:15.272157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e6bca3-caeb-477b-8b07-e65384e32c7a", "name": "network-vif-deleted", "tag": "33bd7132-3bcc-4437-90c0-9a4f018ec3d4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:15.285058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.285695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.286196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.300837 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] Creating event network-vif-deleted:33bd7132-3bcc-4437-90c0-9a4f018ec3d4 for instance c0e6bca3-caeb-477b-8b07-e65384e32c7a on n-h2-858495-2 Sep 23 03:52:15.306652 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-61a0f819-1674-48fd-a96e-7b79d71539bd req-30a3ee2e-9d16-415c-87dd-d16adbb99e05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039866 Sep 23 03:52:15.308492 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1543/3017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:52:15.338638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:15.339639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:15.352333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.353507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.354852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.356362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.357948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.362014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.406525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.420031 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ffbc4da5-5edc-47b3-866e-f62a69daf923 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1472 microversion: 2.1 time: 0.261866 Sep 23 03:52:15.421389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1475/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:15 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:15.682605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:15.683243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:15.691106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.692547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.693247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.694243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.695024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.695863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.871247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:15.873580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:15.882936 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9287197f-779a-43bc-a39c-eab47389d4cd tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1362 microversion: 2.1 time: 0.204652 Sep 23 03:52:15.883726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1476/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:15 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:15.907138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:15.907389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:15.914402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.914908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.915339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.916233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:15.916713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:15.917132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:15.993577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.004307 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed885493-96c6-4526-aead-d372b92cf9fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.673434 Sep 23 03:52:16.005001 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1544/3020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:15 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:16.030395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:16.031436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:16.039250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.039871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.040484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.041388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.042014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.042564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.063253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:16.324383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.351754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9f924cf-1eff-4853-af94-a7d041141298 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.448857 Sep 23 03:52:16.363811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1477/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:15 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:16.379662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:16.388325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:16.397108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.397721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.397892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.398635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.399528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.400160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.401321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.407587 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-527d7fca-a678-4d95-8975-a71d06ac56c0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1608 microversion: 2.1 time: 0.382143 Sep 23 03:52:16.409839 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1545/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:16 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1608 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:16.418967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2fd219-f882-44d2-86a2-76ff167ac61c", "name": "network-vif-deleted", "tag": "1f7eadf7-73e6-4e92-914d-dd785169fab3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:16.435404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.436144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.436956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.465103 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] Creating event network-vif-deleted:1f7eadf7-73e6-4e92-914d-dd785169fab3 for instance cd2fd219-f882-44d2-86a2-76ff167ac61c on n-h1-858495-2 Sep 23 03:52:16.475901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72832756-b891-4156-a71f-af29158a030b req-8f156c6f-7cb6-42e2-9e92-189681e81ac4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064357 Sep 23 03:52:16.476534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1546/3023] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:16.486180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:16.486807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.486972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:16.493882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.494431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.495137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.495803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.496133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.496657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.497102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.498053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.499296 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84d92d0d-3a1b-42d8-bd06-9705c4d3c19c tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1346 microversion: 2.26 time: 0.134246 Sep 23 03:52:16.509444 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1478/3024] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:16 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:16.661335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:16.675239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a975daff-81aa-4dac-a723-483b0963cc59 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1478 microversion: 2.1 time: 0.194469 Sep 23 03:52:16.688603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1547/3025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:16 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1478 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:16.759170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09e620c-ae84-4bcc-a4ec-b1631f82520b", "name": "network-vif-plugged", "status": "completed", "tag": "fe55ca6d-c648-4351-9517-8159273c4656"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:16.773820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.774314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.774755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.792153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] Creating event network-vif-plugged:fe55ca6d-c648-4351-9517-8159273c4656 for instance d09e620c-ae84-4bcc-a4ec-b1631f82520b on n-h1-858495-2 Sep 23 03:52:16.797826 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-91775934-cf76-4d92-bcec-03ea2f7dbf17 req-785e1222-189f-4af3-a297-f8dc35964a36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043085 Sep 23 03:52:16.798788 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1479/3026] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:16.909395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:16.910481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:16.917224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.917776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.918226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.918949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.919514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.919860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.955297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:16.955786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:16.956233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:16.957072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lazy-loading 'fault' on Instance uuid c0e6bca3-caeb-477b-8b07-e65384e32c7a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:16.999200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d761b90df492e8e5ebfb897d72d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1f02a5548d493483ebcad2e339605c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.007947 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2791d794-a3b2-4d70-9996-c91fadf4d4a3 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 200 len: 1367 microversion: 2.1 time: 0.103389 Sep 23 03:52:17.008548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1548/3027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:16 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:17.030884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:17.031727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:17.041970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.042486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.042937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.043663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.044130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.044627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.382658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.384737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:17.385701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:17.398443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.399801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.399921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-294157fe-f387-4e45-9498-ac9d066f497d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.372588 Sep 23 03:52:17.401345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1480/3028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:17 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:17.402101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.403534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.404054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.404507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.437471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:17.443283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:17.457102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.457896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.461219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.462227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.462868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.464508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.799740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.803242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:17.809637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.823084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d03f9245-caca-4958-8fbb-5a0086edfff5 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1608 microversion: 2.1 time: 0.392287 Sep 23 03:52:17.833937 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8f69ad9-b70c-4d8f-8c0d-e3eb870aa9bd tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.447977 Sep 23 03:52:17.833937 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1549/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:17 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:17.833937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:17.833937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:17.843232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.843760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.844205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.845304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.845825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.846543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.848024 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1481/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:17 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1608 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:17.853581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:17.857573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:17.864411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.865226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.866121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.867033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.867689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.868309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.886450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:17.886934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:17.887371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:17.887823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lazy-loading 'fault' on Instance uuid cd2fd219-f882-44d2-86a2-76ff167ac61c {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:17.970354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.980742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.982697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a04439d6d5d04321a2c619e11d936a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89faa549323046e1822043f0fa88077e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:17.985013 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-036d2a46-0344-432e-86b1-37eff12f1912 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 200 len: 1351 microversion: 2.26 time: 0.156904 Sep 23 03:52:17.985806 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1550/3031] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:17 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:18.042720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:18.043354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] [instance: c0e6bca3-caeb-477b-8b07-e65384e32c7a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:18.050101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.050613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.051147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:18.051857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.052699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.053138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:18.069077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] HTTP exception thrown: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Request method failure captured: Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a HTTP/1.1 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSzk0Vq8LXS6gThNNbapU5A1lFptolajkRkKICfRHj5Ksm6qHdjFLsPYkbSbv98zmCzW8axXdc5S2D85awQTsvYpwh3AY34wkoSXm-G6GcliuvDB_uSYW5HqhYm8BMF4l4PYvApmmH0D4XmhMSY5n9E9_DCU1aqRPyo9VJc05qQD3DU Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5b1f02a5548d493483ebcad2e339605c Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestManualDisk-407946271 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b1f02a5548d493483ebcad2e339605c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b1f02a5548d493483ebcad2e339605c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b1f02a5548d493483ebcad2e339605c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b1f02a5548d493483ebcad2e339605c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestManualDisk-407946271 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5b1f02a5548d493483ebcad2e339605c Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestManualDisk-407946271 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestManualDisk-407946271-project Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a27d761b90df492e8e5ebfb897d72d22 Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestManualDisk-407946271-project Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'c0e6bca3-caeb-477b-8b07-e65384e32c7a'} Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:18.070855 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. Sep 23 03:52:18.079188 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:18.081041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Returning 404 to user: Instance c0e6bca3-caeb-477b-8b07-e65384e32c7a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:18.082521 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62d11048-3a0b-4d51-86d9-468f4dc3391e tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a" status: 404 len: 111 microversion: 2.1 time: 0.046182 Sep 23 03:52:18.083863 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1551/3032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:18 2022] GET /compute/v2.1/servers/c0e6bca3-caeb-477b-8b07-e65384e32c7a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:52:18.101492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af4c14f5-6b74-422b-acad-19cfea3d6727 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] Calling method '.version_select at 0x7f0c8b184670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:18.114580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:18.124941 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af4c14f5-6b74-422b-acad-19cfea3d6727 tempest-ServersTestManualDisk-407946271 tempest-ServersTestManualDisk-407946271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360023093" status: 202 len: 0 microversion: 2.1 time: 0.030082 Sep 23 03:52:18.125897 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1552/3033] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360023093 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:52:18.131158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-450d017e-e2ad-414f-bb67-628878649355 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1478 microversion: 2.1 time: 0.281222 Sep 23 03:52:18.132706 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1482/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:17 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1478 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:18.424681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:18.425308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:18.438138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.438981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.439857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:18.440998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.441754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.442692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:18.854453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:18.855210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:18.868002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.871468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.872214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:18.873918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:18.874611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:18.875332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.049947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:19.055692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:19.066284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3f9afb7-ae21-41bd-98db-0f6c5c20124d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1540 microversion: 2.1 time: 0.215759 Sep 23 03:52:19.066497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-745fd195-1713-400e-a3a7-eae7382ded23 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1324 microversion: 2.1 time: 0.646925 Sep 23 03:52:19.081412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1553/3035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:18 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:19.081620 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1483/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:18 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1540 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:19.081710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:19.082091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:19.096007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5907bb-2adf-4192-b903-fe9bbdf8ca37", "name": "network-vif-deleted", "tag": "48efa0fc-3ca4-418d-9207-8dd17dc234ea"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:19.098184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.098896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.099528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.100804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.101516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.107734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.120289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.121151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.121825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.140694 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] Creating event network-vif-deleted:48efa0fc-3ca4-418d-9207-8dd17dc234ea for instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 on n-h2-858495-2 Sep 23 03:52:19.153840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9acfe086-a6cc-4216-96b4-7a76c1104878 req-a6aa5ac4-57e3-44a9-a813-90e1819ac70a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083712 Sep 23 03:52:19.155348 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1484/3037] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:19.162777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:19.163503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] [instance: cd2fd219-f882-44d2-86a2-76ff167ac61c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:19.171866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.172561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.173097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.173954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.174518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.175168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.190300 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] HTTP exception thrown: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Request method failure captured: Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c HTTP/1.1 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1THKnaIJn8Exk_vcaZcPU-6-MNtqqGXU0E-BCluzmlV_HRlMPX56IASSVUA47NjmaO_9K4hQYholfZ0sweuBMmd2I0ZxXAh_pNqjG5a4XWIx0wrG9bGjkFr6PhAMcWoH9y5LZ-ArPMlPX8Otf0jN8j_WEVhcFrTcalNbwGPcrpPkg Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.26 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 89faa549323046e1822043f0fa88077e Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerTagsTestJSON-936889230 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89faa549323046e1822043f0fa88077e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89faa549323046e1822043f0fa88077e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89faa549323046e1822043f0fa88077e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89faa549323046e1822043f0fa88077e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerTagsTestJSON-936889230 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 89faa549323046e1822043f0fa88077e Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerTagsTestJSON-936889230 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerTagsTestJSON-936889230-project Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: a04439d6d5d04321a2c619e11d936a69 Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerTagsTestJSON-936889230-project Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cd2fd219-f882-44d2-86a2-76ff167ac61c'} Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:19.192235 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. Sep 23 03:52:19.199484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:19.204193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] Returning 404 to user: Instance cd2fd219-f882-44d2-86a2-76ff167ac61c could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:19.206811 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a81fde8-541a-4efb-8bed-ca0b23c6cac6 tempest-ServerTagsTestJSON-936889230 tempest-ServerTagsTestJSON-936889230-project] 10.222.0.25 "GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c" status: 404 len: 111 microversion: 2.26 time: 0.048661 Sep 23 03:52:19.210230 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1485/3038] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:19 2022] GET /compute/v2.1/servers/cd2fd219-f882-44d2-86a2-76ff167ac61c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:52:19.216504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:19.218010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:19.225001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.225739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.226326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.227110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.227845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.228447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:19.712094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:19.722181 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6453f93e-c005-4bb0-a2e3-e04beff7a3b9 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.652970 Sep 23 03:52:19.723670 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1554/3039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:19 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:19.762738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:19.776862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-70eac65f-8c74-453e-921a-d7fd4df4c422 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1478 microversion: 2.1 time: 0.565371 Sep 23 03:52:19.778707 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1486/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:19 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1478 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:19.959856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-unplugged", "status": "completed", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:19.981251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:19.985441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:19.987678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.024059 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] Creating event network-vif-unplugged:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:52:20.033676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-13793d07-77d2-4095-9e5c-30a1bd690f9e req-4a0b9674-3d69-492c-9b2e-a291e16c78ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079239 Sep 23 03:52:20.037654 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1555/3041] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:20.092221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:20.092845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:20.102076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:20.103296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:20.109051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.109605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.110042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.110760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.111228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.111660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.112783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.113611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.114901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.115782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.116453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.117050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.232779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:20.248803 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef9e8bdc-b3af-4765-bfbb-34ed5e253029 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1251 microversion: 2.1 time: 0.158876 Sep 23 03:52:20.250422 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1556/3042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:20 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1251 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:20.443429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:20.468435 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85c5d6a3-62dd-4af1-87d9-5cba5755ad44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.379795 Sep 23 03:52:20.471470 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1487/3043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:20 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:20.493748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:20.495245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:20.502249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.502972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.503577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.504461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.505200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.505861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.536267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:20.750071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:20.750887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:20.763759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.764539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.765170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:20.766104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:20.766571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:20.767007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:21.637452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:21.646071 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2841c7e8-dd12-49a0-bce8-1c1d4e344f50 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 1.156374 Sep 23 03:52:21.657394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1557/3044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:20 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:21.676286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:21.677612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:21.718417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:21.718947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:21.719489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:21.720214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:21.720677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:21.721124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:21.982380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:22.000746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:22.034647 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-027c1822-9ed8-464a-9cfb-967b30643d00 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 1.280857 Sep 23 03:52:22.036419 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1488/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:20 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:22.044179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:22.051899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.062186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:22.070661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.071453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.074144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.075150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.087435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.088158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.188996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:22.194116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:22.202288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-620c1422-0722-4911-b729-2f42a6708cf3 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1463 microversion: 2.1 time: 0.536817 Sep 23 03:52:22.206033 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1558/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:21 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1463 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:22.208247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81911056-07ac-4ee4-8771-0ec09a7b66d0 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1251 microversion: 2.1 time: 0.170389 Sep 23 03:52:22.221502 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1489/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:22 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1251 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:22.223448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e7d614-1a2f-4299-8bbd-2ed5a4d89068", "name": "network-vif-plugged", "status": "completed", "tag": "cc997a48-0266-42f0-8de0-0251b90e930a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:22.230526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8325b00-ae67-4dfd-8b9e-ba7e80e9ea41 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-48896493", "metadata": {"": ""}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8325b00-ae67-4dfd-8b9e-ba7e80e9ea41 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action HTTP/1.1 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 105 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-48896493", "metadata": {"": ""}}} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-48896493', 'metadata': {'': ''}}}} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'': ''} Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:52:22.235365 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:22.239611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:22.243723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8325b00-ae67-4dfd-8b9e-ba7e80e9ea41 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:22.244876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8325b00-ae67-4dfd-8b9e-ba7e80e9ea41 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action" status: 400 len: 170 microversion: 2.1 time: 0.037661 Sep 23 03:52:22.249047 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1559/3048] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Sep 23 03:52:22 2022] POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action => generated 170 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:52:22.252935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.253456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.255451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:22.257322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.258948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.267184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.268206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.275908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.277034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.277716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.278123 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] Creating event network-vif-plugged:cc997a48-0266-42f0-8de0-0251b90e930a for instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 on n-h1-858495-2 Sep 23 03:52:22.278512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.284374 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fac8ef35-7810-485d-801b-1be610a59438 req-bc988a6b-45ae-44a4-a4a8-8fa2eb3a437b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073848 Sep 23 03:52:22.288018 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1490/3049] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:22.296145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:22.296877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.305950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.306983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.307460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.308200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.308659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.309149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.434745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7005f41-810c-4766-a3f6-523af55fec25 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 0 microversion: 2.1 time: 0.183974 Sep 23 03:52:22.435919 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1560/3050] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:52:22 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:52:22.449976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:22.451229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.475715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.476833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.477971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.479793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.480503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.481094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.519973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.520807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.521498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.522113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lazy-loading 'fault' on Instance uuid 10edce15-3b09-4f71-b024-2c2f29cf9017 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:22.765128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:22.791305 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f140bcc9-d24b-4ff3-9fdd-9c5b0d4b3762 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1597 microversion: 2.1 time: 0.346568 Sep 23 03:52:22.792235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1561/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:22 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1597 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:22.817803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:22.820249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.823843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:22.838375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.838675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.839133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.839678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54ddca3f-1213-421f-9093-3f2287596f15 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.545846 Sep 23 03:52:22.842242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.842757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.843212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.857387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1491/3052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:22 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:22.876984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:22.877643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:22.918134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:22.921278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.922044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.922489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:22.925191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:22.952147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:22.952787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.003809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62132fe1-6ab0-416c-89ab-49db6b0bc2c7 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action" status: 202 len: 0 microversion: 2.1 time: 0.189752 Sep 23 03:52:23.004783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1562/3053] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:52:22 2022] POST /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:52:23.013222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:23.025956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:23.041017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.041547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.041998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.042718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.043183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.043621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.426997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:23.447100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a28f350-5971-4565-8e5f-d39853dad033 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.576686 Sep 23 03:52:23.450837 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1492/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:22 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:23.457328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:23.505842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:23.524730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.533863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.534448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.540302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.541843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.542564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.664811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a8b804b-c852-475b-93cc-198bfbf38127 tempest-ServersAdminTestJSON-1966229476 tempest-ServersAdminTestJSON-1966229476-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1614 microversion: 2.1 time: 0.653336 Sep 23 03:52:23.684793 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1563/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:23 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1614 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:23.696583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:23.698015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:23.713845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.716965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.717776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.721011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.721731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.722355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.878829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:23.897214 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a525dd01-aa86-4119-90f6-71d8eb8b5730 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1251 microversion: 2.1 time: 0.210714 Sep 23 03:52:23.898997 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1564/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:23 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1251 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:23.912362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-448746a6-33e3-486d-b8d2-7d16aee06d5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2027557932", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-448746a6-33e3-486d-b8d2-7d16aee06d5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action HTTP/1.1 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 619 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2027557932", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2027557932', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:52:23.920598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:52:23.923838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:23.934471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-448746a6-33e3-486d-b8d2-7d16aee06d5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:23.935888 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-448746a6-33e3-486d-b8d2-7d16aee06d5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action" status: 400 len: 938 microversion: 2.1 time: 0.028192 Sep 23 03:52:23.936995 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1565/3057] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Sep 23 03:52:23 2022] POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:52:23.943483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:23.944282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:23.955003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.955801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.957118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:23.958182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:23.959314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:23.960115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.028752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:24.076651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:24.093245 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24c8bc22-15be-493b-8630-f7f6a532b463 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1318 microversion: 2.1 time: 0.640313 Sep 23 03:52:24.099284 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1493/3058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:23 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:24.139469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:24.142570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:24.170344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.172665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.173133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.173910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.177337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.178235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.282419 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d90e81be-6ca3-4ac0-bf07-5939e1871fbb tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 204 len: 0 microversion: 2.1 time: 0.343405 Sep 23 03:52:24.286261 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1566/3059] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:23 2022] DELETE /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:24.293597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:24.293597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:24.308644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.309138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.312825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.313599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.314070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.314508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.668101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:24.684200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:24.692208 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-66d12ace-8279-48c2-9445-26b88cd934c4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.587576 Sep 23 03:52:24.697540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8ebec71-1ac3-41bf-85c7-2b49be7d96b2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1468 microversion: 2.1 time: 0.409414 Sep 23 03:52:24.714082 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1567/3060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:24 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:24.723542 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1494/3061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:24 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:24.729543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:24.731988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-plugged", "status": "completed", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:24.737823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:24.749510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.751882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.752775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.753504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.754503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.755232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.755893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.756625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.761406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.785068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] Creating event network-vif-plugged:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:52:24.792314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-12a2b66a-72fc-44cf-8bc1-1531fbe81fb8 req-a1668441-2cce-4ec1-ab51-fae8bc2d868d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076620 Sep 23 03:52:24.797043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1568/3062] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:24.926164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:24.929276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:24.944086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.947899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.953235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:24.954397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:24.955128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:24.955818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:25.309942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:25.318657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1db6a7dc-c542-465a-ab6a-fb751ff3f089 tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1251 microversion: 2.1 time: 0.399304 Sep 23 03:52:25.319345 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1569/3063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:24 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1251 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:25.347345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:25.348539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:25.387027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:25.387946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:25.388563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:25.390418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:25.391082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:25.391706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:25.699015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:25.707519 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bef77ed4-28a4-46b6-aed3-e647d7dbb9ab tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.982504 Sep 23 03:52:25.708313 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1495/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:24 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:25.727404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:25.728322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:25.740662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:25.741902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:25.742834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:25.744208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:25.749706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:25.750729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.091059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:26.106094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e31a9846-0598-4cf3-b385-e989fb757292 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1509 microversion: 2.1 time: 0.779878 Sep 23 03:52:26.107820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1570/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:25 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1509 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:26.118612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d02bb68d-4926-4da5-bebc-1fdc6367a380 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d02bb68d-4926-4da5-bebc-1fdc6367a380 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action HTTP/1.1 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 285 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.129395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:52:26.135118 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:26.138302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d02bb68d-4926-4da5-bebc-1fdc6367a380 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:26.139593 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d02bb68d-4926-4da5-bebc-1fdc6367a380 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action" status: 400 len: 619 microversion: 2.1 time: 0.030351 Sep 23 03:52:26.140674 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1571/3066] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Sep 23 03:52:26 2022] POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:52:26.146525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:26.148132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:26.156469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.157205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.157828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.158729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.159520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.159936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:26.160481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.179670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74715d4a-06d0-4a66-a638-615fbc854cd2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1468 microversion: 2.1 time: 0.456092 Sep 23 03:52:26.180298 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1496/3067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:25 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:26.191535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:26.191535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:26.203805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.208796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.210235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.211065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.211632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.216091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.838950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:26.847165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:26.854322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:26.873720 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0aa4455c-48ab-45c0-a708-33dcc2fd5f00 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.692212 Sep 23 03:52:26.889447 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3d99082-3dba-444d-a046-4e7a3c6d0305 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1509 microversion: 2.1 time: 0.737738 Sep 23 03:52:26.889684 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1497/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:26 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:26.889799 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1572/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:26 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:26.890025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:26.891147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:26.910398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:26.913087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:26.940739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.947782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.950080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.951048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.951647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.952322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.952988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.953957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.954424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:26.957761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:26.958715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:26.959333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.139546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a3a03385ba4c54972c7fbf55dc867b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e44577f9f2d4ae3a0301069b9b6ae2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:27.149147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f2959c3-1e39-436f-98e2-2b127fc1abdc tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 200 len: 1251 microversion: 2.1 time: 0.266127 Sep 23 03:52:27.150690 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1498/3070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:26 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 1251 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:27.157012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:27.161237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:27.169050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.169915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.170681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.171555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.172174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.172760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.295122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:27.295803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:27.297023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:27.297892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:27.299922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:27.390700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:27.407090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:27.422313 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7cad8aaf-bb7f-460e-83b4-06515c760bd5 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.522228 Sep 23 03:52:27.428433 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1573/3071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:26 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:27.447415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:27.448799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:27.470650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.475072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.475687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.476936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.479974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.481781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.502440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:27.519673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.520620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.521542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.524655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.526779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.528008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.654786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0d59e82-2415-45fc-8059-d723266646a4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "POST /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068/action" status: 202 len: 1111 microversion: 2.1 time: 0.502510 Sep 23 03:52:27.661078 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1499/3072] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:52:27 2022] POST /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068/action => generated 1111 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 03:52:27.680125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1847037297"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:27.687295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:27.690549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:27.700110 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d747202-1b08-4ff0-8d0d-e0021f3837e2 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 200 len: 1426 microversion: 2.1 time: 0.270337 Sep 23 03:52:27.704562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.705915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.708489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.709600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.711883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.714757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.715702 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1574/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:27 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 1426 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:27.754491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:27.801368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:27.802421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Searching by: {'deleted': False, 'project_id': '80f277bc73c74769a96f2d5e83a599fd'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:27.822565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.824404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.829685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.832722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:27.833915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:27.836016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:27.906037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:27.985096 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e57191c1-34d2-467c-a733-787b2239871b tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.264163 Sep 23 03:52:28.002922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1575/3074] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:52:27 2022] GET /compute/v2.1/servers => generated 334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:28.011073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8", "name": "network-vif-deleted", "tag": "57af964f-eebb-4fff-8519-ac4601e7442b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:28.022667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.024119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.024563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.046529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] Creating event network-vif-deleted:57af964f-eebb-4fff-8519-ac4601e7442b for instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 on n-h2-858495-2 Sep 23 03:52:28.052021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d6e242f0-c8c6-4d72-af91-fee97debaf56 req-2dac96ee-2db2-4042-a243-25037bdb8391 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Sep 23 03:52:28.052923 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1576/3075] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:28.058892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.059739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:28.069100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.069602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.070049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.070937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.071407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.071866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.323939 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-640b5476-2bec-40ab-a5cd-85bb0b3e390b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action" status: 202 len: 0 microversion: 2.1 time: 0.656262 Sep 23 03:52:28.327905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1500/3076] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:52:27 2022] POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:52:28.367511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.391017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:28.391882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Searching by: {'deleted': False, 'project_id': '80f277bc73c74769a96f2d5e83a599fd'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:52:28.408935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.410102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.410102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.410878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.411350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.411912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.416042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:28.435216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b10151e9-3958-4e18-b680-4d75dc98a1bf tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.380921 Sep 23 03:52:28.449677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1577/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:28 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:28.454445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.455514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] [instance: 7e5907bb-2adf-4192-b903-fe9bbdf8ca37] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:28.465271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:52:28.475117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.475857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.482281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.483148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.489814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.490541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.520604 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] HTTP exception thrown: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Request method failure captured: Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 HTTP/1.1 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSz11WiVlw7Kp6K4Tyl1JzLwzr9R0uDsFv77TtiLBfXwyP5ufTg5ejXW8xUNPpSoCnduw738Aef6-c33q1EHcnU1icWsaDwBKP4_u4bKrGAsrMAqobVVSPG0gTtFYh52nS51HwiFrocXTNZss1UvYWAng8j-YWZnTGyfkp0NL43ZIOk Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2e44577f9f2d4ae3a0301069b9b6ae2b Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestBootFromVolume-610168624 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e44577f9f2d4ae3a0301069b9b6ae2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e44577f9f2d4ae3a0301069b9b6ae2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e44577f9f2d4ae3a0301069b9b6ae2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e44577f9f2d4ae3a0301069b9b6ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestBootFromVolume-610168624 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2e44577f9f2d4ae3a0301069b9b6ae2b Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestBootFromVolume-610168624 Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestBootFromVolume-610168624-project Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f3a3a03385ba4c54972c7fbf55dc867b Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestBootFromVolume-610168624-project Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7e5907bb-2adf-4192-b903-fe9bbdf8ca37'} Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:28.522321 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. Sep 23 03:52:28.527708 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.532055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Returning 404 to user: Instance 7e5907bb-2adf-4192-b903-fe9bbdf8ca37 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:28.534632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13ea93be-836b-4425-aa6c-2e058cd874ef tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37" status: 404 len: 111 microversion: 2.1 time: 0.092124 Sep 23 03:52:28.537800 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1578/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:28 2022] GET /compute/v2.1/servers/7e5907bb-2adf-4192-b903-fe9bbdf8ca37 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:52:28.549312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:28.549930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-219236342"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:28.557611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:28.574717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.575146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.575614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.576332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.576784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.577215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.579093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.579702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.580267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.671425 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Cannot 'createImage' instance d09e620c-ae84-4bcc-a4ec-b1631f82520b while it is in task_state image_snapshot Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action HTTP/1.1 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 84 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-219236342"}} Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot 'createImage' instance d09e620c-ae84-4bcc-a4ec-b1631f82520b while it is in task_state image_snapshot Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-219236342'}}} Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:52:28.674243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d09e620c-ae84-4bcc-a4ec-b1631f82520b while it is in task_state image_snapshot Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d09e620c-ae84-4bcc-a4ec-b1631f82520b while it is in task_state image_snapshot Sep 23 03:52:28.679169 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:28.681790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 409 to user: Cannot 'createImage' instance d09e620c-ae84-4bcc-a4ec-b1631f82520b while it is in task_state image_snapshot {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:28.683147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-352d6cd1-9916-43b7-aabd-893258e95c16 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action" status: 409 len: 159 microversion: 2.1 time: 0.143383 Sep 23 03:52:28.684299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1579/3079] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:52:28 2022] POST /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b/action => generated 159 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:52:28.691876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99614216-38e4-442c-ab89-54e19cea108d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] Calling method '.version_select at 0x7f0c8bd5a820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.739451 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99614216-38e4-442c-ab89-54e19cea108d tempest-ServersTestBootFromVolume-610168624 tempest-ServersTestBootFromVolume-610168624-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924589938" status: 202 len: 0 microversion: 2.1 time: 0.053779 Sep 23 03:52:28.740581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1580/3080] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924589938 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:52:28.749438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b836743c-d0b0-4cbb-9ad9-e3c6ed3fc137 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8b10a160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.923028 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7fb6ea47-8aa8-40eb-8091-4d6551face5d tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.592215 Sep 23 03:52:28.937800 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1501/3081] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:52:28 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:28.948472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:28.948956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:28.964035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.964586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.964995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:28.965752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:28.971968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:28.972666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.000799 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b836743c-d0b0-4cbb-9ad9-e3c6ed3fc137 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/images/54a6384f-2f6b-4932-8a28-5e982b31e95d" status: 204 len: 0 microversion: 2.1 time: 0.258949 Sep 23 03:52:29.001844 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1581/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:28 2022] DELETE /compute/v2.1/images/54a6384f-2f6b-4932-8a28-5e982b31e95d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:29.008493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c7f38c8-3cf6-4f44-90d8-f3e711825216 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.015418 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] HTTP exception thrown: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Request method failure captured: Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 HTTP/1.1 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzaiww8ksCOJdiedK7ZNaXoEVdi0ukBymlDP3CZHbg-RmlixONrr9YT0uM5VF1IndKx3xSL6j36NnufzQ076WzK6RWciYAOWZLFrdQfMyMrTtDEZXseNr0MtmZcSGmFKtLmAXMJhHLYlZzExmWMcU2cykt-tiGiuxIwfhiJcJ3ucjY Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c385317083c24b2cae54ebc64c19610e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 505327a949b74cca88abf6bb709da9c6 Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8'} Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:29.017184 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Returning 404 to user: Instance aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:29.021182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd0ae1f4-8667-48ba-a390-91c54042d40a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8" status: 404 len: 111 microversion: 2.1 time: 0.079776 Sep 23 03:52:29.035777 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1502/3083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:28 2022] GET /compute/v2.1/servers/aa0610bd-1dc7-4d8c-a2d7-200bb2a5ade8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:52:29.046024 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c7f38c8-3cf6-4f44-90d8-f3e711825216 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043494 Sep 23 03:52:29.048485 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1582/3084] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:52:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:29.049542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.051258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:29.054866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.061950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:29.065669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.067560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.068167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.071510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.073521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.074159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.078387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.079941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.082138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.083059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.117587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.121023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.231800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:29.387552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eabcd866-4011-4c96-b39b-1cabc652ad7e tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 204 len: 0 microversion: 2.1 time: 0.336664 Sep 23 03:52:29.390464 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1583/3085] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:29 2022] DELETE /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:29.404401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.405881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:29.416185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.420255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.421165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.423618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.424352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.424972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.889112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:29.893755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:29.903236 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ba8f25b-a29a-4137-b7da-4b3c9c864188 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1532 microversion: 2.1 time: 0.866116 Sep 23 03:52:29.908388 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1503/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:29 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1532 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:29.913369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.920209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:29.926772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-254389f5-d250-477c-b823-f26dbd57f076 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1469 microversion: 2.1 time: 0.531687 Sep 23 03:52:29.928393 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1584/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:29 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1469 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:29.951892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:29.952404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.954578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:29.954898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.955487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.957541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.959301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.962121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.972158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.972658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.977191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:29.977191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:29.979180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:29.979633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.042534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:30.199057 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2d0c923-ec1c-4790-80ac-0a592deadbdc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 204 len: 0 microversion: 2.1 time: 0.267354 Sep 23 03:52:30.203314 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1585/3088] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:29 2022] DELETE /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:30.210169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:30.210714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:30.218478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.219142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.219911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.220742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.221373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.221874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.381711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:30.394210 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-993fa309-ddd7-4e14-869b-ad7eb8408710 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.484475 Sep 23 03:52:30.395432 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1504/3089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:29 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:30.538080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:30.554056 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b86c6ea-ff49-44a2-aae0-91482017ddcc tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1702 microversion: 2.1 time: 0.348795 Sep 23 03:52:30.556199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1586/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:30 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1702 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:30.931372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:30.933625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:30.952006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:30.953181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:30.959913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.960799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.961476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.964394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.965752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.966418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.968269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.968964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.974281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:30.976709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:30.977403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:30.979579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:31.530835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:31.539531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ad999d4-f7e4-4fc3-bc3d-955a1236d370 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1469 microversion: 2.1 time: 0.591194 Sep 23 03:52:31.544095 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1587/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:30 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:31.552517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:31.556384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:31.570725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:31.571405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:31.572553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:31.575892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:31.576561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:31.579378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:31.870577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:31.880624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d411c92-e726-4ce1-8ff8-740b1584b06d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1538 microversion: 2.1 time: 0.953241 Sep 23 03:52:31.885000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1505/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:30 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1538 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:31.894796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:31.896086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:31.913514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:31.914333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:31.915337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:31.916770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:31.918736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:31.919811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:32.117105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:32.125066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb340c87-b42f-4a87-afe1-cf6fe83d9832 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.579496 Sep 23 03:52:32.125721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1588/3093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:31 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:32.568292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:32.569908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:32.573063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:32.580764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:32.582427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:32.585226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:32.587472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:32.588140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:32.589030 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3d3a2a1-ebf3-4bfd-9faf-8b8afb82f657 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1702 microversion: 2.1 time: 0.701999 Sep 23 03:52:32.590019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:32.601887 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1506/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:31 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1702 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:32.822010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:32.834468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21cf3cc7-3cdd-469a-a1f5-840c021d0594 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 200 len: 1427 microversion: 2.1 time: 0.270216 Sep 23 03:52:32.836879 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1589/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:32 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 1427 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:32.910681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:32.911310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:32.920472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:32.929195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:32.929989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:32.931065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:32.933467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:32.934122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.013879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92b83db-2e76-412e-9bc2-aeb39c34d807", "name": "network-vif-deleted", "tag": "cffd7744-dc89-4497-a787-89527dd60f4f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:33.044540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.045050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.045535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.056276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:33.081602 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] Creating event network-vif-deleted:cffd7744-dc89-4497-a787-89527dd60f4f for instance c92b83db-2e76-412e-9bc2-aeb39c34d807 on n-h1-858495-2 Sep 23 03:52:33.096602 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c26dc1b1-199d-49ae-8cc0-4ee9f95973f6 req-106d2b71-a96f-4c65-a3dc-bd3a8d84434e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088135 Sep 23 03:52:33.108442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1590/3096] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:33.153254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:33.154148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:33.175772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.182571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.185598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.186395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.186886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.187329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.878184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:33.883034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:33.896965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c2b8ea21-b0c8-4fcd-a18e-3f87a27eab20 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1538 microversion: 2.1 time: 0.986718 Sep 23 03:52:33.903371 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-efc14915-88bc-4460-84b8-e6a15a6cc2bc tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.752943 Sep 23 03:52:33.905524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1591/3097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:33 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:33.910263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1507/3098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:32 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1538 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:33.914165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09e620c-ae84-4bcc-a4ec-b1631f82520b", "name": "network-vif-plugged", "status": "completed", "tag": "fe55ca6d-c648-4351-9517-8159273c4656"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:33.919586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:33.920730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:33.928384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.928981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.929802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.930875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.931936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.932724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.937318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.937880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.939986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.956642 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] Creating event network-vif-plugged:fe55ca6d-c648-4351-9517-8159273c4656 for instance d09e620c-ae84-4bcc-a4ec-b1631f82520b on n-h1-858495-2 Sep 23 03:52:33.962266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-153ddd40-ada7-4a1f-9547-fc2debe481d4 req-170e3669-1520-4ab7-ab7c-628c491b8b95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054102 Sep 23 03:52:33.963840 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1592/3099] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:33.969851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:33.970719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: c92b83db-2e76-412e-9bc2-aeb39c34d807] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:33.977823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.978479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.978931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.979649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:33.980112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:33.980569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:33.994388 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] HTTP exception thrown: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Request method failure captured: Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 HTTP/1.1 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLSzaiww8ksCOJdiedK7ZNaXoEVdi0ukBymlDP3CZHbg-RmlixONrr9YT0uM5VF1IndKx3xSL6j36NnufzQ076WzK6RWciYAOWZLFrdQfMyMrTtDEZXseNr0MtmZcSGmFKtLmAXMJhHLYlZzExmWMcU2cykt-tiGiuxIwfhiJcJ3ucjY Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c385317083c24b2cae54ebc64c19610e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 505327a949b74cca88abf6bb709da9c6 Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'c92b83db-2e76-412e-9bc2-aeb39c34d807'} Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:33.996105 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Returning 404 to user: Instance c92b83db-2e76-412e-9bc2-aeb39c34d807 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:34.000179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-896d6aba-e759-41b7-934e-a26e00c83488 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807" status: 404 len: 111 microversion: 2.1 time: 0.032560 Sep 23 03:52:34.002280 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1593/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:33 2022] GET /compute/v2.1/servers/c92b83db-2e76-412e-9bc2-aeb39c34d807 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:52:34.008184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:34.009675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:34.015983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.016605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.017276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.018492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.018636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.019278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.057401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:34.176219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbec3008-c2fe-43cd-831f-c27a5506bbe4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 204 len: 0 microversion: 2.1 time: 0.171194 Sep 23 03:52:34.177244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1594/3101] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:34 2022] DELETE /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:52:34.188372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:34.189330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:34.203325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.204997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.205329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.206752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.207441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.208077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.750898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:34.793475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fc8d7a6-edaa-42fe-bdf2-c42ba15b33f9 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1702 microversion: 2.1 time: 0.879931 Sep 23 03:52:34.797387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1508/3102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:33 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1702 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:34.872534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:34.886840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-64f30c73-f08c-40e1-91c8-f148909c002c tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1469 microversion: 2.1 time: 0.703969 Sep 23 03:52:34.897264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1595/3103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:34 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1469 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:34.936608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:34.938715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:34.941190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:34.944558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:34.961690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.966261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.969752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.971306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.972645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.974881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.976241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.978752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.979818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:34.980259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:34.982057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:34.984127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:35.902284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:35.920364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05ee62cf-9cb3-40e5-b2e1-52a7f1424279 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1520 microversion: 2.1 time: 0.994651 Sep 23 03:52:35.923466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1509/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:34 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1520 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:35.932592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:35.933721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:35.940349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:35.941868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:35.943129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:35.944334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:35.945662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:35.947460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:35.949587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:35.953830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf259ef9-712f-4cd3-b855-5c313d164af8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 1.028828 Sep 23 03:52:35.958570 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1596/3105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:34 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:35.964294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:35.964917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:35.985571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:35.986996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:35.987458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:35.988192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:35.990558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:35.991055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.061123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:36.071591 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b457c91-3a25-4e8d-af28-dc05c98ad0e2 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1634 microversion: 2.1 time: 0.144835 Sep 23 03:52:36.072908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1510/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:35 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1634 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:36.078163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:36.079225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:36.086012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:36.086983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:36.087877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.089132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:36.089837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:36.090487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.138416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:52:36.281041 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-acd69847-765f-4f83-87c1-619394e138f4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 204 len: 0 microversion: 2.1 time: 0.205891 Sep 23 03:52:36.283044 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1511/3107] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:52:36 2022] DELETE /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:52:36.293686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:36.294397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:36.300385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:36.300881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:36.301322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.302061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:36.302531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:36.302959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.306526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:36.779513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:36.794044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-836d3120-dbe9-47c2-bd9e-6016ee72033a tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1469 microversion: 2.1 time: 0.833048 Sep 23 03:52:36.795065 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1597/3108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:35 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1469 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:36.813343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d71c2cd-e0c9-4a39-838b-e65a88156dd4", "name": "network-vif-deleted", "tag": "23193385-e71a-4b3f-a74c-db39fe3f0e47"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:36.844085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:36.846328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:36.846895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:36.877856 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] Creating event network-vif-deleted:23193385-e71a-4b3f-a74c-db39fe3f0e47 for instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 on n-h1-858495-2 Sep 23 03:52:36.890483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:36.893219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fd575dfe-d101-44e1-8c65-940d3dd9e6cc req-208d0986-babd-44c5-95a7-a12e14352997 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092475 Sep 23 03:52:36.894179 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1598/3109] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:36.902823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91e9b93a-c009-4e17-8ef6-0b2665520028 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1526 microversion: 2.1 time: 0.613354 Sep 23 03:52:36.918968 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1512/3110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:36 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1526 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:36.989408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:36.991856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:37.005905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:37.006764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:37.012095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:37.016043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:37.016558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:37.017021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:37.100252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:37.100857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:37.112787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:37.113289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:37.123957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:37.128178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:37.129992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:37.131418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:37.856596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:38.003634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d4aa75ead43cdb41b06e044e01a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f277bc73c74769a96f2d5e83a599fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:38.014170 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9800d7fa-414a-4c6c-ba79-d1e7df3ad103 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 200 len: 1634 microversion: 2.1 time: 0.918472 Sep 23 03:52:38.014768 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1513/3111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:37 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 1634 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:38.039728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:38.048006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:38.058491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:38.058990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:38.059434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:38.060279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:38.060602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:38.061035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:38.412649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:38.426090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:38.428667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54d59d69-9887-4fb3-9cc5-a002e5e5cd93 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 1.437778 Sep 23 03:52:38.453785 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1599/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:36 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:38.468880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:38.472133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:38.501500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:38.502060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:38.502929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:38.504278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:38.505016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:38.505698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:38.539566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:39.086629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:39.112194 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5386571-8cdc-42da-a6d3-8c1128714786 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1469 microversion: 2.1 time: 1.076913 Sep 23 03:52:39.114076 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1514/3113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:38 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1469 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:39.128218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:39.136887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] [instance: 8d71c2cd-e0c9-4a39-838b-e65a88156dd4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:39.157872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.158755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.159528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:39.160515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.161243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.162466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:39.209711 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] HTTP exception thrown: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Request method failure captured: Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 HTTP/1.1 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS00aNrw__sj_TLKRQZfZWbIZmf7KCKscTwftfg_JYJLAYkQST-rmbwRLMQY7ZMN8K-Yv2LvY8uWKycmMs-o55qimHAAEkepOvlcW6Ub8rP4jviOAL8-HHpV7mmeTh594Ad31PuqOK4gtCAQmVUz6MkMvTqG8-Gp0WPyMBKTolOxJVU Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 80f277bc73c74769a96f2d5e83a599fd Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-634399835 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80f277bc73c74769a96f2d5e83a599fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80f277bc73c74769a96f2d5e83a599fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80f277bc73c74769a96f2d5e83a599fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80f277bc73c74769a96f2d5e83a599fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-634399835 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 80f277bc73c74769a96f2d5e83a599fd Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-634399835 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-634399835-project Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d50d4aa75ead43cdb41b06e044e01a87 Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-634399835-project Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8d71c2cd-e0c9-4a39-838b-e65a88156dd4'} Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:39.211732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. Sep 23 03:52:39.215784 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:39.219841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Returning 404 to user: Instance 8d71c2cd-e0c9-4a39-838b-e65a88156dd4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:39.232427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb7469b9-c38f-48c7-a790-0cfad3b8a029 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4" status: 404 len: 111 microversion: 2.1 time: 0.116112 Sep 23 03:52:39.233458 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1515/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:39 2022] GET /compute/v2.1/servers/8d71c2cd-e0c9-4a39-838b-e65a88156dd4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:52:39.241945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f924a519-ac05-4378-8cce-5afd8a02b2d8 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] Calling method '.version_select at 0x7f0c8a7e2310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:39.282824 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f924a519-ac05-4378-8cce-5afd8a02b2d8 tempest-ServersTestJSON-634399835 tempest-ServersTestJSON-634399835-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023870339" status: 202 len: 0 microversion: 2.1 time: 0.044603 Sep 23 03:52:39.286523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1516/3115] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023870339 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:52:39.325801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:39.334605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40fe83fb-eb55-4232-9c32-d4270259bf62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1526 microversion: 2.1 time: 0.879494 Sep 23 03:52:39.340823 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1600/3116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:38 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1526 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:39.458425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:39.459253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:39.470587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.471375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.472046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:39.473153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.473899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.479147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:39.671144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09e620c-ae84-4bcc-a4ec-b1631f82520b", "name": "network-vif-unplugged", "status": "completed", "tag": "fe55ca6d-c648-4351-9517-8159273c4656"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:39.695488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.696337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.697023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:39.719966 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] Creating event network-vif-unplugged:fe55ca6d-c648-4351-9517-8159273c4656 for instance d09e620c-ae84-4bcc-a4ec-b1631f82520b on n-h1-858495-2 Sep 23 03:52:39.732942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0434806b-66a4-4ceb-9bbe-4e5cb4e699ec req-08beed41-50b2-48c8-ac36-66a28b47bd45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065587 Sep 23 03:52:39.734350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1601/3117] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:52:39.939703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edce15-3b09-4f71-b024-2c2f29cf9017", "name": "network-vif-deleted", "tag": "25133760-7171-4e86-a409-03f64c5d9f3d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:39.945286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:39.976536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:39.981372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:39.982210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.016141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] Creating event network-vif-deleted:25133760-7171-4e86-a409-03f64c5d9f3d for instance 10edce15-3b09-4f71-b024-2c2f29cf9017 on n-h2-858495-2 Sep 23 03:52:40.026576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4daed600-997b-47a9-aefa-d90826f5b346 req-9747eb2b-f365-445f-a327-2c21c4bd5ebc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090216 Sep 23 03:52:40.029240 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1602/3118] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:52:40.142655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:40.143465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:40.160772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:40.161699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:40.162385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.163191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:40.163898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:40.164520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.226634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:40.230179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:40.230741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.231657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lazy-loading 'fault' on Instance uuid 10edce15-3b09-4f71-b024-2c2f29cf9017 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:52:40.422002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505327a949b74cca88abf6bb709da9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c385317083c24b2cae54ebc64c19610e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:40.430138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0bbad8df-a269-4f16-a560-5ab85090eeff tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 200 len: 1304 microversion: 2.1 time: 0.292594 Sep 23 03:52:40.445397 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1603/3119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:40 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:40.445397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:40.445397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:40.459244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:40.461304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:40.462321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.470068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:40.470885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:40.474591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:40.490995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:40.543106 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fbbca1a-dc98-4317-8c30-2398843dd86a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 1.087859 Sep 23 03:52:40.544490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1517/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:39 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:40.740649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:40.755939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ae7a86f-b498-4afc-ad40-a4b15ee53116 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 200 len: 1484 microversion: 2.1 time: 0.323028 Sep 23 03:52:40.762271 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1604/3121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:40 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 1484 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:41.460773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:41.461450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] [instance: 10edce15-3b09-4f71-b024-2c2f29cf9017] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:41.486090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.487815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.488125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.492514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.493704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.496921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.551430 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] HTTP exception thrown: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Request method failure captured: Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 HTTP/1.1 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLSzaiww8ksCOJdiedK7ZNaXoEVdi0ukBymlDP3CZHbg-RmlixONrr9YT0uM5VF1IndKx3xSL6j36NnufzQ076WzK6RWciYAOWZLFrdQfMyMrTtDEZXseNr0MtmZcSGmFKtLmAXMJhHLYlZzExmWMcU2cykt-tiGiuxIwfhiJcJ3ucjY Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c385317083c24b2cae54ebc64c19610e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c385317083c24b2cae54ebc64c19610e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c385317083c24b2cae54ebc64c19610e Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminTestJSON-1701615983 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 505327a949b74cca88abf6bb709da9c6 Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminTestJSON-1701615983-project Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '10edce15-3b09-4f71-b024-2c2f29cf9017'} Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:41.557271 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] Returning 404 to user: Instance 10edce15-3b09-4f71-b024-2c2f29cf9017 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-623f7ebc-a5b3-43c9-af22-6b29692d1ff4 tempest-ServersAdminTestJSON-1701615983 tempest-ServersAdminTestJSON-1701615983-project] 10.222.0.25 "GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017" status: 404 len: 111 microversion: 2.1 time: 0.104631 Sep 23 03:52:41.566133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1518/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:41 2022] GET /compute/v2.1/servers/10edce15-3b09-4f71-b024-2c2f29cf9017 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:52:41.572205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:41.572829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:41.593422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.599497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.603301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.604503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.604929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.608640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.791839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:41.792602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:41.807586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.808252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.809871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.816127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:41.816646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:41.817100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:41.882468 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b HTTP/1.1 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b'} Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.886799 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e22c68b6-ac35-47da-bbfb-ba3c0f509e9b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 404 len: 111 microversion: 2.1 time: 0.102269 Sep 23 03:52:41.890573 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1519/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:41 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:52:41.911581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f62a70e2-be40-4a9d-9611-8a72e01a2b52 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'create', calling method: .version_select at 0x7f0c8a61fc10>, body: {"keypair": {"name": "tempest-keypair-1396054246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ77sKrfPYs4wbVAEcCsYaxgrBc0a07cVI4B/y/DlGv8uSk+L8LvT4BtK0R4cked5NnpVIo+TZpicBp2ioOQDwoSN7AspmHY+d+ozI8Bs0JOF+H9AY1K2n5IJ20lnEw1Q=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:41.949899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f62a70e2-be40-4a9d-9611-8a72e01a2b52 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:41.962714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f62a70e2-be40-4a9d-9611-8a72e01a2b52 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for user 4b4d19ac638246b1954cb2d2b2b54bce and project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:42.024168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f62a70e2-be40-4a9d-9611-8a72e01a2b52 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122802 Sep 23 03:52:42.029294 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1520/3124] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:52:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:52:42.147492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09e620c-ae84-4bcc-a4ec-b1631f82520b", "name": "network-vif-deleted", "tag": "fe55ca6d-c648-4351-9517-8159273c4656"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:42.167254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:42.167791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:42.168180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:42.194289 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] Creating event network-vif-deleted:fe55ca6d-c648-4351-9517-8159273c4656 for instance d09e620c-ae84-4bcc-a4ec-b1631f82520b on n-h1-858495-2 Sep 23 03:52:42.209592 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5befe084-7b2f-47db-addd-572e7ef04ee7 req-5bcef22e-78d7-4081-b71a-1cfcd4892220 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065810 Sep 23 03:52:42.210575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1521/3125] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:52:42.533760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:42.547851 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82e8437e-149e-49c3-826d-271d97571e44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.980078 Sep 23 03:52:42.549305 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1605/3126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:41 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:43.575582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:43.576676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:43.586289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:43.587124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:43.587755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:43.588654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:43.589482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:43.590901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:44.256849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:44.271682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7121599a-0b6c-4705-b89b-a40c5fcf5e96 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.698058 Sep 23 03:52:44.272551 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1522/3127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:43 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:45.296791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:45.297582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:45.310973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:45.311813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:45.312290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:45.313045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:45.313584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:45.314021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:45.767654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:45.776072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-492aaacf-678d-46bd-9616-11bd847fc62a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.484129 Sep 23 03:52:45.781933 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1606/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:45 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:46.811131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:46.812825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:46.833670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:46.836128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:46.837624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:46.838559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:46.839181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:46.839917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:47.265605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:47.292736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aaa72b5f-a451-481e-8380-028f79320dd7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.488629 Sep 23 03:52:47.315212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1523/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:46 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:47.972217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98d6bc67-9458-46b9-ae82-cde0431a0bf5 tempest-ExtensionsTest-657434494 tempest-ExtensionsTest-657434494-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:47.973882 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98d6bc67-9458-46b9-ae82-cde0431a0bf5 tempest-ExtensionsTest-657434494 tempest-ExtensionsTest-657434494-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.374029 Sep 23 03:52:47.974455 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1607/3130] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 03:52:47 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:47.984389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2acb4e7-9f46-4bea-9b1f-b4fcaaaf203e tempest-ExtensionsTest-657434494 tempest-ExtensionsTest-657434494-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:47.987481 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2acb4e7-9f46-4bea-9b1f-b4fcaaaf203e tempest-ExtensionsTest-657434494 tempest-ExtensionsTest-657434494-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007025 Sep 23 03:52:47.988077 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1524/3131] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 23 03:52:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:52:48.321615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:48.322446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:48.339516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:48.340206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:48.340798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:48.342683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:48.343341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:48.344259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:48.728078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:48.746069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b021b864-f910-4b6f-bceb-cd53acbf5dd4 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.428777 Sep 23 03:52:48.750230 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1608/3132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:48 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:48.917657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-382691319", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "5ba811f0-0e03-484b-a605-6f97c002a5a7"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:48.988301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] validate_networks() for [('5ba811f0-0e03-484b-a605-6f97c002a5a7', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:52:49.775843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:49.776468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:49.790463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:49.791242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:49.791887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:49.793344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:49.794019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:49.795436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:50.016606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:50.017075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:50.017538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:50.018135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:50.018878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:50.043037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:50.043892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:50.044705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:50.045535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:50.046011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:50.046453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:50.100659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Getting quotas for project 05d730881beb4d279d692f0539e67c13. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:50.115505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Getting quotas for user 5c53c134e52f474bb54a3b0699a93e9d and project 05d730881beb4d279d692f0539e67c13. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:50.148157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:52:50.156016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:52:50.192973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:50.297967 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31c52439-e8bb-47f5-b3f8-56ee9dc6e548 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.592731 Sep 23 03:52:50.303340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1525/3133] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 03:52:50.336558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:50.343538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:50.616662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:50.647910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:50.652648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:50.656290 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d9241038-080e-458d-8ac1-82be2cb67f03 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1258 microversion: 2.21 time: 0.340555 Sep 23 03:52:50.658825 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1526/3134] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:50 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1258 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:50.679487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1629948318", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:50.760170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:50.763413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:52:50.773073 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3367d5a0-abec-4957-b5f8-6548ad890b2e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 1.002108 Sep 23 03:52:50.774734 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1609/3135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:49 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:50.834195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] validate_networks() for [('fadce686-cfb9-45b5-8a6f-428d20302907', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:52:51.548565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1721808294", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:51.637173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:52:52.286155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:52.286718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:52.287198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:52.287711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:52.288203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:52.308863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.309540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.312751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:52.316968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.317764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.318383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:52.377793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:52.386386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for user 4b4d19ac638246b1954cb2d2b2b54bce and project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:52.403725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:52:52.406513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:52:52.529190 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a445f272-be21-45fd-aa45-543484afa7dc tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.868373 Sep 23 03:52:52.532095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1527/3136] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:52:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:52:52.553242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:52.565892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:52.575106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.582298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.587250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:52.592090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.592614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.593086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:52.872739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:52.881700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:52.883472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:52.894396 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39d808fb-cdb3-4c73-9d81-73bed1b4857b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1328 microversion: 2.21 time: 0.351361 Sep 23 03:52:52.909740 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1528/3137] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:52 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:52.922805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:52.923724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:52.960591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.962281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.962901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:52.967775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:52.969666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:52.970263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:53.396898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:53.415406 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-27d4a3d7-21b2-493c-af3d-d33ca137d50e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1516 microversion: 2.1 time: 0.497519 Sep 23 03:52:53.416282 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1529/3138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:52 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1516 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:53.425198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:53.428357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:53.465485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:53.466062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:53.485851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:53.492888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:53.493884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:53.494556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:53.731112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:53.741711 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d4b75ed-86c9-4f5c-9d02-fa4af01bbf7c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1229 microversion: 2.1 time: 0.324189 Sep 23 03:52:53.750126 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1530/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:53 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1229 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:53.911336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9cdc75ed-18b0-4e1f-b070-0893fc57db2e tempest-ComputeTenantNetworksTest-1895725547 tempest-ComputeTenantNetworksTest-1895725547-project] Calling method '.version_select at 0x7f0c8a6a7160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:54.408452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9cdc75ed-18b0-4e1f-b070-0893fc57db2e tempest-ComputeTenantNetworksTest-1895725547 tempest-ComputeTenantNetworksTest-1895725547-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.656729 Sep 23 03:52:54.420764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1531/3140] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 03:52:53 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:54.428399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:54.430968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:54.441308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.442448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.443159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:54.444136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.444873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.446928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:54.524382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:52:54.527320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:52:54.528060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:52:54.530470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:52:54.531892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:52:54.597523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.598521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.603339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:54.605912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.607485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.609679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:54.671769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:52:54.680803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:54.698971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:54.699848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:52:54.712000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:54.717206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-12a09198-e6f1-4e11-b311-625e141c81b2 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1316 microversion: 2.21 time: 0.294094 Sep 23 03:52:54.721290 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1532/3141] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:54 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:54.724398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:52:54.730264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:52:54.736972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f709e764-733c-4583-9574-7d8c8c66138f tempest-ComputeTenantNetworksTest-1895725547 tempest-ComputeTenantNetworksTest-1895725547-project] Calling method '.version_select at 0x7f0c8a6a78b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:54.870746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-572001a0-b246-495c-a320-f1720cd0ae61 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.667783 Sep 23 03:52:54.874491 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1610/3142] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:52:54.912636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:54.922509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:54.940003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.941927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.942754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:54.944090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:54.944741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:54.947028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:55.148306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f709e764-733c-4583-9574-7d8c8c66138f tempest-ComputeTenantNetworksTest-1895725547 tempest-ComputeTenantNetworksTest-1895725547-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/4b302262-d732-4632-8b20-f4731bb49b11" status: 200 len: 138 microversion: 2.1 time: 0.424932 Sep 23 03:52:55.148949 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1533/3143] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 03:52:54 2022] GET /compute/v2.1/os-tenant-networks/4b302262-d732-4632-8b20-f4731bb49b11 => generated 138 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:52:55.154580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:55.155540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:55.173939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:55.174431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:55.174927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:55.175589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:55.176045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:55.178560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:55.371626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:55.399646 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c9a7bae-f1e3-4b58-bd33-136c9617477a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1277 microversion: 2.1 time: 0.249149 Sep 23 03:52:55.403613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1534/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:55 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:55.428658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b356698f-8d6a-4fca-bb6a-8416b1cb519c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:55.432776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b356698f-8d6a-4fca-bb6a-8416b1cb519c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:55.513699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:55.521657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72524bdc-a3ac-4e80-adf9-ebb044d90b37 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1534 microversion: 2.1 time: 0.645584 Sep 23 03:52:55.522250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1611/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:54 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1534 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:55.687391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b356698f-8d6a-4fca-bb6a-8416b1cb519c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:55.701406 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b356698f-8d6a-4fca-bb6a-8416b1cb519c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1193 microversion: 2.1 time: 0.292081 Sep 23 03:52:55.702391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1535/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:55 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1193 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:55.755460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:55.756538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:55.787344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:55.787860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:55.788311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:55.789040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:55.794347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:55.794941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.432875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:56.433554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:56.447918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.450224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.478048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.479583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.480247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.481237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.519483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:56.541777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:56.550670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:56.554085 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6be7388d-e45a-47dc-b3dd-879c74088827 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.806526 Sep 23 03:52:56.559803 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1612/3147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:55 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:52:56.571754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:56.574889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:56.595847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.598735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.599219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.603001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.603727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.605804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.644234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:56.660579 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91de160a-d7d7-41c7-979a-7ffd38368bc4 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1295 microversion: 2.1 time: 0.232884 Sep 23 03:52:56.678078 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1536/3148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:56 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1295 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:56.727508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:56.728261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:56.738265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.739705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.740533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:56.742097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:56.742790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:56.743417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:57.002507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:57.014468 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42c2e392-cc98-41e8-91c6-5005d0ce810c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1245 microversion: 2.1 time: 0.291017 Sep 23 03:52:57.018798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1537/3149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:56 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1245 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:52:57.584349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:57.586739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:57.612591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:57.613704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:57.614417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:57.618134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:57.619674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:57.620400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:57.955493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:57.988169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-977062cf-8c9d-43c4-b693-fe829de654a6 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1522 microversion: 2.1 time: 1.427199 Sep 23 03:52:57.994074 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1613/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:56 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1522 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:58.000564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:58.002947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:58.016154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:58.016837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:58.017494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:58.018756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:58.020456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:58.021087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:58.962187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:58.979617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-57094919-37f0-4151-aa72-fe62be31a30a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1283 microversion: 2.1 time: 0.981437 Sep 23 03:52:58.980600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1614/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:57 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1283 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:59.000212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:59.000842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:59.019930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:59.020432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:59.020879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:59.021635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:59.022098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:59.022534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:59.416589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:59.431139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-84675516-441c-4ed7-b757-e2f8758d61e6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1251 microversion: 2.1 time: 0.449402 Sep 23 03:52:59.434610 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1615/3152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:58 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1251 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:52:59.476051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:52:59.479992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:52:59.494195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:59.494964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:59.495608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:59.496567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:59.497578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:59.498187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:59.616096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:59.634696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:59.643415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:52:59.647101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a49717d-2a8a-4c32-970a-e14fdd1769aa tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 2.066880 Sep 23 03:52:59.656919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1538/3153] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:52:57 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:52:59.666611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e7d614-1a2f-4299-8bbd-2ed5a4d89068", "name": "network-vif-plugged", "status": "completed", "tag": "cc997a48-0266-42f0-8de0-0251b90e930a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:52:59.694194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:52:59.697119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:52:59.698202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:52:59.722658 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] Creating event network-vif-plugged:cc997a48-0266-42f0-8de0-0251b90e930a for instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 on n-h1-858495-2 Sep 23 03:52:59.735770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2ca7aeaf-5494-4d48-b56b-ed80882aeda5 req-eb7c288c-61bf-4f64-8d6a-006a7f237c04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075223 Sep 23 03:52:59.750765 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1539/3154] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:00.009796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:00.010772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:00.025018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.027341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.027961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.031725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.032551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.033142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.065217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:00.438591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:00.459088 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1931abf4-91a6-48f5-a29a-807ac60018ae tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1283 microversion: 2.1 time: 0.454210 Sep 23 03:53:00.461749 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1540/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:00 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1283 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:53:00.484638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:00.490736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:00.513304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.519302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:00.531554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.532465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.534892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.536297 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f45f841-dda3-40f8-86be-559e729a15cb tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1522 microversion: 2.1 time: 1.088799 Sep 23 03:53:00.536748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.537463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.557325 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1616/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:52:59 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1522 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:00.686054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:00.687199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:00.697973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.698523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.698975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.699702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:00.700165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:00.700595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:00.762729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:00.782879 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f6713ea-07a6-4e8f-bff3-b9d4c576a95f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1251 microversion: 2.1 time: 0.319567 Sep 23 03:53:00.800127 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1541/3157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:00 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1251 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:01.326072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:01.335396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:01.349514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:01.350917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e16f0a5-8b91-46ce-bc43-7e0ffdbd25e8 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.669414 Sep 23 03:53:01.352123 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1617/3158] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:00 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:53:01.492696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:01.493539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:01.505606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:01.506125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:01.506578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:01.507307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:01.510176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:01.510643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:01.562436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:01.563152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:01.590403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:01.591473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:01.594575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:01.597675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:01.599606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:01.600724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:02.306918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:02.318404 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30a396e1-329b-44aa-b6b9-fd89c9eb141a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.836525 Sep 23 03:53:02.319286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1542/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:01 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:02.326330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:02.327163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:02.392666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:02.400514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:02.401258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:02.402038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:02.403828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:02.404469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:02.405430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:02.862913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:02.880526 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99f75382-d27e-4d42-a83a-622e192ad9f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1507 microversion: 2.1 time: 1.323196 Sep 23 03:53:02.894464 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1618/3160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:01 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1507 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:02.906619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e940bb9-4026-4f95-b58e-84ee73cfe1d4", "tag": "b841fc18-0840-4acd-99b9-1ca98a4df676"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:02.922539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:02.923037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:02.923475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:02.967093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] Creating event network-changed:b841fc18-0840-4acd-99b9-1ca98a4df676 for instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 on n-h2-858495-2 Sep 23 03:53:02.973405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c4f3c7e7-c9c0-47bf-b069-3b5568ca541b req-4a65f04a-844a-4d2b-9650-f80ab65b8bca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077384 Sep 23 03:53:02.975385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1619/3161] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:02.989865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:02.990689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:03.003180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:03.004033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:03.004343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:03.005613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:03.012763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:03.013781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:03.610149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:03.621221 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-daede6af-be6e-4c74-9c0b-6d35d88eee71 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 1.299874 Sep 23 03:53:03.622665 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1543/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:02 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:03.629179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:03.630259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:03.638670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:03.639521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:03.640487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:03.642984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:03.643814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:03.644654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:04.643783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:04.649328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:04.661306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:04.686642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:04.688087 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-70e4568f-86f7-4efd-a685-99913d1767d0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 1.711205 Sep 23 03:53:04.689165 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1620/3163] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:02 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:04.711518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:04.712722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:04.716206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:04.731532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:04.734327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:04.735050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:04.735977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:04.737650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:04.738825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:04.995299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:05.013067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cba4ea2f-3348-4252-9066-293bf88b2c66 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 200 len: 1507 microversion: 2.1 time: 1.388276 Sep 23 03:53:05.034945 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1544/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:03 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 1507 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:05.041979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:05.043121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:05.052935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:05.055059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:05.055763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:05.056742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:05.058282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:05.059020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:05.526157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:05.537369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1607ccc0-c610-49dd-af7b-c4f18774a98a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.846717 Sep 23 03:53:05.539919 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1621/3165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:04 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:05.692080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:05.776806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2037432869", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "28149f3d-7202-4c0e-84ec-a9fedc951b3c"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:05.856389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] validate_networks() for [('28149f3d-7202-4c0e-84ec-a9fedc951b3c', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:05.857808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:05.871998 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-685daa81-8d19-4c2b-8cc9-42152c79db88 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 0.834626 Sep 23 03:53:05.873236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1545/3166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:05 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:05.878229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:05.878870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:05.889167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:05.892572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:05.893338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:05.894194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:05.894745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:05.895388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:05.927566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:53:06.058865 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc3ad76c-cda9-487d-84b3-4afce8010448 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 204 len: 0 microversion: 2.1 time: 0.183994 Sep 23 03:53:06.062646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1546/3167] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:53:05 2022] DELETE /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:53:06.084842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:06.088882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:06.103149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:06.103885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:06.104445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:06.106584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:06.107384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:06.108459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:06.760483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:06.774769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:06.777668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:06.782162 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4ee22b3-ba3d-4947-9913-a221dec2964c tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.717845 Sep 23 03:53:06.783581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1547/3168] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:06 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:06.794171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-937067712", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "5f98c5c4-b534-48ba-a077-43b45820e902"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:06.910944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] validate_networks() for [('5f98c5c4-b534-48ba-a077-43b45820e902', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:06.955209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:06.955837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:06.956343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:06.957042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:06.957591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:06.968268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:06.969183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:06.969931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:06.971132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:06.971843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:06.972506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:06.995681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Getting quotas for project 9e6c2d5cf60f42c29b4267a594a93df4. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:07.002971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Getting quotas for user 901a04c1f6ad4f83829a0a0bf81d56b9 and project 9e6c2d5cf60f42c29b4267a594a93df4. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:07.021254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:07.024044 n-d-858495-2 devstack@n-api.service[128724]: WARNING nova.utils [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2037432869 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-203743286 Sep 23 03:53:07.025149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:07.097392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54bd0b16-8260-43f6-a796-2c7caa4acb09 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553455 Sep 23 03:53:07.099610 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1622/3169] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:07.112220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:07.116436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:07.131529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:07.134252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:07.134964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:07.136223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:07.137141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:07.137829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:08.046818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:08.054567 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7e4f4b9-273a-44f1-8436-cbd345b2841d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.953491 Sep 23 03:53:08.066519 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1623/3170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:07 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:08.084954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:08.086705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:08.092801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:08.093298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:08.093774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:08.096665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:08.097146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:08.101891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.590927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:09.607765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1bf04e09-30ae-47c5-b315-18e607797a55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 1.538952 Sep 23 03:53:09.609516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1624/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:08 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:09.615971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a79555c-3859-4566-a4ca-bb7e35508317", "tag": "f95012aa-3d19-44bc-a3f0-bc73484db38d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:09.649131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.649677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.650727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.689932 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] Creating event network-changed:f95012aa-3d19-44bc-a3f0-bc73484db38d for instance 8a79555c-3859-4566-a4ca-bb7e35508317 on n-h1-858495-2 Sep 23 03:53:09.703312 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-90623c91-444b-446e-bcd2-997c67bf01a1 req-043593ff-4293-48f6-b58f-9c91d98fcdf7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092479 Sep 23 03:53:09.710299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1625/3172] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:09.720867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:09.722181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:09.738489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.739957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.740421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.741172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.742231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.742673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.810443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:09.814279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:09.814876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:09.815322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:09.815753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:09.836339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.841061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.841941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.842974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.843463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.843908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.881457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:09.897122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for user bb763b81c4da4dea80f92bf1de1d2d54 and project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:09.918706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:09.937769 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-794bb781-ce06-45d4-9d46-4e4946fd07e7 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1290 microversion: 2.1 time: 0.226124 Sep 23 03:53:09.938286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1626/3173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:09 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1290 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:09.945944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:09.950527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:09.974900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:09.975537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:09.996707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:09.997090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:09.997586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:09.998304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:10.007309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:10.008558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:10.063675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98e9dfc4-af1d-43a7-bdb1-909ed7a9e7f1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.278705 Sep 23 03:53:10.064763 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1548/3174] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:10.069731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:10.070791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:10.084975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:10.085858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:10.086532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:10.087478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:10.087950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:10.088395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:10.763997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:10.773193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e20f0aa2-26bc-4ad3-9334-f009ddf5f179 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.707167 Sep 23 03:53:10.794147 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1549/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:10 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:10.799884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76ec2a0c-7d82-4fc6-bfa7-f846d07a613c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:10.800529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76ec2a0c-7d82-4fc6-bfa7-f846d07a613c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:11.015080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76ec2a0c-7d82-4fc6-bfa7-f846d07a613c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.031540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76ec2a0c-7d82-4fc6-bfa7-f846d07a613c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1217 microversion: 2.1 time: 0.236120 Sep 23 03:53:11.048681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1550/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:10 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:11.066618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.074609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:11.077952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:11.093435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.098991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.107347 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8d5d75e-4040-4d33-b486-5715eaba296b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 1.150728 Sep 23 03:53:11.108367 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1627/3177] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:09 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:11.130591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.142343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.143027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.150228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.152438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.152981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.157233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:11.158208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:11.174120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:11.176332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.178281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.180242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.182047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.183655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.184620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.464797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.487514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb61aa81-b5d8-49e6-86e1-4585b5c0c67f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1290 microversion: 2.1 time: 0.367259 Sep 23 03:53:11.488973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1628/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:11 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1290 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:11.609059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e940bb9-4026-4f95-b58e-84ee73cfe1d4", "name": "network-vif-plugged", "status": "completed", "tag": "b841fc18-0840-4acd-99b9-1ca98a4df676"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:11.637879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.638965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.640956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.655111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:11.680060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] Creating event network-vif-plugged:b841fc18-0840-4acd-99b9-1ca98a4df676 for instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 on n-h2-858495-2 Sep 23 03:53:11.694200 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72af3af3-c129-42dd-b109-89274db04604 req-346496fa-b5a5-4a64-9782-4445b60f572a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089802 Sep 23 03:53:11.697202 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1629/3179] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:53:11.811448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:11.818901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:11.823640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:11.841027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.848390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eea7242f-00c2-4915-b2bc-c2302475c459 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 0.792694 Sep 23 03:53:11.849442 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1551/3180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:11 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:11.855207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.855670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.860496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.860986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.861473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.868295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5adbf9-921c-4983-ba38-fb92f91cbe41", "tag": "b3e53cd3-370b-4b26-beef-e56e519f1034"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:11.902065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:11.902849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:11.904177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:11.944152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] Creating event network-changed:b3e53cd3-370b-4b26-beef-e56e519f1034 for instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 on n-h2-858495-2 Sep 23 03:53:11.959768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-41e50eed-de8b-4a28-8d97-247b19cb2940 req-14b9ee59-0ae2-4b1f-b21e-f7daae7e91ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106907 Sep 23 03:53:11.961323 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1552/3181] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:11.975371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e7d614-1a2f-4299-8bbd-2ed5a4d89068", "name": "network-vif-deleted", "tag": "cc997a48-0266-42f0-8de0-0251b90e930a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:12.017566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.018165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.018567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.050150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] Creating event network-vif-deleted:cc997a48-0266-42f0-8de0-0251b90e930a for instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 on n-h1-858495-2 Sep 23 03:53:12.056993 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fb008e5d-bcca-4062-8a1c-9ecd3b94f3eb req-c9748f4b-4f10-4374-a801-2e67a475a70d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094038 Sep 23 03:53:12.057958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1553/3182] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:12.076826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:12.078085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:12.102753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.103644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.104403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.105692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.106370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.107047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.265709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.274670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b8b9c18-cd4f-40c7-b6c0-3ada201a7f01 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1213 microversion: 2.1 time: 0.203353 Sep 23 03:53:12.281665 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1554/3183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:12 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:12.292589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:12.293290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:12.306031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.310716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.316090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.317803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.318494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.319378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.449206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.459571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc1b6895-679e-4859-b556-163caf1ee749 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.656244 Sep 23 03:53:12.471224 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1630/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:11 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:12.517670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:12.518294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:12.530544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.530953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.531396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.532147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.532615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.533045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.548298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.559905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.564274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.574627 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-829c4708-4ae3-424e-a03a-db2049634955 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.291540 Sep 23 03:53:12.575973 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1555/3185] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:12 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:12.608644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:12.618543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a28bad29-2b05-401f-8a7e-4edc33cc7d98 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1290 microversion: 2.1 time: 0.106702 Sep 23 03:53:12.619569 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1631/3186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:12 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:53:12.872716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:12.873338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:12.875797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:12.883726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.884291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.884734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:12.885740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:12.886423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:12.887025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.075462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:13.084356 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd849808-70ab-4f69-ae71-044696b4d974 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 0.215379 Sep 23 03:53:13.084958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1556/3187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:12 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:13.304446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:13.304990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:13.321651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.334917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.342637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.343816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.344554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.345134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.484680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:13.492330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:13.500771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.505023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.505797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.508951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.509858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.512147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.589728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:13.604326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-503e679f-ab8d-4933-b216-944d7947ef84 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1213 microversion: 2.1 time: 0.303793 Sep 23 03:53:13.604931 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1632/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:13 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1213 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:13.617104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:13.628912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:13.654748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.655269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.655720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:13.656457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:13.656919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:13.657376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.079193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.088262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-abcc6fab-7910-4c77-8979-79d645f843ac tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.607492 Sep 23 03:53:14.088615 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1557/3189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:13 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:53:14.121951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:14.122615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:14.132843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.143976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.145754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.146253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.146701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.147422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.147942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.148375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.153444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.155059 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1be0107c-4fb1-48cf-b4c2-23abde6d8668 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.544034 Sep 23 03:53:14.155194 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1633/3190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:13 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:14.174830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:14.178065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:14.188668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.191226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.193235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.195851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.196736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.197451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:14.198041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.290614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.299756 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a97f5cc-bf75-4b46-a2c0-67b729cd04c1 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1290 microversion: 2.1 time: 0.181953 Sep 23 03:53:14.300632 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1558/3191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:14 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1290 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:14.421373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.430950 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-165f1954-4e52-4d65-9d88-b1aceba3c9f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 0.264820 Sep 23 03:53:14.432130 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1634/3192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:14 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:14.628345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:14.628808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:14.636664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.637673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.638341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.639299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:14.639979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:14.640628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:14.736650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:14.752996 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3783439d-3e05-49b4-ab5e-b34434bbb02e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1277 microversion: 2.1 time: 0.122255 Sep 23 03:53:14.754133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1559/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:14 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:15.117079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:15.117839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:15.125603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.126368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.127312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.128194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.128843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.129467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.183455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:15.184833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:15.196280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.197315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.199233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.199233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.199759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.200454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.542973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:15.567987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65e408ac-1d07-4218-afd3-be1b574a2500 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.452936 Sep 23 03:53:15.592706 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1635/3194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:15 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:15.630707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:15.634350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:15.678204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.680690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.684901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.705056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.706961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.708249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.902717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:15.921587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:15.923748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:15.925106 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67ae10af-0e15-495c-be58-38aa1f249886 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1358 microversion: 2.21 time: 0.747269 Sep 23 03:53:15.925870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1560/3195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:15 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1358 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:53:15.940276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:15.940903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:15.969215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.969749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.970237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:15.971051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:15.971510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:15.972006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:16.844843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:16.854411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-313da502-3cc8-44b1-819b-92c42fc72cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 1.260133 Sep 23 03:53:16.870911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1636/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:15 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:16.878441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:16.879312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:16.886841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:16.887599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:16.888256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:16.889150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:16.890319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:16.891077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:16.984163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:17.013402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.014024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:17.023506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0eea201-553c-47a6-a748-07a48c75a6ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 1.096395 Sep 23 03:53:17.034555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1561/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:15 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:17.040370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:17.041216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:17.059768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.060459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.061070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.062002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.062680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.063297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.118296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.150942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-32e96319-2433-4726-9191-21cb96b40f46 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1275 microversion: 2.1 time: 0.278432 Sep 23 03:53:17.154051 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1637/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:16 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:17.173599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a79555c-3859-4566-a4ca-bb7e35508317", "name": "network-vif-plugged", "status": "completed", "tag": "f95012aa-3d19-44bc-a3f0-bc73484db38d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:17.204812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.205990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.207991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.243441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] Creating event network-vif-plugged:f95012aa-3d19-44bc-a3f0-bc73484db38d for instance 8a79555c-3859-4566-a4ca-bb7e35508317 on n-h1-858495-2 Sep 23 03:53:17.253560 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e0fcf703-f456-4b25-98ea-05d95dd4db87 req-85ce6340-91f7-40c9-9146-a6b9ea671894 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094057 Sep 23 03:53:17.268226 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1638/3199] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:17.285876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:17.289884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:17.299699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.307357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.308168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.309136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.309768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.310277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.670794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.679730 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a21a8767-9522-4d84-9ef1-b5d6e5bf03bf tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.643789 Sep 23 03:53:17.686590 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1562/3200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:17 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:17.825510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb276a91-5415-4496-a9ff-5bed9cf7a3ae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: .version_select at 0x7f0c8a807430>, body: {"keypair": {"name": "tempest-keypair-869624744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7wF8PpoqUO0ddvH5tyWVMCr2JLY4pnEuR3XNqUQI5iuBUZItWwM1jRzCLD6wtO/yxCDtLM9tVGhamWqwZapiI7i7jpoSCJEA5V5Wqdiv4nTJX5ykvlKDLaBXw8SDQW9w=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:17.847445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fb276a91-5415-4496-a9ff-5bed9cf7a3ae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:17.855849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fb276a91-5415-4496-a9ff-5bed9cf7a3ae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:17.889550 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb276a91-5415-4496-a9ff-5bed9cf7a3ae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201241 Sep 23 03:53:17.891430 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1563/3201] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:53:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:17.892135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.899051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f85f5-a4e5-4c5b-a30a-fc2bce676ac2", "tag": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:17.905252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.907149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:17.912857 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-748cbe3e-0ba4-413e-96f8-d1d31777e53a tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1551 microversion: 2.21 time: 0.635162 Sep 23 03:53:17.914561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1639/3202] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:17 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1551 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:17.918483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.918923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.922707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.923864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:17.927822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:17.942776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.943276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.943749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.944744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:17.945199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:17.947228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:17.967482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] Creating event network-changed:d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 for instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 on n-h1-858495-2 Sep 23 03:53:17.979160 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4292bac7-0d1e-4c4f-9869-611d9537e90b req-f6ab4ef9-86c6-46fd-a17c-8fde1d426c22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085092 Sep 23 03:53:17.980136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1564/3203] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:17.992196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:17.992814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:18.005314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.008439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.009140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.010088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.013455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.016840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.091671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:53:18.277196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d6e3216b-e569-4a0a-8e02-71b2e00da693 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 204 len: 0 microversion: 2.21 time: 0.294976 Sep 23 03:53:18.278149 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1565/3204] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:53:17 2022] DELETE /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:53:18.288408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:18.289585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:18.306029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.306655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.307137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:18.307408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.308742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.311545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.312222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.317925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-41d7cf29-83bd-406f-b78f-7f3f83cb5545 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 0.401926 Sep 23 03:53:18.318531 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1640/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:17 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:18.325708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:18.326438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:18.343943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.344523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.344966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.345745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.346203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.346711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.654048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:18.666649 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-45f749f6-ee8a-419c-bda4-af9e931a7f52 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1275 microversion: 2.1 time: 0.346988 Sep 23 03:53:18.667507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1641/3206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:18 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:18.681210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:18.681907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:18.698024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.698433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.698874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.699596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.700056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.700487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.906275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:18.921773 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d013ac46-c00b-4bb6-90d7-4ddafbef02d2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 0.633397 Sep 23 03:53:18.922773 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1566/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:18 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:18.927615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:18.937847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:18.944382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.945110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.945744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:18.946778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:18.951788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:18.952425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.263692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:19.274969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:19.279775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:19.283908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc61819f-d6f0-454e-b827-c38559c46d81 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1557 microversion: 2.21 time: 0.615337 Sep 23 03:53:19.306951 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1642/3208] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:18 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1557 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:19.347863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:19.348755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:19.356749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:19.365732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:19.366473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.367559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:19.368475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:19.369138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.500422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:19.524397 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e481b5dd-dfb0-4af1-8d8f-1c07558d6d9c tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1325 microversion: 2.1 time: 0.600445 Sep 23 03:53:19.525128 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1567/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:18 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:19.545443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5adbf9-921c-4983-ba38-fb92f91cbe41", "name": "network-vif-plugged", "status": "completed", "tag": "b3e53cd3-370b-4b26-beef-e56e519f1034"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:19.570740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:19.587742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:19.588514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.622026 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] Creating event network-vif-plugged:b3e53cd3-370b-4b26-beef-e56e519f1034 for instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 on n-h2-858495-2 Sep 23 03:53:19.629029 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e71c3b4f-be43-4356-b6b4-2a4a0bbfca05 req-e54dcf05-0430-4292-9d7f-0c4e38213b27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086231 Sep 23 03:53:19.635554 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1568/3210] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:19.695796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:19.705099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:19.729770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:19.730275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:19.730728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.731767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:19.731963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:19.732304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:19.868389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:20.330003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:20.343735 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec71055a-3a86-4549-926a-c329cef4d875 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.653070 Sep 23 03:53:20.366017 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1569/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:19 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:20.375678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:20.380272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:20.392118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:20.392921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:20.393693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:20.394695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:20.395320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:20.395936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:20.411978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:20.425995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b48f1f3-c3aa-4e24-b9d6-1a130263be86 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 1.081836 Sep 23 03:53:20.436692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1643/3212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:19 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:53:20.471051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:20.473506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:20.490727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:20.492187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:20.492790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:20.494076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:20.494699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:20.495595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:21.400070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:21.411540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec7be13c-7e40-488e-9e62-0f80cf9e96c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1293 microversion: 2.1 time: 1.044007 Sep 23 03:53:21.416408 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1570/3213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:20 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1293 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:21.432995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:21.451188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:21.460668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:21.461638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:21.462243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:21.463162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:21.463784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:21.464494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:21.503141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:21.520720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:21.523521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:21.525220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f551fdf-1d6e-46b7-a71a-65cfe0a04509 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1557 microversion: 2.21 time: 1.082811 Sep 23 03:53:21.526556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1644/3214] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:20 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1557 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:21.638112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1358290901", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7eaac8f2-9b18-4c41-958d-0329bde70a12"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:21.771320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] validate_networks() for [('7eaac8f2-9b18-4c41-958d-0329bde70a12', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:22.575312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:22.588828 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d38600d-8a5a-4baa-8f2f-6ed3d03d2922 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1522 microversion: 2.1 time: 1.170749 Sep 23 03:53:22.625941 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1571/3215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:21 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1522 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:22.631168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:22.632862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:22.641333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:22.642201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:22.642853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:22.643789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:22.644457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:22.645206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.368302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:23.377262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-734f6bd1-c795-4097-8220-f250aad57da7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.749846 Sep 23 03:53:23.377905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1572/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:22 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:23.383228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:23.384086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:23.390519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.391270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.391923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.393296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.394216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.395555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.889516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:23.889992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:23.900661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:23.901633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:23.902126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:23.922598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.926862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:23.927939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.928681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.933779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.936294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.936884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.938226 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c506306-2628-4e63-acc7-bd17d0925442 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 0.559260 Sep 23 03:53:23.942919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1573/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:23 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:23.953187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:23.954791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:23.967509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.968006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.968451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.973250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:23.978209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:23.979413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:23.992131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Getting quotas for project 944c87b48a1e4769ab4feec284b4500c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:24.005711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Getting quotas for user 59ba3ae1a568477782ba5cc8f2474fc6 and project 944c87b48a1e4769ab4feec284b4500c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:24.040045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Going to run 3 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:24.042526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:24.120904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=2af8aefb-d6df-4416-9b83-4902bcf9eef6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:24.241774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=6ab87fe5-171d-4fc3-a239-f160dd82ab1c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:24.326061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8bf2259-d8ef-4ecb-83f4-41688e2ac5e4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.797065 Sep 23 03:53:24.336559 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1645/3218] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:24.339305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:24.348872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:24.349636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:24.363115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.363543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.367188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.368031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.368519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.371519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.379603 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d14adb14-f87b-4447-9052-52cc2ec25488 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1472 microversion: 2.1 time: 0.426185 Sep 23 03:53:24.399581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1574/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:23 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:24.403559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e940bb9-4026-4f95-b58e-84ee73cfe1d4", "name": "network-vif-unplugged", "status": "completed", "tag": "b841fc18-0840-4acd-99b9-1ca98a4df676"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:24.501175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.502002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.502633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.526494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] Creating event network-vif-unplugged:b841fc18-0840-4acd-99b9-1ca98a4df676 for instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 on n-h2-858495-2 Sep 23 03:53:24.533416 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-de06b06f-2509-41c1-aeb6-154edc214e36 req-ff5f2795-9a13-4fb4-9e80-bda2f2164247 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145371 Sep 23 03:53:24.534968 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1575/3220] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:24.541839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:24.544955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.545484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.545936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.546400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lazy-loading 'fault' on Instance uuid 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:53:24.548826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:24.559157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.559973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.560641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.561832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:24.562461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:24.563058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:24.613999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:24.735921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:24.751336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:24.759535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c53c134e52f474bb54a3b0699a93e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d730881beb4d279d692f0539e67c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:24.761085 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbff3db3-15fb-471b-a6c8-a141d03395c3 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 200 len: 1348 microversion: 2.21 time: 0.422141 Sep 23 03:53:24.766980 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1646/3221] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:24 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 1348 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:53:24.789459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1658791067", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477af16e-1c5b-4384-8f7b-9015a1b1fdab"}], "security_groups": [{"name": "tempest-securitygroup--1274497597"}], "key_name": "tempest-keypair-869624744", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:25.014293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] validate_networks() for [('477af16e-1c5b-4384-8f7b-9015a1b1fdab', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:25.309091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:25.320442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3123a39a-3513-46c8-a042-6d4226d2ca5d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1522 microversion: 2.1 time: 0.783989 Sep 23 03:53:25.321051 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1576/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:24 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1522 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:25.338360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e940bb9-4026-4f95-b58e-84ee73cfe1d4", "name": "network-vif-deleted", "tag": "b841fc18-0840-4acd-99b9-1ca98a4df676"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:25.365462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:25.366952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:25.367570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:25.388283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] Creating event network-vif-deleted:b841fc18-0840-4acd-99b9-1ca98a4df676 for instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 on n-h2-858495-2 Sep 23 03:53:25.409963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ae13e61c-0cb2-4fa6-bdc7-575fa8586f83 req-596ec1cf-289e-4211-a6e1-4160003438e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087207 Sep 23 03:53:25.412371 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1577/3223] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:25.422018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:25.430425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:25.432407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:53:25.472292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:25.473168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:25.473915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:25.474875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:25.475658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:25.476330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:25.529726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:53:25.590081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41eaa205-f801-4407-85d3-c4a6d84e55ae tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.176189 Sep 23 03:53:25.593335 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1578/3224] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:53:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:25.601889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:25.604292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:25.614725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:25.615693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:25.617299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:25.618336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:25.619070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:25.619711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:26.239827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:26.248851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5580dd4-3603-41a6-8abb-f7c9e44b1c3c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.653538 Sep 23 03:53:26.262437 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1579/3225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:25 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:26.267616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-386871511", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:26.390900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:26.391624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:26.392355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:26.392918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:26.393492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:26.396671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:26.406499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:26.407107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:26.407646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:26.408478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:26.409334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:26.409945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:26.431469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:26.438736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:26.453966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:26.456310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:26.544864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63f47c64-c5a6-4ca3-b35c-dabc3b50a237 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.776581 Sep 23 03:53:26.546042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1647/3226] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:26.556583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:26.557627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:26.564681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:26.566416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:26.567156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:26.568365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:26.569719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:26.570409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:26.577577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:27.031383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:27.070251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f78ff270-105e-48a5-affe-79357f3dd23d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 0.522856 Sep 23 03:53:27.073679 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1648/3227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:26 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:27.088196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1218818008"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:27.093672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:27.102360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.102933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.103563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.104360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.105158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.105614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.350740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:27.351630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:27.352601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:27.353209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:27.353808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:27.366577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.367297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.368241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.369451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.370167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.370766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.396259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:27.402598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:27.420014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:27.431629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-642d9bbd-1362-499d-9640-aa214df1d572 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317/action" status: 202 len: 0 microversion: 2.1 time: 0.353695 Sep 23 03:53:27.434103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:27.445755 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1649/3228] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:53:27 2022] POST /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 03:53:27.455192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:27.462061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:27.476740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.477266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.477863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.478617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.479080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.479735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.538162 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83ac4b8b-45da-4f45-b760-23466cc8e802 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274586 Sep 23 03:53:27.539879 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1580/3229] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:27.561636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:27.562638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:27.573599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.574592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.576862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.579224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.579952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.580682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.593755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:27.602639 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-883eaa00-af94-4a49-bb0d-3445e7d9c06e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1219 microversion: 2.1 time: 0.155456 Sep 23 03:53:27.603244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1650/3230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:27 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:27.608280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:27.608899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:27.615032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.616328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.616958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.617582 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] HTTP exception thrown: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Request method failure captured: Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 HTTP/1.1 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2QdvNoOMk7ksdAOAxSjfW2K4sQJw1VjYG-dpBpbDj-HPYihy1A2FDrF1eiwOqmAqyd5UYV2C0add2aTg0y0mUdXXfKRWQVKzudZpbfgcP0ZIIaAfSIAGw_22UlJ-GILTgZmamU1Lk18XCzl5Uy3oi_FErTiNZFL2BAi-h2ryjXT5E Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05d730881beb4d279d692f0539e67c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05d730881beb4d279d692f0539e67c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5c53c134e52f474bb54a3b0699a93e9d Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2e940bb9-4026-4f95-b58e-84ee73cfe1d4'} Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:27.621819 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Returning 404 to user: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:27.627120 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e2dd30a-a57d-472a-b528-2511b40f0597 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 404 len: 111 microversion: 2.21 time: 0.084489 Sep 23 03:53:27.630829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1581/3231] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:27 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:53:27.637058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f85f5-a4e5-4c5b-a30a-fc2bce676ac2", "name": "network-vif-plugged", "status": "completed", "tag": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:27.638929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.639646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.640310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.648357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.648840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.649279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.663685 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] Creating event network-vif-plugged:d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 for instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 on n-h1-858495-2 Sep 23 03:53:27.669267 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d8ca24b0-a3bb-4130-9599-8deaec630973 req-a396ba85-d5d3-4778-98ed-be4e31004253 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036522 Sep 23 03:53:27.670105 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1582/3232] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:27.676900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:27.677896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:27.686498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.687277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.687892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.689050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.689782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.690853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.838278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:27.871743 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d49e18fd-dfd7-465c-b1a1-37a77d9e1b28 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1245 microversion: 2.1 time: 0.267181 Sep 23 03:53:27.875114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1651/3233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:27 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1245 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:27.881276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17df0aa-2a19-4428-9147-2477e5dc3691", "tag": "dd045c9d-504d-4fe3-8f43-f889082f4f54"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:27.893156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:27.894555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:27.895460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:27.917780 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] Creating event network-changed:dd045c9d-504d-4fe3-8f43-f889082f4f54 for instance b17df0aa-2a19-4428-9147-2477e5dc3691 on n-h2-858495-2 Sep 23 03:53:27.924855 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0d96d082-09de-481e-8234-b65675b0a4cf req-8c3241c0-4480-456b-9107-310aae78b487 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047654 Sep 23 03:53:27.926714 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1652/3234] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:27.934755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98079927-283d-4de1-860b-d213ae1d1c5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8b166790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.134847 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98079927-283d-4de1-860b-d213ae1d1c5b tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978" status: 204 len: 0 microversion: 2.1 time: 0.206659 Sep 23 03:53:28.136385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1653/3235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:27 2022] DELETE /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:53:28.142224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-749a7445-3924-48d4-aedf-1d2dfd583185 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.143145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-749a7445-3924-48d4-aedf-1d2dfd583185 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.192111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-749a7445-3924-48d4-aedf-1d2dfd583185 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:53:28.251659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:28.262730 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d91631b7-cf5d-4dcf-940b-2a896f32bd87 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.591173 Sep 23 03:53:28.267020 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1583/3236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:27 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:28.277302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '.version_select at 0x7f0c8a7de820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.278003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.292079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.292829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.300066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.301146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.301867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.302530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.518965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df28099a-cccf-48a8-8641-b2d45f23ea77 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.250091 Sep 23 03:53:28.520600 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1584/3237] 10.222.0.25 () {60 vars in 1337 bytes} [Fri Sep 23 03:53:28 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4/os-instance-actions => generated 611 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:53:28.533845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.538191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.574112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.576098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.576552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.577289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.577782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.578224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.734347 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.scheduler.client.report [None req-749a7445-3924-48d4-aedf-1d2dfd583185 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Deleted allocations for instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 Sep 23 03:53:28.736782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:28.776240 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-749a7445-3924-48d4-aedf-1d2dfd583185 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900" status: 204 len: 0 microversion: 2.1 time: 0.638228 Sep 23 03:53:28.776879 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1654/3238] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:53:28 2022] DELETE /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:53:28.782676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0ea01dc-318b-4825-b31c-d90d14d56c21 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8b8f14c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.819559 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c0ea01dc-318b-4825-b31c-d90d14d56c21 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Image not found. Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0ea01dc-318b-4825-b31c-d90d14d56c21 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978 HTTP/1.1 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2876dcea-c80d-43dc-84ca-1654940c8978'} Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2876dcea-c80d-43dc-84ca-1654940c8978 Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:53:28.823681 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2876dcea-c80d-43dc-84ca-1654940c8978 could not be found. Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:53:28.828886 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.834820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0ea01dc-318b-4825-b31c-d90d14d56c21 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:28.834820 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0ea01dc-318b-4825-b31c-d90d14d56c21 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978" status: 404 len: 62 microversion: 2.1 time: 0.056284 Sep 23 03:53:28.837562 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1655/3239] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:53:28 2022] GET /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:53:28.858765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.860206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.875282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.876170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.876846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.880423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.881116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.883482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.915398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:28.918453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] HTTP exception thrown: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Request method failure captured: Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 HTTP/1.1 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2QdvNoOMk7ksdAOAxSjfW2K4sQJw1VjYG-dpBpbDj-HPYihy1A2FDrF1eiwOqmAqyd5UYV2C0add2aTg0y0mUdXXfKRWQVKzudZpbfgcP0ZIIaAfSIAGw_22UlJ-GILTgZmamU1Lk18XCzl5Uy3oi_FErTiNZFL2BAi-h2ryjXT5E Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05d730881beb4d279d692f0539e67c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05d730881beb4d279d692f0539e67c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5c53c134e52f474bb54a3b0699a93e9d Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2e940bb9-4026-4f95-b58e-84ee73cfe1d4'} Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:53:28.920550 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Returning 404 to user: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:28.925405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f2ff88e-ca15-41ac-a9fa-a82d903218b0 tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 404 len: 111 microversion: 2.21 time: 0.085614 Sep 23 03:53:28.931152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1656/3240] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:53:28 2022] DELETE /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:53:28.940060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.940701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.947077 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31d9a8ea-70bf-4606-a65c-96e063afd435 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1332 microversion: 2.1 time: 0.425020 Sep 23 03:53:28.948015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.948573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.949019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.949829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.950332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.950771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:28.953514 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1585/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:28 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1332 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:28.966370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:28.972290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:28.996829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:28.998010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:28.999689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:29.000981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:29.006228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:29.007599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:29.032002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 HTTP/1.1 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '9bdd0e9a-43bc-4a94-ad22-02eb491cd900'} Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:29.035100 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:53:29.039821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:53:29.042183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:29.043669 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b154b22-1d30-4e5a-86ed-bda294e34ef4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900" status: 404 len: 111 microversion: 2.1 time: 0.088677 Sep 23 03:53:29.045811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1586/3242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:28 2022] GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:53:29.055209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:29.057382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:29.066875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:29.067479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:29.068084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:29.068956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:29.069579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:29.070162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:29.151122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:29.165751 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8de20236-cb26-4ff9-b428-da3e9274bdbf tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1219 microversion: 2.1 time: 0.232944 Sep 23 03:53:29.166544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1657/3243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:28 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:29.182770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:29.183676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:29.194084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:29.195131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:29.195899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:29.197138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:29.197889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:29.198790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:30.291451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:30.311651 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cd116ea-d882-4d15-85f9-3cc3ac0bc08a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1237 microversion: 2.1 time: 1.143517 Sep 23 03:53:30.312364 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1658/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:29 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1237 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:30.317570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:30.318357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] [instance: 2e940bb9-4026-4f95-b58e-84ee73cfe1d4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:30.334711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:30.335384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:30.338043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:30.339447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:30.340196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:30.341894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:30.374499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] HTTP exception thrown: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Request method failure captured: Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 HTTP/1.1 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2QdvNoOMk7ksdAOAxSjfW2K4sQJw1VjYG-dpBpbDj-HPYihy1A2FDrF1eiwOqmAqyd5UYV2C0add2aTg0y0mUdXXfKRWQVKzudZpbfgcP0ZIIaAfSIAGw_22UlJ-GILTgZmamU1Lk18XCzl5Uy3oi_FErTiNZFL2BAi-h2ryjXT5E Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05d730881beb4d279d692f0539e67c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05d730881beb4d279d692f0539e67c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05d730881beb4d279d692f0539e67c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 05d730881beb4d279d692f0539e67c13 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1122099963 Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5c53c134e52f474bb54a3b0699a93e9d Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-InstanceActionsV221TestJSON-1122099963-project Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2e940bb9-4026-4f95-b58e-84ee73cfe1d4'} Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:30.379604 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:30.385546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] Returning 404 to user: Instance 2e940bb9-4026-4f95-b58e-84ee73cfe1d4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:30.391698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54b8af11-cb31-4a85-b3e6-af728e09268b tempest-InstanceActionsV221TestJSON-1122099963 tempest-InstanceActionsV221TestJSON-1122099963-project] 10.222.0.25 "GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4" status: 404 len: 111 microversion: 2.21 time: 0.074838 Sep 23 03:53:30.392746 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1659/3245] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:53:30 2022] GET /compute/v2.1/servers/2e940bb9-4026-4f95-b58e-84ee73cfe1d4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:53:30.407835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-764849501", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:30.523009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:30.935466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:30.954445 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd0db8e7-442c-422a-a365-ba39e5091c8d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1540 microversion: 2.1 time: 1.906751 Sep 23 03:53:30.970344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1587/3246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:29 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1540 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:30.973699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:30.975974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:30.983339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:30.984130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:30.984753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:30.985654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:30.986247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:30.986779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:31.661155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:31.670788 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec336c28-ece9-4bb8-ac5f-f259899a875d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.703644 Sep 23 03:53:31.671786 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1588/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:30 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:31.677691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:31.678670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:31.693164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:31.695225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:31.695887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:31.697718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:31.698360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:31.698958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.249880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:32.261489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e348a062-9a06-4e2a-944a-7bc145219ce2 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1536 microversion: 2.1 time: 0.588284 Sep 23 03:53:32.264434 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1589/3248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:31 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1536 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:32.271268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:32.273041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:32.294162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.294902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.295603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.296449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.297173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.297725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.440951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:32.442641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:32.444382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:32.445468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:32.446768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:32.460644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:32.479474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.480262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.480875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.482248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.483428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.484154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.498944 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b536beb-f40d-486d-916f-7e0f5d1e9a4a tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1281 microversion: 2.1 time: 0.232696 Sep 23 03:53:32.499870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1590/3249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:32 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:32.504758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a79555c-3859-4566-a4ca-bb7e35508317", "name": "network-vif-plugged", "status": "completed", "tag": "f95012aa-3d19-44bc-a3f0-bc73484db38d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:32.515769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:32.522136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:32.523701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.529232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.535067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.538190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:32.566761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:32.567295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] Creating event network-vif-plugged:f95012aa-3d19-44bc-a3f0-bc73484db38d for instance 8a79555c-3859-4566-a4ca-bb7e35508317 on n-h1-858495-2 Sep 23 03:53:32.572691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8a07abd6-1096-4b22-bed3-9af78bf155fd req-b29591a4-e01c-4cd8-a696-803c956f2ad4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071396 Sep 23 03:53:32.573308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1591/3250] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:32.575164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:32.589215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:32.590153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:32.596683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.597176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.605921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.607027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.607715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.608462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.714026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6c16537-7fd3-42ef-a8f1-e21124c23084 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.319070 Sep 23 03:53:32.716105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1660/3251] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:32.741495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab87fe5-171d-4fc3-a239-f160dd82ab1c", "tag": "eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:32.758911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.759409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.759849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.791725 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] Creating event network-changed:eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f for instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c on n-h1-858495-2 Sep 23 03:53:32.803635 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-62b9987e-9977-4986-8fe9-2e8cf5becc04 req-7b9690ea-9d71-438a-8d03-e6187d6d5293 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073425 Sep 23 03:53:32.804662 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1661/3252] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:32.821180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:32.822107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:32.835902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.836421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.838032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.842291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:32.842794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:32.843246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:32.848642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:32.867293 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd501b32-f9e7-4f64-9089-62da44f40ddc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1299 microversion: 2.1 time: 0.292556 Sep 23 03:53:32.870952 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1592/3253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:32 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:32.878317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a17032f0-0992-419c-8f3c-2189c672603e tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'create', calling method: .version_select at 0x7f0c8a7e9940>, body: {"pool": "aeba3486-51aa-4773-88f5-0f88525e575c"} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:34.051786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:34.068079 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a13580d2-3026-444d-9b8a-992bc61e804d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1522 microversion: 2.1 time: 1.261538 Sep 23 03:53:34.069948 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1662/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:32 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1522 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:34.076923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:34.078096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:34.108913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.113417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.120286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:34.123290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.125557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.127242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:34.776865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:34.784874 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6e7a776-6fbe-43b6-88a4-d59e82bebe91 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.713596 Sep 23 03:53:34.785707 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1663/3255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:34 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:34.790397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:34.791304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:34.797422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.798095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.798723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:34.799579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.800208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.800642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:34.957545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:34.969534 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2cd3e642-3799-4794-b0df-c66f069a833b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1272 microversion: 2.1 time: 0.182566 Sep 23 03:53:34.973901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1664/3256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:34 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:34.979171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:34.980014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:34.987843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.988574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.989481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:34.990976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:34.991593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:34.992188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:35.524840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:35.536848 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9241a28e-6857-4643-8575-cf90a0d7ae1e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.558165 Sep 23 03:53:35.549911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1665/3257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:34 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:35.565252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:35.568867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:35.581906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:35.582557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:35.589957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:35.590835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:35.595671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:35.596307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:36.223977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:36.235195 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39feccd5-a330-4645-927b-7038894f5ef6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1367 microversion: 2.1 time: 0.683509 Sep 23 03:53:36.236106 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1666/3258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:35 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1367 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:36.242139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:36.242944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:36.250691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:36.252310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:36.252987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:36.256056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:36.256990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:36.257944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:36.317965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:53:36.551959 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-973afea7-0800-4fad-8fd8-3b320f976645 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 204 len: 0 microversion: 2.1 time: 0.314052 Sep 23 03:53:36.553110 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1667/3259] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:53:36 2022] DELETE /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:53:36.559958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17df0aa-2a19-4428-9147-2477e5dc3691", "name": "network-vif-plugged", "status": "completed", "tag": "dd045c9d-504d-4fe3-8f43-f889082f4f54"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:36.572728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:36.573263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:36.573729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:36.586555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:36.589767 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] Creating event network-vif-plugged:dd045c9d-504d-4fe3-8f43-f889082f4f54 for instance b17df0aa-2a19-4428-9147-2477e5dc3691 on n-h2-858495-2 Sep 23 03:53:36.595647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-abe69d93-2880-48e7-ad7f-4d6ce670f5c7 req-c3e67dbd-ed54-4c22-950d-0640cc406a1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Sep 23 03:53:36.600846 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1668/3260] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:36.607769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:36.608876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:36.620513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:36.621387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:36.622191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:36.623161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:36.623836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:36.624277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:37.269336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:37.280546 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2c228d4-59f2-4aad-9094-874e1a8d925f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.678157 Sep 23 03:53:37.285095 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1669/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:36 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:37.299963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:37.306253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:37.312881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:37.313720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:37.314326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:37.315491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:37.316386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:37.317022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:37.381386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:37.411920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:37.935267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:37.943697 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d688762-4cf8-44ef-ac55-98d91b88748d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1278 microversion: 2.1 time: 0.653090 Sep 23 03:53:37.944280 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1670/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:37 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1278 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:37.948786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6014c14c-d670-4333-a033-a26367fa56ad", "tag": "809d0bdd-d415-41c3-9771-3761b2a3f136"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:37.961600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:37.962388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:37.962814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:37.987554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] Creating event network-changed:809d0bdd-d415-41c3-9771-3761b2a3f136 for instance 6014c14c-d670-4333-a033-a26367fa56ad on n-h2-858495-2 Sep 23 03:53:37.999990 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a7449dcf-23f2-4287-9e65-f1f5029b540f req-ca505368-0d3c-4476-a3ca-d6dc6905ab3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054354 Sep 23 03:53:38.006855 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1671/3263] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:38.016543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:38.033845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:38.049397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.053497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.054693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:38.056069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.056713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.057614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:38.722066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:38.736089 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04aecd4f-d4ef-449d-9894-65ea23c13c17 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1528 microversion: 2.1 time: 0.727458 Sep 23 03:53:38.738542 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1672/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:38 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1528 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:38.746926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:38.747818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:38.758606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.759954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.760674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:38.763433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.764737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.765436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:38.939748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a17032f0-0992-419c-8f3c-2189c672603e tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.067501 Sep 23 03:53:38.940957 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1593/3265] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:53:32 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:38.947574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:38.948549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:38.957147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.957959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.959352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:38.960595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:38.961227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:38.961864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:39.290554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:39.312121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-345123e0-c964-4b0e-ad19-d8a02ec8ad66 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.571416 Sep 23 03:53:39.313045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1673/3266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:38 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:39.331342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:39.332311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:39.343779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:39.344277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:39.344799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:39.345457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:39.345916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:39.346348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:39.533883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:39.550879 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e06078ba-1430-43da-a47c-a5b44ce0f8d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1367 microversion: 2.1 time: 0.608458 Sep 23 03:53:39.555800 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1594/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:38 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:39.760686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a79555c-3859-4566-a4ca-bb7e35508317", "name": "network-vif-unplugged", "status": "completed", "tag": "f95012aa-3d19-44bc-a3f0-bc73484db38d"}, {"server_uuid": "6ab87fe5-171d-4fc3-a239-f160dd82ab1c", "name": "network-vif-plugged", "status": "completed", "tag": "eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:39.790370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:39.794159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:39.794674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:39.862783 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Creating event network-vif-unplugged:f95012aa-3d19-44bc-a3f0-bc73484db38d for instance 8a79555c-3859-4566-a4ca-bb7e35508317 on n-h1-858495-2 Sep 23 03:53:39.871302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] Creating event network-vif-plugged:eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f for instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c on n-h1-858495-2 Sep 23 03:53:39.903073 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ca41b281-c8e5-4917-b068-7804a30bfe34 req-09e1c865-c6ef-4a5c-9c5b-2e8dde91bf70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.345587 Sep 23 03:53:39.903709 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1595/3268] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:39.921926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.9"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:39.926450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:39.934012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:39.934799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:39.935482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:39.936391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:39.937136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:39.937998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.012602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:53:40.013273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquired lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:53:40.075612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:40.084736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ed707433-df24-4b53-b35f-286ddd6e3f08 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1317 microversion: 2.1 time: 0.769947 Sep 23 03:53:40.091229 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1674/3269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:39 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:40.097422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:40.109335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:40.116626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.117216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.120447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.121647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.122404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.123031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.701538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:40.709986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad099b18-de81-462b-b2e9-bfbfc5abf36e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1320 microversion: 2.1 time: 0.617300 Sep 23 03:53:40.711021 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1675/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:40 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:40.715627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12be66a1-e9b7-4d41-84bb-d9f4e4572209", "tag": "29383b63-6301-40a6-a8e5-a4dae8c6f6d2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:40.725196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.726638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.727461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.741956 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] Creating event network-changed:29383b63-6301-40a6-a8e5-a4dae8c6f6d2 for instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 on n-h2-858495-2 Sep 23 03:53:40.749432 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-43c91f51-6158-49d2-9855-0d6649de5288 req-42206697-2f67-4dde-bfef-c8cbbfad011f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036649 Sep 23 03:53:40.750383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1676/3271] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:40.757297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:40.758684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:40.766559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.767397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.767839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.768548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.769000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.769631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.807303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:40.807955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:40.808508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:40.809059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lazy-loading 'fault' on Instance uuid 8a79555c-3859-4566-a4ca-bb7e35508317 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:53:40.989796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:41.000274 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50e444e0-e508-4157-9739-0a2d20328b76 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 200 len: 1315 microversion: 2.1 time: 0.248169 Sep 23 03:53:41.001027 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1677/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:40 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:41.007530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a79555c-3859-4566-a4ca-bb7e35508317", "name": "network-vif-deleted", "tag": "f95012aa-3d19-44bc-a3f0-bc73484db38d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:41.021257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:41.021597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:41.022046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:41.059771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] Creating event network-vif-deleted:f95012aa-3d19-44bc-a3f0-bc73484db38d for instance 8a79555c-3859-4566-a4ca-bb7e35508317 on n-h1-858495-2 Sep 23 03:53:41.067385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-95686211-7d24-462a-be66-b8f1a98b937b req-1bffa350-d991-4929-b698-ca842d7ac925 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064102 Sep 23 03:53:41.072182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1678/3273] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:41.080349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:41.081082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:41.087786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:41.088500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:41.088942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:41.090118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:41.090578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:41.091008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:42.415085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:42.423138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58045470-f22a-4ad8-aee3-ff1535fe1d32 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 1.348974 Sep 23 03:53:42.428075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1679/3274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:41 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:42.441716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:42.442591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:42.472543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:42.473976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:42.474752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:42.475672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:42.476301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:42.477091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:42.508169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:42.564025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=20 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:43.206961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:43.215729 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-984808b0-eb04-4aea-947d-ce70a99bda98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1367 microversion: 2.1 time: 0.786534 Sep 23 03:53:43.216317 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1680/3275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:42 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1367 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:43.226539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:43.230099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:43.246514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:43.247401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:43.248000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:43.249129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:43.249804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:43.250604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:44.101922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:44.140654 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-637b2c99-af92-4bb3-99e0-6edc47b82df8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1507 microversion: 2.1 time: 0.918013 Sep 23 03:53:44.166596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1681/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:43 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1507 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:44.172785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:44.173716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:44.181551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:44.182337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:44.182945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:44.183876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:44.184512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:44.187806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.271938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:45.284791 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8faad5f-3ac1-4be8-98a9-818340d0dac3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1320 microversion: 2.1 time: 1.116783 Sep 23 03:53:45.286063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1682/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:44 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1320 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:45.308927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:45.309955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:45.316266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.317316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.319169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.320178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.320912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.321718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.338222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 HTTP/1.1 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '8a79555c-3859-4566-a4ca-bb7e35508317'} Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:45.340210 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:53:45.344140 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:45.346170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:45.347168 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef0c93ee-d2b5-4d8d-aaa1-0a91f7c2d4dd tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 404 len: 111 microversion: 2.1 time: 0.051657 Sep 23 03:53:45.353513 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1683/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:45 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:53:45.359172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af8aefb-d6df-4416-9b83-4902bcf9eef6", "tag": "a3ddb746-37e9-4653-8094-0767319fd921"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:45.371180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.371821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.372365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.397574 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] Creating event network-changed:a3ddb746-37e9-4653-8094-0767319fd921 for instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 on n-h2-858495-2 Sep 23 03:53:45.407756 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-82f3978c-8540-4123-9c1b-58ff65cb9fe1 req-17c4b9f4-5b06-4559-a3b4-3a9950941e65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057882 Sep 23 03:53:45.408384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1684/3279] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:45.420984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6014c14c-d670-4333-a033-a26367fa56ad", "name": "network-vif-plugged", "status": "completed", "tag": "809d0bdd-d415-41c3-9771-3761b2a3f136"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:45.448880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.449308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.450019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.507474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] Creating event network-vif-plugged:809d0bdd-d415-41c3-9771-3761b2a3f136 for instance 6014c14c-d670-4333-a033-a26367fa56ad on n-h2-858495-2 Sep 23 03:53:45.523683 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b0c7ac27-6b27-4d5a-860f-b33e3408522b req-aa3c38ad-5b64-41fb-b229-cdf37b07aa1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110945 Sep 23 03:53:45.530294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1685/3280] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:45.541301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:45.543218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:45.551506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.552845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.553745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.555180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.556013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.557615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.839222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:53:45.900805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:45.910949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78fb0b05-bbe5-4656-a292-b3fba8d2e04e tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.378810 Sep 23 03:53:45.913433 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1686/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:45 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:45.922810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:45.924185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:45.934834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.935702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.936392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:45.937595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:45.938520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:45.939225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:46.367247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:46.379490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dae24d6-04d6-489d-9526-37c8d5a707c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1507 microversion: 2.1 time: 0.463218 Sep 23 03:53:46.380826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1687/3282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:45 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:46.388790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:46.389723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:46.398036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:46.398891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:46.399540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:46.401126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:46.401938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:46.402595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:46.769608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:46.784777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1ac5095-4066-4cbc-a032-0fe91cad8cfc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1367 microversion: 2.1 time: 0.398664 Sep 23 03:53:46.803875 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1688/3283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:46 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:46.826839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-119103166", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:46.953156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] validate_networks() for [('fadce686-cfb9-45b5-8a6f-428d20302907', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:53:47.391540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Updating instance_info_cache with network_info: [{"id": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3", "address": "fa:16:3e:18:c5:24", "network": {"id": "28149f3d-7202-4c0e-84ec-a9fedc951b3c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-111515594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e6c2d5cf60f42c29b4267a594a93df4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2a88f82-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:53:47.416487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Releasing lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:53:47.417417 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5a6e5f1-919e-477c-b7cd-66fe1711bd99 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 202 len: 0 microversion: 2.1 time: 7.510271 Sep 23 03:53:47.418045 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1596/3284] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:53:39 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 0 bytes in 7514 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:53:47.423916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:47.429521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:47.489257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:47.489831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:47.494165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:47.496261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:47.510325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:47.511292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:47.534882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:47.843614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:47.856716 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e758fcf-9feb-4410-979d-3d1fe35f35c0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1320 microversion: 2.1 time: 0.437346 Sep 23 03:53:47.859045 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1597/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:47 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:47.869750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:47.876729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:47.900812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:47.905504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:47.906114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:47.907248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:47.907981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:47.908665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:48.072127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:48.073410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:48.074132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:48.074654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:48.075181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:48.084358 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-429a7072-10f2-4ab1-8d9f-b743b3616a38 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "PUT /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1079 microversion: 2.1 time: 0.205148 Sep 23 03:53:48.101159 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1598/3286] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:53:47 2022] PUT /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1079 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:48.108955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:48.110316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:48.112659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:48.113594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:48.115585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:48.117180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:48.120252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:48.121267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:48.121769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:48.121990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:48.122687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:48.123655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:48.124358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:48.125021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:48.155140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:48.211077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:48.218092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:48.220076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Getting quotas for user 4b4d19ac638246b1954cb2d2b2b54bce and project 5e536ae7fea543ee8f7effb52ff34c82. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:48.243513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:53:48.247747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:53:48.304766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87ec0a95-0154-45a7-bb5a-9b04cb925c38 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.498357 Sep 23 03:53:48.307235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1689/3287] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:53:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:53:48.312516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fb7bf314-c9a5-4ea5-b0db-20014367bc31 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'create', calling method: .version_select at 0x7f0c8b64edc0>, body: {"pool": "aeba3486-51aa-4773-88f5-0f88525e575c"} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:49.810743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:49.819068 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af76df96-9181-47c4-a0f0-ce2e89307540 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 1.715794 Sep 23 03:53:49.819660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1599/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:48 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:49.831437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d53178cd-e691-4857-96c1-4b22ee4dcef4", "tag": "0c7f832b-479c-4119-9add-0e038e700b46"}, {"name": "network-changed", "server_uuid": "834f85f5-a4e5-4c5b-a30a-fc2bce676ac2", "tag": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:49.852315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:49.853283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:49.854505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:49.875011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Creating event network-changed:0c7f832b-479c-4119-9add-0e038e700b46 for instance d53178cd-e691-4857-96c1-4b22ee4dcef4 on n-h1-858495-2 Sep 23 03:53:49.875745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] Creating event network-changed:d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 for instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 on n-h1-858495-2 Sep 23 03:53:49.885837 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bee87fd1-8c3b-44e6-aa40-1ab32058e22b req-be530c91-555c-4b77-adad-02735ca79b44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058492 Sep 23 03:53:49.887892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1600/3289] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:49.895410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:49.898470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:49.912171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:49.914097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:49.914608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:49.915438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:49.920645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:49.921285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:50.386104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:50.399165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8711cad4-e787-4835-9547-87e2087d129d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1367 microversion: 2.1 time: 0.509145 Sep 23 03:53:50.400572 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1601/3290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:49 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:50.408539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:50.410378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:50.422132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:50.423583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:50.425546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:50.427124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:50.427824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:50.446053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:51.079530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:51.089654 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1285a180-7440-4229-80b0-239bf5d69d0b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1505 microversion: 2.1 time: 0.687719 Sep 23 03:53:51.098359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1602/3291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:50 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:51.103733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:51.104349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:51.118998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:51.125873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:51.126603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:51.127303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:51.127798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:51.128281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:51.944774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:51.956185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4fec943-7795-4954-802d-129a39bcc4a0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1324 microversion: 2.1 time: 0.856297 Sep 23 03:53:51.956797 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1603/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:51 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1324 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:51.964980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:51.966667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:51.976725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:51.978167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:51.979118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:51.982621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:51.983357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:51.987310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:53.055398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:53.065716 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e7ba846-41c6-4dcd-b8bb-d247dd02ff4d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1320 microversion: 2.1 time: 1.106364 Sep 23 03:53:53.068256 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1604/3293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:51 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1320 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:53.341212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c67c831d-efd4-4d74-bc43-c94f5ec1620e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: .version_select at 0x7f0c8ab2db80>, body: {"keypair": {"name": "tempest-keypair-2050040181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCId8+l7g5QHpgxPxwImCdJ2N6Y6Xe7yNlH4ENpfkc0BQcl0T7sIXsQIc3+K5nw/89awfzaV9p07Qvn9qPb17yVaTMjKFYyv7zCtyQv2aNU3SnUhD6W3Gls/8ZsMeb26g=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:53.374323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c67c831d-efd4-4d74-bc43-c94f5ec1620e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:53:53.404512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c67c831d-efd4-4d74-bc43-c94f5ec1620e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:53:53.458334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c67c831d-efd4-4d74-bc43-c94f5ec1620e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.387100 Sep 23 03:53:53.459817 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1605/3294] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:53:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:53.475839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:53.477248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:53.491305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:53.492506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:53.493250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:53.494388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:53.495268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:53.495931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:53.863557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:53.883091 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fdd9c181-c104-4d31-9de3-8e1f4e7c92c8 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.410393 Sep 23 03:53:53.886556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1606/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:53 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:53.912519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:53.913148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:53.939766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:53.943723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:53.945241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:53.946506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:53.947163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:53.947859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:54.350263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:54.360137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7cbd3fe1-debe-4cef-944b-7d60fe5cf55e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1505 microversion: 2.1 time: 0.472446 Sep 23 03:53:54.364673 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1607/3296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:53 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:54.385643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:54.386473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:54.394341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:54.395204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:54.395858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:54.396807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:54.397971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:54.398885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:54.913540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:54.928569 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26d27fa2-31c6-4801-9edf-b0e0be044a5b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1555 microversion: 2.1 time: 0.558716 Sep 23 03:53:54.929222 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1608/3297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:54 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1555 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:54.944927 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fb7bf314-c9a5-4ea5-b0db-20014367bc31 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.636274 Sep 23 03:53:54.946362 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1690/3298] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:53:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:54.954414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:54.956901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:54.976559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:54.977975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:54.979205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:54.981929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:54.983482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:54.985553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.093012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a470dc-7d81-4c6c-aaa7-2b2d2134af11", "tag": "24e48754-ad14-467a-b7cd-3d87b4012e06"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:55.119687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.120524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.121224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.135820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] Creating event network-changed:24e48754-ad14-467a-b7cd-3d87b4012e06 for instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 on n-h1-858495-2 Sep 23 03:53:55.141723 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e5b16bba-5bc3-4183-9843-da762ba16f57 req-3afd5de4-428b-4130-a308-a11a586d1b2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210849 Sep 23 03:53:55.143229 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1609/3299] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:55.150862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53178cd-e691-4857-96c1-4b22ee4dcef4", "name": "network-vif-plugged", "status": "completed", "tag": "0c7f832b-479c-4119-9add-0e038e700b46"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:55.162465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.168509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.169325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.183351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] Creating event network-vif-plugged:0c7f832b-479c-4119-9add-0e038e700b46 for instance d53178cd-e691-4857-96c1-4b22ee4dcef4 on n-h1-858495-2 Sep 23 03:53:55.188973 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-81010021-e38b-47a9-88a8-414ceda40550 req-a8014838-7f4e-44b2-b4ed-60483f6a839e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043966 Sep 23 03:53:55.190406 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1610/3300] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:55.196436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:55.198120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:55.206936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.207755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.209123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.221750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.222707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.223444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.737789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:55.747556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1844bd7-43f6-45b1-a4ac-5040ab4578f6 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1324 microversion: 2.1 time: 0.799907 Sep 23 03:53:55.757926 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1691/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:54 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1324 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:55.763131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:55.766257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:55.785927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.786550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.787093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.788224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.789088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.789088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.830938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:55.846772 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce7eb57e-fc7c-48c2-bc49-41314690d071 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1320 microversion: 2.1 time: 0.654698 Sep 23 03:53:55.859439 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1611/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:55 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1320 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:55.866945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:55.867487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:55.892207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.892708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.893226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.894059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:55.894580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:55.895140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:55.921903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:53:55.922345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:53:55.922882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:53:55.923408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:53:55.923835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:53:56.001192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:56.007507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.008031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.008443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.009148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.009692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.010324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.040079 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d07ee5b9-744f-4bec-a5f0-d39a8fee2538 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "POST /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691/action" status: 202 len: 1111 microversion: 2.1 time: 0.280447 Sep 23 03:53:56.040915 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1692/3303] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:53:55 2022] POST /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691/action => generated 1111 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 03:53:56.048522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:56.049251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:56.059926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.060767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.061389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.062272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.062880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.063613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.244724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6742fcf7-5d3c-46ca-beba-ddfb67ae85b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201727 Sep 23 03:53:56.257414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1693/3304] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:53:56 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:56.257414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.243"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:56.284511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:56.304731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.305697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.307160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.309038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.309817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.310780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.344669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:56.361910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9500472-d0e9-4d8d-a4f9-46cedc01f18c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.501218 Sep 23 03:53:56.362153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:53:56.362574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquired lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:53:56.362875 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1612/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:55 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:56.374079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:56.374951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:56.389178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.389846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.390393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:56.391108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:56.391570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:56.392139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:57.429894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:57.440266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44293b66-66b8-4875-b582-aac2cb0ea079 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 1.070493 Sep 23 03:53:57.455144 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1613/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:56 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:57.464627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:57.465547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:57.473168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:57.474637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:57.475278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:57.476431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:57.477105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:57.477771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.155331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:58.166372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:58.174676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e0eeaa2-101e-4eff-9234-ef26eb7c69ce tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1324 microversion: 2.1 time: 0.717423 Sep 23 03:53:58.175280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1614/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:57 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:58.181106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:58.181746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:58.189637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:58.189637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:58.189637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.189637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:58.194018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:58.195055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.235324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:53:58.248002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG neutronclient.v2_0.client [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c.", "detail": ""}} {{(pid=128724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 03:53:58.248606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Releasing lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:53:58.249169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.249169 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Request method failure captured: Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action HTTP/1.1 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 46 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2gytZkId6pZB9T68i_1HI6kejluf3Q0F6rMPJX-x-zTktxfrNY8VsU0RwoJ4JfcwXNSP9tKmlXSSVjJYyG-5pw3fxzD96ReR-OKZGm6laTsrYdgvN7vHN0mJlFBS2R9NrHJ_nq6cScdPfVxLlwudsfW5_43gwvQwXg4ryR53_KXrs Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 901a04c1f6ad4f83829a0a0bf81d56b9 Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: {"addFloatingIp": {"address": "172.25.2.243"}} Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '834f85f5-a4e5-4c5b-a30a-fc2bce676ac2', 'body': {'addFloatingIp': {'address': '172.25.2.243'}}} Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 03:53:58.252439 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] Sep 23 03:53:58.257296 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:53:58.265388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Returning 400 to user: Cannot associate floating IP 172.25.2.243 (19da441e-5704-4a19-a4fe-15a8cecf482d) with port d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network aeba3486-51aa-4773-88f5-0f88525e575c. Sep 23 03:53:58.265388 n-d-858495-2 devstack@n-api.service[128724]: Neutron server returns request_ids: ['req-9a234cb0-7371-4052-b526-c5c4fbdb1e01'] {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:53:58.265388 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e995d25a-997e-455f-8af5-46dcc8c1ac64 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 400 len: 382 microversion: 2.1 time: 2.017231 Sep 23 03:53:58.266365 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1694/3308] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:53:56 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 382 bytes in 2019 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:53:58.272016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af8aefb-d6df-4416-9b83-4902bcf9eef6", "name": "network-vif-plugged", "status": "completed", "tag": "a3ddb746-37e9-4653-8094-0767319fd921"}, {"server_uuid": "12be66a1-e9b7-4d41-84bb-d9f4e4572209", "name": "network-vif-plugged", "status": "completed", "tag": "29383b63-6301-40a6-a8e5-a4dae8c6f6d2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:53:58.284896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:58.285803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:58.286821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.302856 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Creating event network-vif-plugged:a3ddb746-37e9-4653-8094-0767319fd921 for instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 on n-h2-858495-2 Sep 23 03:53:58.303389 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] Creating event network-vif-plugged:29383b63-6301-40a6-a8e5-a4dae8c6f6d2 for instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 on n-h2-858495-2 Sep 23 03:53:58.312562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6866ceb1-603e-4a9a-b99a-6ff932ecf3e4 req-c4d87eb1-62de-4890-9001-6ad5b69555a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044935 Sep 23 03:53:58.313875 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1695/3309] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:53:58.322721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:58.323455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:58.329686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:58.330195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:58.330648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.331377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:58.333266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:58.333741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:58.742737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:58.754984 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0427b812-a7b9-4a71-b139-02e9f140ce4e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1500 microversion: 2.1 time: 0.577211 Sep 23 03:53:58.757494 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1615/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:58 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1500 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:58.765098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd00083b-5069-4b1a-aa62-5295727bbe7d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '.version_select at 0x7f0c8b633160>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:59.148592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:59.158328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89b85b96-8908-4304-bf04-fc390c3cb8d1 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.842803 Sep 23 03:53:59.174479 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1696/3311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:58 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:59.180797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:59.181828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:59.188824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:59.189714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:59.190398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:59.191477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:59.192332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:59.192986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:59.543710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:53:59.556911 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3f98300-a819-45fc-af3b-78a4f9e9ee0d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.380500 Sep 23 03:53:59.558509 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1697/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:59 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:53:59.564550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:53:59.565408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:53:59.576182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:59.577408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:59.578245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:53:59.580221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:53:59.580907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:53:59.581547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:00.328795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:00.340340 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fbb8aa0-1b64-48fd-aa2a-a4861c84c7f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1500 microversion: 2.1 time: 0.779782 Sep 23 03:54:00.341268 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1698/3313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:53:59 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1500 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:00.347882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-595161714", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "035b98c4-22a0-4a66-81a1-f3cedd6f6f67"}], "security_groups": [{"name": "tempest-securitygroup--1834943054"}], "key_name": "tempest-keypair-2050040181", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:00.508645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] validate_networks() for [('035b98c4-22a0-4a66-81a1-f3cedd6f6f67', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:00.820135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd00083b-5069-4b1a-aa62-5295727bbe7d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/19da441e-5704-4a19-a4fe-15a8cecf482d" status: 202 len: 0 microversion: 2.1 time: 2.061507 Sep 23 03:54:00.821074 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1616/3314] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:53:58 2022] DELETE /compute/v2.1/os-floating-ips/19da441e-5704-4a19-a4fe-15a8cecf482d => generated 0 bytes in 2063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:54:00.826676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:00.830536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:00.847178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:00.847703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:00.848746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:00.850200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:00.850911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:00.851900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:00.875554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:01.102174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:01.110481 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af03936e-e871-40be-9696-92ac8c5765c0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1324 microversion: 2.1 time: 0.288203 Sep 23 03:54:01.111628 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1617/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:00 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:01.119050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:01.119914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:01.132347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.133061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.133721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.134630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.135667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.136286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.171534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:01.177068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:01.178095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:01.178684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:01.179272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:01.190511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.191343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.192006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.193012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.194259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.194904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.215964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:01.229696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:01.248559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:01.251418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:01.331903 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a0a836d-31d3-4aae-9b27-69105b417030 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.988648 Sep 23 03:54:01.340891 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1699/3316] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:54:01.409994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:01.423646 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0609f603-aeb6-4108-ab92-ddcae995be40 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1323 microversion: 2.1 time: 0.310693 Sep 23 03:54:01.425106 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1618/3317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:01 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:01.430174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a470dc-7d81-4c6c-aaa7-2b2d2134af11", "name": "network-vif-plugged", "status": "completed", "tag": "24e48754-ad14-467a-b7cd-3d87b4012e06"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:01.441421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.442606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.443283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.463954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] Creating event network-vif-plugged:24e48754-ad14-467a-b7cd-3d87b4012e06 for instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 on n-h1-858495-2 Sep 23 03:54:01.471092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6014c14c-d670-4333-a033-a26367fa56ad", "tag": "809d0bdd-d415-41c3-9771-3761b2a3f136"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:01.472910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-41a13e3d-2ae6-472b-a9fb-eca822cdd6df req-30d0600c-d04d-4216-b188-9702866d251f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046313 Sep 23 03:54:01.474982 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1619/3318] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:01.482567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:01.483392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:01.489025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.489946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.490497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.505665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] Creating event network-changed:809d0bdd-d415-41c3-9771-3761b2a3f136 for instance 6014c14c-d670-4333-a033-a26367fa56ad on n-h2-858495-2 Sep 23 03:54:01.512147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6426bae5-0067-4da6-ad8a-ba424de56146 req-98539729-abc8-45ab-9af2-f513cf427c49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173681 Sep 23 03:54:01.513177 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1700/3319] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:01.521277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:01.521499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.522088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.522660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.523723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.524699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:01.525291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.527176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.532965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.534375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.535023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.536123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:01.536908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:01.537551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:01.605366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:01.810597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bcf0cf93-7bc2-4b23-bf9b-c894af61f7bc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 204 len: 0 microversion: 2.1 time: 0.333773 Sep 23 03:54:01.811210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1620/3320] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:01 2022] DELETE /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:01.835199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.9"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:01.853514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:01.868869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ded009f2-ddc4-4b2c-93e4-2fa99b338b4f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.353542 Sep 23 03:54:01.884313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1701/3321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:01 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:01.895949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d61b98e3-cef8-4723-9af0-0df2102ec8ee tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:01.896776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d61b98e3-cef8-4723-9af0-0df2102ec8ee tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:02.133736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d61b98e3-cef8-4723-9af0-0df2102ec8ee tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:02.146657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d61b98e3-cef8-4723-9af0-0df2102ec8ee tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1238 microversion: 2.1 time: 0.259577 Sep 23 03:54:02.161815 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1702/3322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:01 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1238 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:02.161815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:02.166214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:02.186051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.186660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.187273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.187841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.188310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.188752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.222039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:02.229147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.229694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.230194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.232556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.233045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.233566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.692413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:02.708756 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9fdff2fe-553f-4cb1-a933-f624de8672cb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1506 microversion: 2.1 time: 0.552273 Sep 23 03:54:02.712679 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1703/3323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:02 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:02.722719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:02.724227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:02.740576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.741594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.742036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.742748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:02.743204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:02.743628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:02.909927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:54:02.911026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquired lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:54:03.088733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:03.099397 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-afb206c5-b57a-42d3-945f-432097ae0a28 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1324 microversion: 2.1 time: 0.385049 Sep 23 03:54:03.100261 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1704/3324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:02 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:03.105941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:03.106814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:03.115861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.118038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.118686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:03.120105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.120983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.121793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:03.421336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:03.518626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:03.533759 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e69e9dc4-ada3-4436-a2d0-0491545cf3ac tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1517 microversion: 2.1 time: 0.431700 Sep 23 03:54:03.535262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1705/3325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:03 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1517 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:03.540421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:03.541158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:03.547373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.548327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.549192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:03.550449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.551826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.552568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:03.954714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:03.975119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d50733d-a090-4a8f-b2d8-081161460975 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.437384 Sep 23 03:54:03.976426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1706/3326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:03 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:03.981919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:03.982821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:03.989861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.990716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.991395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:03.992540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:03.993243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:03.994011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:04.087127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:04.096679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c955cd54-530a-4463-9df1-11b28516739c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1290 microversion: 2.1 time: 0.118190 Sep 23 03:54:04.113227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1707/3327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:03 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:04.118797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:04.119345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:04.127728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:04.128273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:04.128783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:04.130014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:04.130535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:04.130967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:04.501011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:04.521327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3327329f-e7d4-4690-a639-521e6c289a02 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 200 len: 1517 microversion: 2.1 time: 0.406277 Sep 23 03:54:04.541577 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1708/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:04 2022] GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:04.555226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:04.556061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:04.567858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:04.571011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:04.571737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:54:04.573607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:04.575963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:04.576633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:04.577892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:04.582622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:05.042778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:05.055294 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b25874ff-9c44-4416-80ae-1e247e548a98 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 200 len: 1506 microversion: 2.1 time: 0.512256 Sep 23 03:54:05.069235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1709/3329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:04 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:05.071127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:05.071981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:05.081975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:05.088593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:05.089463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:05.094399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:05.095110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:05.095738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.038966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:06.056818 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c81ef25b-392a-4425-91e5-571ca8a963e2 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1520 microversion: 2.1 time: 0.993642 Sep 23 03:54:06.062606 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1710/3330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:05 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1520 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:06.073792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:06.076225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:06.086933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.087682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.088330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.089335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.090002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.090710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.394388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Updating instance_info_cache with network_info: [{"id": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3", "address": "fa:16:3e:18:c5:24", "network": {"id": "28149f3d-7202-4c0e-84ec-a9fedc951b3c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-111515594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e6c2d5cf60f42c29b4267a594a93df4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2a88f82-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:54:06.402557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Releasing lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:54:06.403506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a0bcae2-4b56-4096-a344-fdc8dfdd8013 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 202 len: 0 microversion: 2.1 time: 4.579073 Sep 23 03:54:06.406014 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1621/3331] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:54:01 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 0 bytes in 4594 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:54:06.420263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:06.432672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f85f5-a4e5-4c5b-a30a-fc2bce676ac2", "tag": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:06.434434 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98b092b8-91ff-486a-a64a-1af02a421df3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 200 len: 1516 microversion: 2.1 time: 0.366939 Sep 23 03:54:06.442462 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1711/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:06 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:06.449401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:06.451788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:06.452407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:06.463541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.464340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.467276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.468025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.468643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.470022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.470773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.471426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.472026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.483596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] Creating event network-changed:d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 for instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 on n-h1-858495-2 Sep 23 03:54:06.490781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e246ee31-6e59-4b39-9900-aa236b2e2e92 req-cadf2bb5-fec5-4382-bde1-b5a3f53a92f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065874 Sep 23 03:54:06.503744 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1622/3333] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:06.518817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53178cd-e691-4857-96c1-4b22ee4dcef4", "name": "network-vif-deleted", "tag": "0c7f832b-479c-4119-9add-0e038e700b46"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:06.547223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.550245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.552275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.583882 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] Creating event network-vif-deleted:0c7f832b-479c-4119-9add-0e038e700b46 for instance d53178cd-e691-4857-96c1-4b22ee4dcef4 on n-h1-858495-2 Sep 23 03:54:06.596101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e7e11e79-010e-41b8-b7e6-02345965ff76 req-5e2349ef-758b-44b7-b598-4239978d1121 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089940 Sep 23 03:54:06.601417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1623/3334] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:06.628943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:06.632633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:06.653342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.654167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.655442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.656395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.661652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.662411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.880983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:06.894505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e662d221-a07c-428d-ba28-f2c0a1005a2d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1296 microversion: 2.1 time: 0.291719 Sep 23 03:54:06.906133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1624/3335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:06 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1296 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:06.926795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:06.927813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:06.936448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.937291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.938269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.939535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:06.940234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:06.940882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:06.977903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 HTTP/1.1 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd53178cd-e691-4857-96c1-4b22ee4dcef4'} Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:06.979624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:06.984012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56fdac62-768f-42e6-a148-61407d5948ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 404 len: 111 microversion: 2.1 time: 0.073585 Sep 23 03:54:06.995177 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1625/3336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:06 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:06.998181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:06.998700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:07.015860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.016816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.016816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.017588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.018058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.018498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.088279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:07.098669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:07.108971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab857f71-3d5b-4776-a919-4ca72384af57 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.661312 Sep 23 03:54:07.110086 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1712/3337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:06 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:07.123007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dcdb5397-5412-4550-84be-b1354470da6d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '.version_select at 0x7f0c8b166a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:07.280362 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d1867603-2953-43a2-887c-7752c544821a tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 204 len: 0 microversion: 2.1 time: 0.291193 Sep 23 03:54:07.281290 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1626/3338] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:06 2022] DELETE /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:07.287450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:07.288046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:07.306520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.307036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.307479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.308196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.308654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.309399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.370398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:07.536754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d540bb3c-0b9a-4b7b-9474-f77c61a96f6c tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 204 len: 0 microversion: 2.1 time: 0.253596 Sep 23 03:54:07.540272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1627/3339] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:07 2022] DELETE /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:07.548468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb7cb10b-e2f7-4813-b246-ab539c0a1622 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: .version_select at 0x7f0c8b371c10>, body: {"keypair": {"name": "tempest-key-546869270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHnDwqLLZebO0y2YVQgie8MJb8sYj3FzUjPsGWXzf0TQ9pN5eHYbe6m9A1u8COwXHZzyi2SqBSIBuGla2t/S1OTz3vUl/o7VzCj+MNDu1jh/8NBWxCRZBV8XI9GnGKeUw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:07.595861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-cb7cb10b-e2f7-4813-b246-ab539c0a1622 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:07.604978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-cb7cb10b-e2f7-4813-b246-ab539c0a1622 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:07.659262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb7cb10b-e2f7-4813-b246-ab539c0a1622 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.120036 Sep 23 03:54:07.660903 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1628/3340] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:54:07 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:07.674764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:07.675788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:07.687779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.688283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.688734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.693726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:07.694291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:07.694753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:07.984851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:07.993639 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae841e8b-a2b3-42f7-a2c4-83f72f166c4e tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1526 microversion: 2.1 time: 0.331317 Sep 23 03:54:07.997533 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1629/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:07 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1526 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:08.004926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:08.010948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:08.031164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.031825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.033166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.034750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.037298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.038959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.315364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:08.323892 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d341b80f-abbf-4a15-8aae-7a876cb434ce tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 200 len: 1522 microversion: 2.1 time: 0.324238 Sep 23 03:54:08.325334 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1630/3342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:07 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:08.330237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd003ade-0a08-4fe4-afa4-73e18cb2685a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '.version_select at 0x7f0c8bfaee50>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:08.334685 n-d-858495-2 devstack@n-api.service[128723]: WARNING oslo_db.sqlalchemy.utils [None req-bd003ade-0a08-4fe4-afa4-73e18cb2685a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 03:54:08.341957 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd003ade-0a08-4fe4-afa4-73e18cb2685a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.015344 Sep 23 03:54:08.342776 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1631/3343] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:54:08 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:08.348272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:08.349127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:08.359336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.359839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.360623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.361006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.363639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.364992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.933189 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dcdb5397-5412-4550-84be-b1354470da6d tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a226fb02-595d-4b8e-815b-0833d42e5872" status: 202 len: 0 microversion: 2.1 time: 1.822060 Sep 23 03:54:08.938071 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1713/3344] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:54:07 2022] DELETE /compute/v2.1/os-floating-ips/a226fb02-595d-4b8e-815b-0833d42e5872 => generated 0 bytes in 1827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:54:08.942782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:08.952729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93f593e0-40e5-4ec1-8ea1-64b58b651963 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.608379 Sep 23 03:54:08.957956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:08.961072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:08.977145 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1632/3345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:08 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:08.977711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.978216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.978664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.979379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:08.979837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:08.980271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:08.987844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-681414235", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-key-546869270", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:09.067652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:09.342546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:09.350884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ef9dd79-927f-4dfe-9769-da520abb1a44 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.411176 Sep 23 03:54:09.352012 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1714/3346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:08 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:09.356982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8c3d3af-a032-44fd-a099-9718ac3194f3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8c3d3af-a032-44fd-a099-9718ac3194f3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Request method failure captured: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action HTTP/1.1 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 34 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2gytZkId6pZB9T68i_1HI6kejluf3Q0F6rMPJX-x-zTktxfrNY8VsU0RwoJ4JfcwXNSP9tKmlXSSVjJYyG-5pw3fxzD96ReR-OKZGm6laTsrYdgvN7vHN0mJlFBS2R9NrHJ_nq6cScdPfVxLlwudsfW5_43gwvQwXg4ryR53_KXrs Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 901a04c1f6ad4f83829a0a0bf81d56b9 Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: {"addFloatingIp": {"address": ""}} Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '834f85f5-a4e5-4c5b-a30a-fc2bce676ac2', 'body': {'addFloatingIp': {'address': ''}}} Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:09.361286 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 03:54:09.367978 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:09.370422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8c3d3af-a032-44fd-a099-9718ac3194f3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:09.371703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8c3d3af-a032-44fd-a099-9718ac3194f3 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 400 len: 142 microversion: 2.1 time: 0.018528 Sep 23 03:54:09.372290 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1715/3347] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:54:09 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:09.377418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:09.378077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:09.385948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:09.386419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:09.386858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:09.387558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:09.388000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:09.388446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:09.690348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4d19ac638246b1954cb2d2b2b54bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e536ae7fea543ee8f7effb52ff34c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:09.701077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d375f5b5-ecc2-4df5-b972-5aa435ca2e62 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 200 len: 1526 microversion: 2.1 time: 0.327509 Sep 23 03:54:09.702420 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1716/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:09 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 1526 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:09.719789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:09.722758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:09.731073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:09.731581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:09.732027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:09.732778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:09.733247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:09.733719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.104736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:10.105850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:10.106331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:10.106744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:10.107474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:10.124429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.124921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.125383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.134360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.135412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.136071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.160911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:10.204717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:10.216314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:10.262078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:10.265751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:10.382876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:10.391399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8bccde37-a507-4e9e-866a-3c1552a2f9f4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 200 len: 1522 microversion: 2.1 time: 0.687646 Sep 23 03:54:10.391997 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1717/3349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:09 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:10.413193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:10.415674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:10.439158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.440641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.449057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.450201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.450692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.451133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.471334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b99a64c-cb71-4bde-9464-54f37320d93c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492930 Sep 23 03:54:10.477836 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1633/3350] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:54:10.486395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:10.491719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:10.506733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.508339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.508982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.510222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.512523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.513318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.536616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:54:10.537460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquired lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:54:10.807959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Releasing lock "refresh_cache-834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:54:10.808638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] HTTP exception thrown: floating IP not found Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Request method failure captured: Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action HTTP/1.1 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 41 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2gytZkId6pZB9T68i_1HI6kejluf3Q0F6rMPJX-x-zTktxfrNY8VsU0RwoJ4JfcwXNSP9tKmlXSSVjJYyG-5pw3fxzD96ReR-OKZGm6laTsrYdgvN7vHN0mJlFBS2R9NrHJ_nq6cScdPfVxLlwudsfW5_43gwvQwXg4ryR53_KXrs Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 901a04c1f6ad4f83829a0a0bf81d56b9 Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: exception: floating IP not found Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '834f85f5-a4e5-4c5b-a30a-fc2bce676ac2', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 23 03:54:10.810552 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:10.816631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Returning 404 to user: floating IP not found {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:10.818095 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d71d1134-1810-4ce1-bc0f-71d218a7aa20 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 404 len: 67 microversion: 2.1 time: 0.419045 Sep 23 03:54:10.818887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1718/3351] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:54:10 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 67 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:10.824706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a470dc-7d81-4c6c-aaa7-2b2d2134af11", "name": "network-vif-deleted", "tag": "24e48754-ad14-467a-b7cd-3d87b4012e06"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:10.855913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.856503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.857898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.885231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] Creating event network-vif-deleted:24e48754-ad14-467a-b7cd-3d87b4012e06 for instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 on n-h1-858495-2 Sep 23 03:54:10.895552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2e2f0c60-cf62-4371-b19c-af022c7252f5 req-4beb86cf-aad2-4156-b335-d506f06ba148 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074413 Sep 23 03:54:10.919404 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1719/3352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:10.927397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:10.931110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:10.958031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.976713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.977724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:10.978686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:10.979805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:10.980481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.205436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:11.234320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:11.258132 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d861476-3d5d-4efd-b3e6-091334e18684 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.778221 Sep 23 03:54:11.262310 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1634/3353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:10 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:11.271254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.272656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.279462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.280215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.281139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.282106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.283074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.283740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.494011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:11.513158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5da8dd20-0569-4585-a66e-f5e7c386238a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1231 microversion: 2.1 time: 0.249396 Sep 23 03:54:11.525375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1635/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:11 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1231 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:11.525375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.525375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: c8a470dc-7d81-4c6c-aaa7-2b2d2134af11] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.533946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.535314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.536914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.538472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.542092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.543317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.584693 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 HTTP/1.1 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c8a470dc-7d81-4c6c-aaa7-2b2d2134af11'} Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.591474 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.596455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:11.600599 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79ae6e27-32d5-490d-9f12-ab7d29556690 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11" status: 404 len: 111 microversion: 2.1 time: 0.081403 Sep 23 03:54:11.601704 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1636/3355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:11 2022] GET /compute/v2.1/servers/c8a470dc-7d81-4c6c-aaa7-2b2d2134af11 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:11.620948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b30984-72f1-493d-8876-7a59528d51e4 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:11.683937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:11.687436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-23b30984-72f1-493d-8876-7a59528d51e4 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b30984-72f1-493d-8876-7a59528d51e4 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Request method failure captured: Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action HTTP/1.1 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 44 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2gytZkId6pZB9T68i_1HI6kejluf3Q0F6rMPJX-x-zTktxfrNY8VsU0RwoJ4JfcwXNSP9tKmlXSSVjJYyG-5pw3fxzD96ReR-OKZGm6laTsrYdgvN7vHN0mJlFBS2R9NrHJ_nq6cScdPfVxLlwudsfW5_43gwvQwXg4ryR53_KXrs Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 901a04c1f6ad4f83829a0a0bf81d56b9 Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: exception: Floating IP not found for address 0.0.0.0. Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '834f85f5-a4e5-4c5b-a30a-fc2bce676ac2', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 23 03:54:11.691094 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b30984-72f1-493d-8876-7a59528d51e4 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:11.698130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23b30984-72f1-493d-8876-7a59528d51e4 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action" status: 404 len: 88 microversion: 2.1 time: 0.093046 Sep 23 03:54:11.701535 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1637/3356] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:54:11 2022] POST /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2/action => generated 88 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:11.706028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.706666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.717864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-29a2947b-d795-4cbd-9901-88fdaae8094e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.796767 Sep 23 03:54:11.718966 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1720/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:10 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:11.723407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.723933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.724393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.725131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.725624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.726077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.730267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af8aefb-d6df-4416-9b83-4902bcf9eef6", "name": "network-vif-deleted", "tag": "a3ddb746-37e9-4653-8094-0767319fd921"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:11.744699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.745481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.746523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.766412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] Creating event network-vif-deleted:a3ddb746-37e9-4653-8094-0767319fd921 for instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 on n-h2-858495-2 Sep 23 03:54:11.785091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.786250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.786704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.787216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lazy-loading 'fault' on Instance uuid 2af8aefb-d6df-4416-9b83-4902bcf9eef6 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:54:11.790221 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ba383fec-6430-4dba-94ec-f7d4fa04c02f req-ac92d94d-1ecc-4e49-8fca-6e168665d821 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069808 Sep 23 03:54:11.796756 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1721/3358] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:11.807122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bebb02ec-ddd1-43e9-bf04-e14a3f10bcd0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8bcd2700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.832475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-bebb02ec-ddd1-43e9-bf04-e14a3f10bcd0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Image not found. Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bebb02ec-ddd1-43e9-bf04-e14a3f10bcd0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978 HTTP/1.1 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2876dcea-c80d-43dc-84ca-1654940c8978'} Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2876dcea-c80d-43dc-84ca-1654940c8978 to delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2876dcea-c80d-43dc-84ca-1654940c8978 could not be found. Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.835274 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:54:11.839879 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.842663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bebb02ec-ddd1-43e9-bf04-e14a3f10bcd0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:11.843557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bebb02ec-ddd1-43e9-bf04-e14a3f10bcd0 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978" status: 404 len: 62 microversion: 2.1 time: 0.045363 Sep 23 03:54:11.844140 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1722/3359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:11 2022] DELETE /compute/v2.1/images/2876dcea-c80d-43dc-84ca-1654940c8978 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:11.846349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:11.850159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.850799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.857949 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f66ed98-de7c-40ec-b713-24199b63fb98 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 200 len: 1313 microversion: 2.1 time: 0.157388 Sep 23 03:54:11.859074 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1638/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:11 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:11.859408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.859928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.860377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.861108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.861604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.862036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.879478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.880016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.890946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.891452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.891907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.893156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.893542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.894017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.896155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:11.910088 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 HTTP/1.1 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8a79555c-3859-4566-a4ca-bb7e35508317'} Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:11.911935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:11.916775 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8f83ff2-160c-4a3c-8b03-1f3bf1ce5414 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 404 len: 111 microversion: 2.1 time: 0.052465 Sep 23 03:54:11.919015 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1639/3361] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:11 2022] DELETE /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:11.922858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.923498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: 8a79555c-3859-4566-a4ca-bb7e35508317] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:11.933362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.933883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.934334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.939630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:11.940284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:11.940752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:11.959023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 HTTP/1.1 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8a79555c-3859-4566-a4ca-bb7e35508317'} Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.960878 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance 8a79555c-3859-4566-a4ca-bb7e35508317 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba2ce4ab-b83e-4f76-a27e-6b519a7747fe tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317" status: 404 len: 111 microversion: 2.1 time: 0.044130 Sep 23 03:54:11.969169 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1640/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:11 2022] GET /compute/v2.1/servers/8a79555c-3859-4566-a4ca-bb7e35508317 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:11.972073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-597786f3-10f2-4d37-a596-cd7f8cbf5c44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8bac30d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:11.993616 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-597786f3-10f2-4d37-a596-cd7f8cbf5c44 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396054246" status: 202 len: 0 microversion: 2.1 time: 0.025915 Sep 23 03:54:11.994935 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1641/3363] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396054246 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:54:12.016913 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ec787bf-0ca8-4f6e-925d-3f0e84136d9f tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 204 len: 0 microversion: 2.1 time: 0.171128 Sep 23 03:54:12.017637 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1723/3364] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:11 2022] DELETE /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:12.025780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:12.026931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:12.033532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.034031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.034490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.035727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.036720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.037180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.229576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:12.243785 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e790dc7-6f2b-4ab7-868e-57a4d0c7d6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1542 microversion: 2.1 time: 0.221887 Sep 23 03:54:12.245443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1642/3365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:12 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1542 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:12.287076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:12.287822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:12.306977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:12.311996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.313383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.318395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.325102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.327265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.328185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.543001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:12.544298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:12.556126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.557154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.558616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.560260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.560979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.561952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.777975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:12.793238 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47b51e8b-cf5e-43f5-a27d-a9693fc9d101 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1279 microversion: 2.1 time: 0.254953 Sep 23 03:54:12.794975 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1643/3366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:12 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:12.801538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:12.802674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:12.809064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.809717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.810963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:12.812127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:12.812885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:12.813528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.008090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.020680 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5e82f39-ec0d-4be1-9f53-43892311d87f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.740226 Sep 23 03:54:13.036350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1724/3367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:12 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:13.041454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.042262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:13.047887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:13.049809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.050516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.051167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.052100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.052731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.053329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.070984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] HTTP exception thrown: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 HTTP/1.1 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2af8aefb-d6df-4416-9b83-4902bcf9eef6'} Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.073285 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:13.078703 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.080122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 404 to user: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.081162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-943fcb6a-0359-4657-a39e-1f707273a4aa tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 404 len: 111 microversion: 2.1 time: 0.043534 Sep 23 03:54:13.082805 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1725/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:13.094280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.100287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.101486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.107488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.107982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.108416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.109411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.110239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.110863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.209219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bb398e3-7652-450e-bae0-8d5c4389b9c2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.117934 Sep 23 03:54:13.210835 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1726/3369] 10.222.0.25 () {58 vars in 1230 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:13.217833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:13.231619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.232613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.233342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.246057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.248156 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] Creating event network-changed:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:54:13.254056 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-95ecd16a-0e03-4b59-a763-cce8011abd70 req-ab5d210a-be6f-4e30-a950-b61de065937b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041342 Sep 23 03:54:13.255956 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-128f4de0-2266-4194-a593-2e6b74bd6ea0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.459673 Sep 23 03:54:13.256183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1727/3370] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:13.259652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1644/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:12 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:13.262702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73d653f1-1011-496b-a476-4eef6c5cf4ab tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73d653f1-1011-496b-a476-4eef6c5cf4ab tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 03:54:13.266944 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 03:54:13.273534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.276332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73d653f1-1011-496b-a476-4eef6c5cf4ab tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.281311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.282162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73d653f1-1011-496b-a476-4eef6c5cf4ab tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020046 Sep 23 03:54:13.282646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:13.283067 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1728/3372] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:13.292406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.292827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.293806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.294484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.295567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.296241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.296882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.304554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.305342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.312343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.312874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.313557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.314610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.315251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.315868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.359349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:54:13.399069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4259a664-b807-4b19-b863-e0d2b08d0ec2 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.109673 Sep 23 03:54:13.401021 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1729/3373] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers => generated 683 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:54:13.415416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.428044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.429041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.servers [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Removing options 'limit' from query {{(pid=128724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 03:54:13.431708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.438736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.439577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.440285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.441866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.442570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.443460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.490260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:54:13.537311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03f0e267-de16-4299-8eb4-c7e18373e626 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.127274 Sep 23 03:54:13.539357 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1730/3374] 10.222.0.25 () {58 vars in 1144 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:13.554509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27603d53-7d79-4d86-b754-525227a5a9de tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27603d53-7d79-4d86-b754-525227a5a9de tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '-1' Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 03:54:13.558440 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 03:54:13.563162 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.567326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27603d53-7d79-4d86-b754-525227a5a9de tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.568416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-27603d53-7d79-4d86-b754-525227a5a9de tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017802 Sep 23 03:54:13.575250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1731/3375] 10.222.0.25 () {58 vars in 1142 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:54:13.580724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63c037f7-7fa9-4203-961e-7c784ff85129 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63c037f7-7fa9-4203-961e-7c784ff85129 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: action_args: {} Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'testing' Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 03:54:13.587540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 03:54:13.592954 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.594964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63c037f7-7fa9-4203-961e-7c784ff85129 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.595979 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63c037f7-7fa9-4203-961e-7c784ff85129 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019308 Sep 23 03:54:13.602592 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1732/3376] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:13.609940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e5608bd-b31f-4c8b-b869-598d40abcf83 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.611464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.616084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e5608bd-b31f-4c8b-b869-598d40abcf83 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.617148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e5608bd-b31f-4c8b-b869-598d40abcf83 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.623974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8c5dc2c-90d8-4b8b-8a83-9d22418f1963 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1542 microversion: 2.1 time: 0.355341 Sep 23 03:54:13.625222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.servers [None req-0e5608bd-b31f-4c8b-b869-598d40abcf83 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Flavor 'non_existing_flavor' could not be found {{(pid=128724) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 23 03:54:13.641499 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1645/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:13.643585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e5608bd-b31f-4c8b-b869-598d40abcf83 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039572 Sep 23 03:54:13.645843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1733/3378] 10.222.0.25 () {58 vars in 1178 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:13.660801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.671185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.672026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.678420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.678914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.679360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.680251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.680925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.681578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.690660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9c53c9d-31d3-42d1-ae80-918ca1b28b77 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '.version_select at 0x7f0c8b4bb820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.729182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c9c53c9d-31d3-42d1-ae80-918ca1b28b77 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Image not found. Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9c53c9d-31d3-42d1-ae80-918ca1b28b77 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/images/54a6384f-2f6b-4932-8a28-5e982b31e95d HTTP/1.1 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '54a6384f-2f6b-4932-8a28-5e982b31e95d'} Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 54a6384f-2f6b-4932-8a28-5e982b31e95d to delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 54a6384f-2f6b-4932-8a28-5e982b31e95d could not be found. Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.731883 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9c53c9d-31d3-42d1-ae80-918ca1b28b77 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9c53c9d-31d3-42d1-ae80-918ca1b28b77 tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/images/54a6384f-2f6b-4932-8a28-5e982b31e95d" status: 404 len: 62 microversion: 2.1 time: 0.054904 Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1734/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:13 2022] DELETE /compute/v2.1/images/54a6384f-2f6b-4932-8a28-5e982b31e95d => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:13.743320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.748114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:13.763996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.764594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.765046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.766911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.767547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.768372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.773218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:13.787821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b HTTP/1.1 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b'} Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:13.790341 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.795905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.799777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b2bfd9d-badf-4644-b4fb-a07bbde2646d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 404 len: 111 microversion: 2.1 time: 0.061223 Sep 23 03:54:13.800757 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1735/3380] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:13 2022] DELETE /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:13.811594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.812216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] [instance: d09e620c-ae84-4bcc-a4ec-b1631f82520b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:13.819445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.820218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.820852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.821765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.822402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.823005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.844477 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1bf81be-cf95-4afb-bbc3-c8cd5ea8c337 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.189553 Sep 23 03:54:13.853386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1646/3381] 10.222.0.25 () {58 vars in 1174 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:13.854374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] HTTP exception thrown: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Request method failure captured: Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b HTTP/1.1 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kNhdsw3wUdk5_6KA1J2kneQmJ-i6zkPzg6vKnB0sM5UKfPVvocTQI_lBCg8ZOID6fjUexjyf4cStj5sDQe7ixnbBuDBBDK2q3_EXLZ0yxdk6ejZc1xWAaBxwhn37ttLpago_IEPSIBTH7PKcjzCynS19F4YTkSWmYrcCCgDW-AM8 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e536ae7fea543ee8f7effb52ff34c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5e536ae7fea543ee8f7effb52ff34c82 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-382856455 Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b4d19ac638246b1954cb2d2b2b54bce Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-382856455-project Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd09e620c-ae84-4bcc-a4ec-b1631f82520b'} Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.855965 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] Returning 404 to user: Instance d09e620c-ae84-4bcc-a4ec-b1631f82520b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5bc89f2-bd3a-4619-9504-8287e857104d tempest-ImagesOneServerNegativeTestJSON-382856455 tempest-ImagesOneServerNegativeTestJSON-382856455-project] 10.222.0.25 "GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b" status: 404 len: 111 microversion: 2.1 time: 0.051773 Sep 23 03:54:13.864625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1736/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers/d09e620c-ae84-4bcc-a4ec-b1631f82520b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:13.865573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.877045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:13.877814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:13.888691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.890662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.890662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.891051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.891590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.892707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.896391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:13.903139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:13.914343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.918083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.918852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.919885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:13.920600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:13.921330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:13.997988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:14.000186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ef4944c-4ebd-458b-8006-0bd072f3a9eb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.140181 Sep 23 03:54:14.008528 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dbdd4e96-a4d0-49c2-8186-bdee670286c2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1279 microversion: 2.1 time: 0.153274 Sep 23 03:54:14.009613 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1737/3383] 10.222.0.25 () {58 vars in 1184 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:14.014879 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1647/3384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:13 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:14.028229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:14.038748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:14.039829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:14.044912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:14.045575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:14.047173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.048115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.051096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.052145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.052822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.053499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.055917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.068022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.068865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.071418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.077806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.078331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.095567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:54:14.164540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:14.177189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.177986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.178628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.714065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:14.724479 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e86cbaf2-bae5-457e-a8ac-dbac8b9399bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.684911 Sep 23 03:54:14.725746 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1648/3385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:14 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:14.732691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:14.733312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:14.742393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.743132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.743786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.744692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.745303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.746015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.825920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc1536a4-5237-432c-9c6a-1eb85963cdad tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.814522 Sep 23 03:54:14.826529 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1738/3386] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 03:54:14 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:14.831507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:14.832988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:14.850176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.851222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.851848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:14.852764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:14.853234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:14.853704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.234932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:15.279802 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37bf6fd2-99ef-4838-bad3-255a1934ee27 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.552469 Sep 23 03:54:15.281216 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1649/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:14 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:15.287516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0613a721-5378-4051-9276-7153e68d555d tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.297398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0613a721-5378-4051-9276-7153e68d555d tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:15.298603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:15.299222 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0613a721-5378-4051-9276-7153e68d555d tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016446 Sep 23 03:54:15.299679 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1650/3388] 10.222.0.25 () {58 vars in 1178 bytes} [Fri Sep 23 03:54:15 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:15.304368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.306256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:15.320267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.320781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.321230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.321989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.322458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.322896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.326704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ffd3ebe-0667-4077-b270-d577250ab3f6 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1542 microversion: 2.1 time: 0.498790 Sep 23 03:54:15.341852 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1739/3389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:14 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1542 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:15.351460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.356661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:15.359506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Searching by: {'deleted': False, 'project_id': '944c87b48a1e4769ab4feec284b4500c'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 03:54:15.374650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.377981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.379227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.381201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.385568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.386281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.447564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 03:54:15.507137 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-64ae445f-694f-40ed-84cc-12f12078abb9 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.164030 Sep 23 03:54:15.507708 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1740/3390] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 03:54:15 2022] GET /compute/v2.1/servers => generated 683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:15.520830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-plugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:15.534348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.534827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.535288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.546880 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] Creating event network-vif-plugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:54:15.557767 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d3edbdf8-bac0-4c2a-a90d-c6e4556254df req-369efbb5-c43f-49e9-9005-1f6a7aaa71d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040392 Sep 23 03:54:15.558902 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1741/3391] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:15.570657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.571805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:15.587915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.588875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.589517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.590497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.591301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.592250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.614731 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] HTTP exception thrown: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 HTTP/1.1 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2af8aefb-d6df-4416-9b83-4902bcf9eef6'} Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:15.616423 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 404 to user: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:15.622281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-455a4f93-4efd-4b55-8793-dfbd09c5a786 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 404 len: 111 microversion: 2.1 time: 0.058025 Sep 23 03:54:15.624088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1742/3392] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:15 2022] DELETE /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:15.627149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.627857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:15.635429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.636230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.636926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.638144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.638793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.639791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.680742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:15.815480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:15.838904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7787823-e5e2-49ed-a23b-bc6e2dbb33fd tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1285 microversion: 2.1 time: 0.536099 Sep 23 03:54:15.842960 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1651/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:15 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1285 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:15.851971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f85f5-a4e5-4c5b-a30a-fc2bce676ac2", "name": "network-vif-deleted", "tag": "d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:15.866822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.867460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.867979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.886671 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] Creating event network-vif-deleted:d2a88f82-a1a5-4c44-91fa-0dccdf4deaf3 for instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 on n-h1-858495-2 Sep 23 03:54:15.886911 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3087d2a8-04f7-4b68-9d61-41285d8005cc tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 204 len: 0 microversion: 2.1 time: 0.263156 Sep 23 03:54:15.887424 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1743/3394] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:15 2022] DELETE /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:15.895663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-189ecf7c-6386-4fb2-80be-15cac72a5f3a req-827fb92d-b2c6-4253-8d84-18460284546b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048786 Sep 23 03:54:15.896386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1652/3395] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:15.900031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.903581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:15.904082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:15.905173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:15.907950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:15.915463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.915963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.917473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.918251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.918711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.919180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.920820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.921458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.922177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.923158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:15.924118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:15.927176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:15.982678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:16.105050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8350e6a1-2a6c-4f8e-a301-ebde4a0e4035 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 204 len: 0 microversion: 2.1 time: 0.207064 Sep 23 03:54:16.106374 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1653/3396] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:15 2022] DELETE /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:16.133106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:16.133853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 2af8aefb-d6df-4416-9b83-4902bcf9eef6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:16.156743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.159534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.160875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.166270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.166772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.167231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.203093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] HTTP exception thrown: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 HTTP/1.1 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2af8aefb-d6df-4416-9b83-4902bcf9eef6'} Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:16.204924 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 404 to user: Instance 2af8aefb-d6df-4416-9b83-4902bcf9eef6 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af8a9787-d450-4829-a93d-2ce0cb8b6853 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6" status: 404 len: 111 microversion: 2.1 time: 0.083556 Sep 23 03:54:16.210984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1654/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:16 2022] GET /compute/v2.1/servers/2af8aefb-d6df-4416-9b83-4902bcf9eef6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:16.216532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:16.217201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:16.243897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.244585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.244924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.245700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.246161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.246595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.274233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:16.619314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:16.628018 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01d400d0-fa86-4371-98b6-bae7b2ddd764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.739290 Sep 23 03:54:16.637438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1744/3398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:15 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:16.646446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:16.647083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:16.654944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.655995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.656454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.657188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.657690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.658132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.700570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:16.709227 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d2fa1e2-c2e3-4732-8dc1-1b32cc017bff tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 200 len: 1523 microversion: 2.1 time: 0.496451 Sep 23 03:54:16.710301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1655/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:16 2022] GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:16.715113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:16.715943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:16.724598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.725247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.725829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.726649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.727220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.727781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.770318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.770905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.771458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.772034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lazy-loading 'fault' on Instance uuid 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:54:16.866529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a04c1f6ad4f83829a0a0bf81d56b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6c2d5cf60f42c29b4267a594a93df4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:16.880851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-504eb0d0-d3fa-44ec-86c0-74f6845465a0 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 200 len: 1322 microversion: 2.1 time: 0.168375 Sep 23 03:54:16.882984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1656/3400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:16 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:16.893232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:16.897147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:16.908707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.909813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.918384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:16.919226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:16.919878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:16.920477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:17.038861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:17.054043 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79b9ac25-dd41-4f80-9c96-4c0b17490fef tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1285 microversion: 2.1 time: 0.169158 Sep 23 03:54:17.057613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1657/3401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:16 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:17.126168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:17.136981 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9327e48e-c582-4e1e-98f0-ef25756aeb6d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.498250 Sep 23 03:54:17.152912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1745/3402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:16 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:17.652611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:17.653530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:17.666738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:17.667249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:17.667697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:17.668412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:17.669054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:17.669680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:17.745365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:17.746565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:17.755019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:17.755501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:17.756478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:17.757631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:17.758255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:17.762827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.209774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:18.218645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf3cf72e-51ba-47ea-a362-8a8a17e15bd6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1364 microversion: 2.1 time: 0.570595 Sep 23 03:54:18.219254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1658/3403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:17 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1364 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:18.248958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:18.259615 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f920557-7c93-41f5-abd5-26d8e3e42bfb tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 200 len: 1523 microversion: 2.1 time: 0.526761 Sep 23 03:54:18.262732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:18.263687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] [instance: 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:18.264512 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1746/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:17 2022] GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:18.274821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:18.280426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.281331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:18.282128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.286712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.287756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.289894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.290513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.301370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.302193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.314092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.315201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.315856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.317115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.328272 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] HTTP exception thrown: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Request method failure captured: Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 HTTP/1.1 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2gytZkId6pZB9T68i_1HI6kejluf3Q0F6rMPJX-x-zTktxfrNY8VsU0RwoJ4JfcwXNSP9tKmlXSSVjJYyG-5pw3fxzD96ReR-OKZGm6laTsrYdgvN7vHN0mJlFBS2R9NrHJ_nq6cScdPfVxLlwudsfW5_43gwvQwXg4ryR53_KXrs Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6c2d5cf60f42c29b4267a594a93df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 9e6c2d5cf60f42c29b4267a594a93df4 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 901a04c1f6ad4f83829a0a0bf81d56b9 Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '834f85f5-a4e5-4c5b-a30a-fc2bce676ac2'} Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. Sep 23 03:54:18.330169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. Sep 23 03:54:18.335210 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:18.340299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] Returning 404 to user: Instance 834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:18.341440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5aea1d90-4e38-4fb1-9240-4a0a21705718 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377 tempest-FloatingIPsAssociationNegativeTestJSON-1341053377-project] 10.222.0.25 "GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2" status: 404 len: 111 microversion: 2.1 time: 0.106294 Sep 23 03:54:18.347853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1659/3405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:18 2022] GET /compute/v2.1/servers/834f85f5-a4e5-4c5b-a30a-fc2bce676ac2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:18.363316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:18.364223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:18.381653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.382716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.383342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.384295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:18.384992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:18.385996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:18.987286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:19.004767 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd511987-1061-41df-a47a-99c498f7f040 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.736034 Sep 23 03:54:19.017573 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1747/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:18 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:19.050090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:19.059606 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e31ea928-9f6d-4ac4-8a4d-538e3e33305b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1516 microversion: 2.1 time: 0.709224 Sep 23 03:54:19.060207 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1660/3407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:18 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1516 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:19.247001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:19.247629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:19.260810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:19.261296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:19.261769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:19.262490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:19.262952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:19.263454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:19.289090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:19.289753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:19.304921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:19.305720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:19.306325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:19.307447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:19.308100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:19.308962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:19.841496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:19.858883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94dc6df1-050e-49a7-b36f-bb822c908cf4 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 200 len: 1481 microversion: 2.1 time: 0.573487 Sep 23 03:54:19.864243 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1661/3408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:19 2022] GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 1481 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:19.889672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab87fe5-171d-4fc3-a239-f160dd82ab1c", "name": "network-vif-deleted", "tag": "eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:19.932859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:19.934272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:19.934889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:19.949996 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] Creating event network-vif-deleted:eb5f4384-a0c3-4eaa-a84d-dabfa4a3c53f for instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c on n-h1-858495-2 Sep 23 03:54:19.955760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-734b413d-97d5-4aa0-a89d-b73a08d62d1a req-9d463360-711e-4add-8c9a-3e15b2593c30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085379 Sep 23 03:54:19.956660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1662/3409] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:20.029064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:20.030520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:20.049609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.050495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.051147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.051958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.052568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.053081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.250999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:20.483364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:20.492737 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6eb0858-f3af-4356-acb4-732a69d3aa00 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1550 microversion: 2.1 time: 1.249657 Sep 23 03:54:20.498625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1748/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:19 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1550 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:20.504193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:20.510646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:20.531411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.534750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.535340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.536177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.536738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.537269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.568662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:20.589057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc3e3a1b-9e40-463d-a77f-3cc1a42f3a6b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.564227 Sep 23 03:54:20.592550 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1663/3411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:20 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:20.613693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:20.614572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:20.632328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.634497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.639407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.640374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.641049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.641737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.945611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d649b78-2f57-410e-aa87-5320a8edb3ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.351430 Sep 23 03:54:20.946830 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1664/3412] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:54:20 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/os-interface => generated 284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:20.951888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:20.952727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 6ab87fe5-171d-4fc3-a239-f160dd82ab1c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:20.970509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.971372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.974022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.974985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:20.975610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:20.977733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:20.998589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:21.012457 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e182a134-e16e-472b-94c9-50431a99741c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.512455 Sep 23 03:54:21.015084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] HTTP exception thrown: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c HTTP/1.1 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6ab87fe5-171d-4fc3-a239-f160dd82ab1c'} Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:21.024172 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 404 to user: Instance 6ab87fe5-171d-4fc3-a239-f160dd82ab1c could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0c5b031-0bdf-4c7f-9bc4-9ec6d5f5be54 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c" status: 404 len: 111 microversion: 2.1 time: 0.077701 Sep 23 03:54:21.028551 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1665/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:20 2022] GET /compute/v2.1/servers/6ab87fe5-171d-4fc3-a239-f160dd82ab1c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:21.039580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1749/3414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:20 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:21.042936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:21.044697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:21.056493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:21.060735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:21.062280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:21.065434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:21.067826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:21.068471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:21.332893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd3dacc-3679-4c59-9983-65ee0125e42d", "tag": "9b93cc78-97a0-40ce-9528-850eca6afaa0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:21.368473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:21.370485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:21.371198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:21.387163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] Creating event network-changed:9b93cc78-97a0-40ce-9528-850eca6afaa0 for instance 2dd3dacc-3679-4c59-9983-65ee0125e42d on n-h1-858495-2 Sep 23 03:54:21.393662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2d60f9b8-8f8d-42c0-8c19-403791701557 req-859e4a9c-c6b5-4b4b-a717-7552217ce7fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064855 Sep 23 03:54:21.399544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1750/3415] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:54:21.617177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:21.617912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:21.626039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:21.626039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:21.626039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:21.635173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:21.635806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:21.636253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:22.150717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:22.177165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f60b9aff-f157-477f-8697-bb3eb4abf0b6 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1523 microversion: 2.1 time: 1.142549 Sep 23 03:54:22.194803 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1666/3416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:21 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1523 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:22.217805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:22.218446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:22.227934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:22.228926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:22.229427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:22.230159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:22.230626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:22.233313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:22.465818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:22.476808 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83403d3e-6f97-4214-a959-cf9370e7a7c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.863316 Sep 23 03:54:22.477430 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1751/3417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:21 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:22.860365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:22.873229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c359737c-f4da-4e0b-94ef-288cbac2a85e tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.673681 Sep 23 03:54:22.874910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1667/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:22 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:23.210119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:23.210813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:23.239118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.239541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.244408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.245269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.245795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.248996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.353144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.354040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.354684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.355318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lazy-loading 'fault' on Instance uuid 12be66a1-e9b7-4d41-84bb-d9f4e4572209 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:54:23.502414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12be66a1-e9b7-4d41-84bb-d9f4e4572209", "name": "network-vif-deleted", "tag": "29383b63-6301-40a6-a8e5-a4dae8c6f6d2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:23.521480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.523736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.524270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.540473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ba3ae1a568477782ba5cc8f2474fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944c87b48a1e4769ab4feec284b4500c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:23.543128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:23.551570 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3718748f-7ef6-42d1-97ad-ef2d04894fec tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 200 len: 1313 microversion: 2.1 time: 0.346054 Sep 23 03:54:23.559087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] Creating event network-vif-deleted:29383b63-6301-40a6-a8e5-a4dae8c6f6d2 for instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 on n-h2-858495-2 Sep 23 03:54:23.560081 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1752/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:23 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:23.565088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:23.568571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:23.576586 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-45c4ea64-5f79-49dc-b53d-80e81f41bb2c req-ff81b92d-2ee8-4c11-8354-18392a57cfe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080101 Sep 23 03:54:23.577685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1668/3420] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:23.585945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.586706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.593566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.594674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.596029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.596687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.728196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17df0aa-2a19-4428-9147-2477e5dc3691", "name": "network-vif-unplugged", "status": "completed", "tag": "dd045c9d-504d-4fe3-8f43-f889082f4f54"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:23.747188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.747995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.748610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.774228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:23.778909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] Creating event network-vif-unplugged:dd045c9d-504d-4fe3-8f43-f889082f4f54 for instance b17df0aa-2a19-4428-9147-2477e5dc3691 on n-h2-858495-2 Sep 23 03:54:23.793387 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2b1b4035-b762-4d4b-ae3b-c2f4e82348cb req-af01704b-85e4-44f2-82f8-4b16ed6c3c17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072341 Sep 23 03:54:23.794038 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1669/3421] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:54:23.902062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:23.902997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:23.912406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.921092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.921827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:23.923406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:23.924045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:23.924646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:24.093676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:24.103180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bc30080-0427-4825-ad21-6bba09db7c0c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.541788 Sep 23 03:54:24.104262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1753/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:23 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:24.584772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:24.586131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] [instance: 12be66a1-e9b7-4d41-84bb-d9f4e4572209] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:24.588315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:24.603529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:24.604286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:24.604902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:24.605899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:24.606526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:24.607127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:24.651545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] HTTP exception thrown: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Request method failure captured: Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 HTTP/1.1 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2wTWV2gdU8UqZh3xcv-Kqd1loVpv24P6WPCe6baQx58l07_Zaz2s1V5eooxuD5QzCoBveg0mMpdJ78lIrCA9WVgy17YE0DaVZiji2hGkKWgWl8I466AfheuZNRXIBvctCuj3LxaamherYDOET5_C6ptihQuvxZ8fg2ESJrbdzsnUI Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_944c87b48a1e4769ab4feec284b4500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 944c87b48a1e4769ab4feec284b4500c Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1446198441 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 59ba3ae1a568477782ba5cc8f2474fc6 Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListServersNegativeTestJSON-1446198441-project Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '12be66a1-e9b7-4d41-84bb-d9f4e4572209'} Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:24.655934 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. Sep 23 03:54:24.660637 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:24.673964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] Returning 404 to user: Instance 12be66a1-e9b7-4d41-84bb-d9f4e4572209 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:24.674822 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f26dd07c-ba87-4647-91db-c16e24660ad3 tempest-ListServersNegativeTestJSON-1446198441 tempest-ListServersNegativeTestJSON-1446198441-project] 10.222.0.25 "GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209" status: 404 len: 111 microversion: 2.1 time: 0.093944 Sep 23 03:54:24.678037 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1754/3423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:24 2022] GET /compute/v2.1/servers/12be66a1-e9b7-4d41-84bb-d9f4e4572209 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:24.778949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:24.797697 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad3f30d9-1235-4a4f-8bb7-9a85ce3635a1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.900365 Sep 23 03:54:24.798839 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1670/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:23 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:25.136582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:25.139955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:25.148482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:25.150162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:25.151169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:25.152391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:25.153183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:25.154187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:25.397601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:25.689602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:25.699014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a894be1c-1a75-4c2d-9eea-af7ed179ae83 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.572417 Sep 23 03:54:25.714522 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1755/3425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:25 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:25.761870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:25.778910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:25.779694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:25.780956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:25.799907 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] Creating event network-changed:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:54:25.821593 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2b3d5059-6342-4e6d-a000-0bcdb903aff7 req-8ce1cbea-9306-48c3-90b6-39064fe28b20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062161 Sep 23 03:54:25.823050 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1671/3426] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:25.825998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:25.826939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:25.836586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:25.838515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:25.843053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:25.844357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:25.845217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:25.845941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:26.419443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:26.443403 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d085df59-48b7-44cf-8285-bb975968294c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.621608 Sep 23 03:54:26.444520 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1756/3427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:25 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:26.726011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:26.726928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:26.747185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:26.747808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:26.748336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:26.749200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:26.750019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:26.750617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:27.069056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:27.082781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8a7b728-9c65-417d-bc78-dc8bdcfac103 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.361798 Sep 23 03:54:27.103171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1672/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:26 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:27.401042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41d9b59f-b3ee-47ec-8c50-b5dd0f70a391 tempest-ListImageFiltersNegativeTestJSON-1100515645 tempest-ListImageFiltersNegativeTestJSON-1100515645-project] Calling method '.version_select at 0x7f0c8b0b3af0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:27.432242 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-41d9b59f-b3ee-47ec-8c50-b5dd0f70a391 tempest-ListImageFiltersNegativeTestJSON-1100515645 tempest-ListImageFiltersNegativeTestJSON-1100515645-project] HTTP exception thrown: Image not found. Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41d9b59f-b3ee-47ec-8c50-b5dd0f70a391 tempest-ListImageFiltersNegativeTestJSON-1100515645 tempest-ListImageFiltersNegativeTestJSON-1100515645-project] Request method failure captured: Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/images/7c89be98-a9f1-46ba-b7d4-5c71f522aa6e HTTP/1.1 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS3zAE9av4yMJG7NxnYOytYYT9KpaZQiM3niumRqceIR-45aXhowZNr04MpOnYhj3F1qnksGmUSL6PoCBW__3pW8LOLrLXju9SWibCGNm3Unns6oWrdnfqaUbV9F2-TSwL8lwiuaVPKC8CSvphDtPy3lVQSZoRNlVbNl-pf6lRU8CeI Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 44bba555e2db4aa3b29459099ed92191 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1100515645 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44bba555e2db4aa3b29459099ed92191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44bba555e2db4aa3b29459099ed92191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/44bba555e2db4aa3b29459099ed92191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_44bba555e2db4aa3b29459099ed92191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1100515645 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 44bba555e2db4aa3b29459099ed92191 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1100515645 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ListImageFiltersNegativeTestJSON-1100515645-project Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: d24e385ae9724421b7110f099fedadf8 Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1100515645-project Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: exception: Image not found. Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7c89be98-a9f1-46ba-b7d4-5c71f522aa6e'} Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7c89be98-a9f1-46ba-b7d4-5c71f522aa6e Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 03:54:27.434299 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c89be98-a9f1-46ba-b7d4-5c71f522aa6e could not be found. Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41d9b59f-b3ee-47ec-8c50-b5dd0f70a391 tempest-ListImageFiltersNegativeTestJSON-1100515645 tempest-ListImageFiltersNegativeTestJSON-1100515645-project] Returning 404 to user: Image not found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:27.439477 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-41d9b59f-b3ee-47ec-8c50-b5dd0f70a391 tempest-ListImageFiltersNegativeTestJSON-1100515645 tempest-ListImageFiltersNegativeTestJSON-1100515645-project] 10.222.0.25 "GET /compute/v2.1/images/7c89be98-a9f1-46ba-b7d4-5c71f522aa6e" status: 404 len: 62 microversion: 2.1 time: 0.220218 Sep 23 03:54:27.451898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1757/3429] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 23 03:54:27 2022] GET /compute/v2.1/images/7c89be98-a9f1-46ba-b7d4-5c71f522aa6e => generated 62 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:27.472795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:27.473884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:27.487834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:27.488375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:27.488830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:27.489643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:27.490298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:27.490814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:28.130424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:28.131304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:28.146811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:28.147518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:28.147975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:28.148700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:28.151711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:28.152213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:28.198470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:28.218159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e09b26e-0c02-49af-bba6-273b08b63fc8 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.747091 Sep 23 03:54:28.221311 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1673/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:27 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:28.310011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17df0aa-2a19-4428-9147-2477e5dc3691", "name": "network-vif-plugged", "status": "completed", "tag": "dd045c9d-504d-4fe3-8f43-f889082f4f54"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:28.369272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:28.371347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:28.372749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:28.403635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] Creating event network-vif-plugged:dd045c9d-504d-4fe3-8f43-f889082f4f54 for instance b17df0aa-2a19-4428-9147-2477e5dc3691 on n-h2-858495-2 Sep 23 03:54:28.415979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cf970bb2-23d2-4909-bc3f-abf2c4e7beab req-eaeef3fd-1197-4821-8ead-354a37b457e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113789 Sep 23 03:54:28.417195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1674/3431] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:28.454791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:28.471641 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71aa1fa9-8fb9-44ff-b5b8-c24185eaa33e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.357405 Sep 23 03:54:28.493753 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1758/3432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:28 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:29.249818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:29.251795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:29.276890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:29.281043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:29.284090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:29.292089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:29.293641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:29.295631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:29.502341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:29.503065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:29.523326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:29.524118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:29.524672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:29.527875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:29.528479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:29.531978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:29.563891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:29.573461 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a3b6507-73e9-4086-a8e5-4b7e1cc21413 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1522 microversion: 2.1 time: 0.329254 Sep 23 03:54:29.583089 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1675/3433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:29 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:29.879045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:29.888595 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63c62e65-b990-4bc5-a6bf-93a4ed476922 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.390061 Sep 23 03:54:29.891880 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1759/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:29 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:30.453512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd3dacc-3679-4c59-9983-65ee0125e42d", "name": "network-vif-plugged", "status": "completed", "tag": "9b93cc78-97a0-40ce-9528-850eca6afaa0"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:30.481138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:30.483315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:30.484539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:30.517393 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] Creating event network-vif-plugged:9b93cc78-97a0-40ce-9528-850eca6afaa0 for instance 2dd3dacc-3679-4c59-9983-65ee0125e42d on n-h1-858495-2 Sep 23 03:54:30.524280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-63a9d42d-bba9-45b4-8a2e-18c70129911b req-3cf64474-640e-4a9c-b141-13a2a97af2de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081656 Sep 23 03:54:30.529700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1676/3435] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:30.609099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:30.609944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:30.637089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:30.640164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:30.640663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:30.642609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:30.644811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:30.645261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:30.920591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:30.921307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:30.933550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:30.950151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:30.950920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:30.952069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:30.952825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:30.953561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.008927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:31.096311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:31.136896 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bcd779a4-44b9-4d9d-9a72-3460e29011d7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1507 microversion: 2.1 time: 0.532197 Sep 23 03:54:31.173218 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1760/3436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:30 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1507 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:31.193908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:31.195720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:31.210798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.212012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.212999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.226507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.227780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.228814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.673118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:31.683011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a003f457-95ef-484d-a6f3-1503af77593a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1327 microversion: 2.1 time: 0.767037 Sep 23 03:54:31.684164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1677/3437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:30 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1327 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:31.794589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:31.825556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c7459da-367a-438e-aa99-326c3f999917 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 200 len: 1507 microversion: 2.1 time: 0.643267 Sep 23 03:54:31.840973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1761/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:31 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:31.932770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Calling method '.version_select at 0x7f0c93424040>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:31.956672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.957551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.958327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.959426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.960499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.961366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.963973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Calling method '.version_select at 0x7f0c93398d30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:31.989671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.991168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.991632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:31.992391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:31.997146 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b95483d-b90f-4204-b9e1-6a2fe7270850 tempest-AbsoluteLimitsTestJSON-2122598483 tempest-AbsoluteLimitsTestJSON-2122598483-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.154702 Sep 23 03:54:31.998428 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1762/3439] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 23 03:54:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:31.999506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:31.999980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:32.005060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:32.006666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:32.015242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:32.016699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:32.017604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:32.018707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:32.019394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:32.020068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:32.034559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9bb5293c-77fe-4147-b03a-b6eb5358e936 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.349070 Sep 23 03:54:32.035445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1678/3440] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 23 03:54:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:32.078119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:32.109046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-385053520", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:32.240732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28f67135-751f-4654-a33c-a70aa04a47b7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 204 len: 0 microversion: 2.1 time: 0.240596 Sep 23 03:54:32.241846 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1763/3441] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:31 2022] DELETE /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:54:32.254037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:32.460673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1469429043", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "5f98c5c4-b534-48ba-a077-43b45820e902"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:32.556895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] validate_networks() for [('5f98c5c4-b534-48ba-a077-43b45820e902', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:33.114004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Getting quotas for project 310fdfa3de3e4d7fbce2575902d8a7f9. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:33.141957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Getting quotas for user 7c4cf6040e4b48dfa6961cd60ab81416 and project 310fdfa3de3e4d7fbce2575902d8a7f9. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:33.197340 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Request method failure captured: Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 1751 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS33Ljo7TDPvsp-q5XhTlE8c-8_SL8LZ5QPERqfKtk34W7HCDR4qOflCLVkU5btpeR_wNcHDzExsFFYL6U2Ct61U9avn4NzirdQSqW_QsIM9ZH5Gpt2rkOK-jcBuNRn-Do7QqHYuPFtL_67Adho4SgDvw6wwcJPi00ifjpQb3yV4wwM Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 310fdfa3de3e4d7fbce2575902d8a7f9 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1407631294 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310fdfa3de3e4d7fbce2575902d8a7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310fdfa3de3e4d7fbce2575902d8a7f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/310fdfa3de3e4d7fbce2575902d8a7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_310fdfa3de3e4d7fbce2575902d8a7f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1407631294 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 310fdfa3de3e4d7fbce2575902d8a7f9 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1407631294 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7c4cf6040e4b48dfa6961cd60ab81416 Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-385053520", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:33.201728 n-d-858495-2 devstack@n-api.service[128723]: exception: Maximum number of metadata items exceeds 128 Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-385053520', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:33.204935 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 23 03:54:33.208169 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:33.213281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:33.214435 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5551026d-fd51-4984-b9ea-6922919c4d96 tempest-AbsoluteLimitsNegativeTestJSON-1407631294 tempest-AbsoluteLimitsNegativeTestJSON-1407631294-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.109820 Sep 23 03:54:33.216703 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1679/3442] 10.222.0.25 () {60 vars in 1148 bytes} [Fri Sep 23 03:54:32 2022] POST /compute/v2.1/servers => generated 87 bytes in 1113 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:54:33.233267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:33.235614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:33.254273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:33.254894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:33.255452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:33.256822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:33.257439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:33.258034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:33.864454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:33.879199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53a066b8-c374-4e80-88aa-d6b51f14743c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1506 microversion: 2.1 time: 0.656024 Sep 23 03:54:33.880020 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1680/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:33 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:33.907642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:33.908328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:33.919364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:33.920379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:33.920823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:33.923961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:33.928992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:33.929708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:34.013547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:34.014127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:34.014429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:34.015039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:34.015625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:34.027884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:34.030474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:34.031375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:34.036641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:34.037304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:34.037970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:34.098245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:34.117307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Getting quotas for user bb763b81c4da4dea80f92bf1de1d2d54 and project 46500f7bd44b4d9f9c02c3228ff55038. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:34.147491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:34.150269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:34.213768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:34.278245 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b1e7fb79-1abe-4980-b8a7-32b0f4799b65 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822667 Sep 23 03:54:34.278921 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1764/3444] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:54:34.291409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a28529c5-b040-4b0d-9f98-203e918bce04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:34.292887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a28529c5-b040-4b0d-9f98-203e918bce04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:34.498542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a28529c5-b040-4b0d-9f98-203e918bce04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:34.509931 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a28529c5-b040-4b0d-9f98-203e918bce04 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1218 microversion: 2.1 time: 0.222950 Sep 23 03:54:34.525561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1765/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:34 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:34.722882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:34.731622 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b3f0b8a-6ef5-4051-939b-16f9aa39447a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1506 microversion: 2.1 time: 0.828813 Sep 23 03:54:34.732214 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1681/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:33 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:34.760086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:34.760826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:34.782603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:34.783112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:34.783555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:34.784844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:34.785303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:34.785855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:34.873898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:35.066921 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66eb7169-b612-401b-9314-1f8c5b508d47 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 204 len: 0 microversion: 2.1 time: 0.309843 Sep 23 03:54:35.069018 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1766/3447] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:54:34 2022] DELETE /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:54:35.077102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:35.077817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:35.091494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:35.097587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:35.098301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:35.099057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:35.099519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:35.103451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:35.539578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:35.540775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:35.563586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:35.572912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:35.576355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:35.577321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:35.577917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:35.578625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:35.897435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:35.918314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97a18d68-a003-4ccd-933b-4d35f5dc7f4a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1222 microversion: 2.1 time: 0.382846 Sep 23 03:54:35.918956 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1767/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:35 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1222 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:35.932915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:35.950321 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f8a8b68c-07f5-4fc7-bf9e-8472df3f68b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1512 microversion: 2.1 time: 0.876631 Sep 23 03:54:35.951278 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1682/3449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:35 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1512 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:36.442535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:36.444473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:36.445075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:36.446678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:36.449243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:36.454627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:36.462086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:36.500346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3f53a7f-cc33-4b95-8bd1-26ccc3fa0c4b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1523602749", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:36.503988 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a3f53a7f-cc33-4b95-8bd1-26ccc3fa0c4b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] HTTP exception thrown: min_count must be <= max_count Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3f53a7f-cc33-4b95-8bd1-26ccc3fa0c4b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Request method failure captured: Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 184 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS37d562r33wFtbQP5ONEhWMQXH5Ms1ba1uPL0aUHoXrwvpzi_fqjnXob9x47ynGpRk2QJfS3wyzyfehcqtBiQN5wu5nbpIJYBtY4D-tkkKqjINnn1ugcsorIr5u6Sulv-CEe0LUckpC8E87jVinvHdJAGYRMKHRWk3lvbxB0B8Df-Q Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bc1dbdfb586a48fc9042f1263b5a87da Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1523602749", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: exception: min_count must be <= max_count Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1523602749', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 23 03:54:36.505506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.512983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3f53a7f-cc33-4b95-8bd1-26ccc3fa0c4b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Returning 400 to user: min_count must be <= max_count {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:36.515354 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3f53a7f-cc33-4b95-8bd1-26ccc3fa0c4b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.557641 Sep 23 03:54:36.516309 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1683/3450] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:35 2022] POST /compute/v2.1/servers => generated 74 bytes in 564 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:54:36.548053 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-96ffca7e-b80b-4021-b725-83adbd11ff83 tempest-AZV2TestJSON-346298303 tempest-AZV2TestJSON-346298303-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.620698 Sep 23 03:54:36.559738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1768/3451] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Sep 23 03:54:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:54:36.652339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-233de9a6-922b-4c17-ac46-665d38c6e2c4 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-25282584", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "max_count": 0}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-233de9a6-922b-4c17-ac46-665d38c6e2c4 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Request method failure captured: Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 166 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS37d562r33wFtbQP5ONEhWMQXH5Ms1ba1uPL0aUHoXrwvpzi_fqjnXob9x47ynGpRk2QJfS3wyzyfehcqtBiQN5wu5nbpIJYBtY4D-tkkKqjINnn1ugcsorIr5u6Sulv-CEe0LUckpC8E87jVinvHdJAGYRMKHRWk3lvbxB0B8Df-Q Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bc1dbdfb586a48fc9042f1263b5a87da Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-25282584", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "max_count": 0}} Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-25282584', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'max_count': 0}}} Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 0 Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:54:36.659456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:36.664807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.666209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-233de9a6-922b-4c17-ac46-665d38c6e2c4 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:36.667274 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-233de9a6-922b-4c17-ac46-665d38c6e2c4 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021985 Sep 23 03:54:36.681445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1684/3452] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:36.864959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9efcbf8b-5747-466e-be24-533ab99f2807 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1402670667", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "max_count": 2.5}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9efcbf8b-5747-466e-be24-533ab99f2807 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Request method failure captured: Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 170 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS37d562r33wFtbQP5ONEhWMQXH5Ms1ba1uPL0aUHoXrwvpzi_fqjnXob9x47ynGpRk2QJfS3wyzyfehcqtBiQN5wu5nbpIJYBtY4D-tkkKqjINnn1ugcsorIr5u6Sulv-CEe0LUckpC8E87jVinvHdJAGYRMKHRWk3lvbxB0B8Df-Q Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: bc1dbdfb586a48fc9042f1263b5a87da Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1402670667", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "max_count": 2.5}} Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1402670667', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'max_count': 2.5}}} Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 2.5 Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:54:36.878675 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:36.885088 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:36.897737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9efcbf8b-5747-466e-be24-533ab99f2807 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:36.902026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9efcbf8b-5747-466e-be24-533ab99f2807 tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041265 Sep 23 03:54:36.903080 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1769/3453] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:36.936305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17df0aa-2a19-4428-9147-2477e5dc3691", "name": "network-vif-deleted", "tag": "dd045c9d-504d-4fe3-8f43-f889082f4f54"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:36.941775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:36.945332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:36.980109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:36.982055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:36.983631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:36.988160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:36.990209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:36.991172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:36.993565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:36.995657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:36.998183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:37.042482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] Creating event network-vif-deleted:dd045c9d-504d-4fe3-8f43-f889082f4f54 for instance b17df0aa-2a19-4428-9147-2477e5dc3691 on n-h2-858495-2 Sep 23 03:54:37.064846 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4bc91386-239c-46e0-ab54-a6741980b227 req-7e4344e1-8081-4b04-85d4-8c209a17d207 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133827 Sep 23 03:54:37.073015 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1685/3454] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:37.095742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:37.098257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:37.123634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:37.125372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:37.128694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:37.129594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:37.131610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:37.132293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:37.287561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:37.304077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b740ad6a-064d-4a89-b555-2f4d9ce8257f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1288 microversion: 2.1 time: 0.365984 Sep 23 03:54:37.305558 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1770/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:36 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1288 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:37.311822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73683ee4-2587-4fab-9a5e-023dfc268c0f tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-367074656", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 0}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73683ee4-2587-4fab-9a5e-023dfc268c0f tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Request method failure captured: Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 167 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS37d562r33wFtbQP5ONEhWMQXH5Ms1ba1uPL0aUHoXrwvpzi_fqjnXob9x47ynGpRk2QJfS3wyzyfehcqtBiQN5wu5nbpIJYBtY4D-tkkKqjINnn1ugcsorIr5u6Sulv-CEe0LUckpC8E87jVinvHdJAGYRMKHRWk3lvbxB0B8Df-Q Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: bc1dbdfb586a48fc9042f1263b5a87da Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-367074656", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 0}} Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-367074656', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'min_count': 0}}} Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 0 Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:54:37.316486 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 03:54:37.322246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.333031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73683ee4-2587-4fab-9a5e-023dfc268c0f tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:37.338643 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73683ee4-2587-4fab-9a5e-023dfc268c0f tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031818 Sep 23 03:54:37.342984 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1771/3456] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:37.584052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17971a19-68fb-47ef-865f-7cbced3d1a1b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1122760653", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 2.5}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17971a19-68fb-47ef-865f-7cbced3d1a1b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Request method failure captured: Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 170 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS37d562r33wFtbQP5ONEhWMQXH5Ms1ba1uPL0aUHoXrwvpzi_fqjnXob9x47ynGpRk2QJfS3wyzyfehcqtBiQN5wu5nbpIJYBtY4D-tkkKqjINnn1ugcsorIr5u6Sulv-CEe0LUckpC8E87jVinvHdJAGYRMKHRWk3lvbxB0B8Df-Q Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdd890b748047ffa0b96d1d7896d1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 2bdd890b748047ffa0b96d1d7896d1ae Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1909835040 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: bc1dbdfb586a48fc9042f1263b5a87da Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1909835040-project Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1122760653", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 2.5}} Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1122760653', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'min_count': 2.5}}} Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 2.5 Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:54:37.589103 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 03:54:37.594033 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:37.600065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17971a19-68fb-47ef-865f-7cbced3d1a1b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:37.601162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17971a19-68fb-47ef-865f-7cbced3d1a1b tempest-MultipleCreateNegativeTestJSON-1909835040 tempest-MultipleCreateNegativeTestJSON-1909835040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022502 Sep 23 03:54:37.601964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1772/3457] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:54:37.644690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd3dacc-3679-4c59-9983-65ee0125e42d", "name": "network-vif-deleted", "tag": "9b93cc78-97a0-40ce-9528-850eca6afaa0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:37.663110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:37.671804 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67f96413-d15e-44c7-bf9d-6f74ce184f76 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 200 len: 1512 microversion: 2.1 time: 0.596998 Sep 23 03:54:37.678122 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1686/3458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:37 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 1512 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:37.703644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:37.715390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:37.716446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:37.733948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] Creating event network-vif-deleted:9b93cc78-97a0-40ce-9528-850eca6afaa0 for instance 2dd3dacc-3679-4c59-9983-65ee0125e42d on n-h1-858495-2 Sep 23 03:54:37.751494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b6a3d784-3fbf-4771-a2fc-ceea60711b52 req-7f53f4f9-4b31-4076-a018-45e50f3670eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114378 Sep 23 03:54:37.761553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1773/3459] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:54:38.330254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:38.331941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:38.350120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:38.350685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:38.351549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:38.352744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:38.353690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:38.354332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:38.512362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:38.524585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-380874ab-ad90-4335-a61c-b3da5d3b62f0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1276 microversion: 2.1 time: 0.197825 Sep 23 03:54:38.541749 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1687/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:38 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:38.713230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:38.713998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:38.724542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:38.725262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:38.726008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:38.727220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:38.727901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:38.728517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:38.747162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d HTTP/1.1 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2dd3dacc-3679-4c59-9983-65ee0125e42d'} Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:38.749163 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:54:38.757215 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:54:38.759320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:38.760432 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3ebbebb-6d50-4d9e-b858-59d59d39c8fb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 404 len: 111 microversion: 2.1 time: 0.055313 Sep 23 03:54:38.764619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1774/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:38 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:54:38.769974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf5926e1-60a9-47e1-ad77-263ec2ccbd84 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '.version_select at 0x7f0c9341eee0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:38.791194 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf5926e1-60a9-47e1-ad77-263ec2ccbd84 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-546869270" status: 202 len: 0 microversion: 2.1 time: 0.025389 Sep 23 03:54:38.801852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1688/3462] 10.222.0.25 () {58 vars in 1206 bytes} [Fri Sep 23 03:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-546869270 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:54:38.940407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-525014872", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:39.035509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:39.558791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:39.558791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:39.566583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:39.567087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:39.567542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:39.568288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:39.568729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:39.569161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:40.395924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:40.406888 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3637c43-f927-487b-be1f-7948bef99f9a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.854175 Sep 23 03:54:40.412021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1689/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:39 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:40.878375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:40.879481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:40.879961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:40.880709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:40.885652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:40.927872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:40.928425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:40.930080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:40.932540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:40.933107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:40.933581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:40.954031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:40.995026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:41.002515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:41.031587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:41.040798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:41.174615 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f3effcbe-b53f-4a20-9c40-33126a9c2fb6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237844 Sep 23 03:54:41.181785 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1775/3464] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:54:41.193285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-82a7f18e-b9ea-471c-bf90-437214306604 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:41.195000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-82a7f18e-b9ea-471c-bf90-437214306604 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:41.390671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-82a7f18e-b9ea-471c-bf90-437214306604 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:41.400021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-82a7f18e-b9ea-471c-bf90-437214306604 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1208 microversion: 2.1 time: 0.210589 Sep 23 03:54:41.405242 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1690/3465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:41 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1208 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:41.443567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:41.444221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:41.456224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:41.457093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:41.458374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:41.459169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:41.459640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:41.460132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:41.523987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-137658329", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:41.638802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:41.640242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:41.641363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:41.643996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:41.644736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:41.668162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:41.669809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:41.670568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:41.672181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:41.673073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:41.673769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:41.724962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Getting quotas for project 2b1db4a8d1e34f94935e8f4d4a0e459b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:41.735432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Getting quotas for user d413b421c9ea4464b683aa680deb5be7 and project 2b1db4a8d1e34f94935e8f4d4a0e459b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:41.753798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:41.756650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:41.828927 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-995c4fe3-624c-4b76-82ce-8e313204d4cd tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.547883 Sep 23 03:54:41.830963 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1776/3466] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 03:54:41.835875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4b471f-72b5-4406-8d77-b732d7ec7414", "tag": "da175bb5-9b03-4342-9753-3117b80b497e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:41.848315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:41.849119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:41.850996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:41.906206 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] Creating event network-changed:da175bb5-9b03-4342-9753-3117b80b497e for instance cd4b471f-72b5-4406-8d77-b732d7ec7414 on n-h2-858495-2 Sep 23 03:54:41.918852 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fd8af0a0-a92d-443b-9bd8-337836dabe87 req-21088f8c-21e2-4f41-9745-ecba71fe6f4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085225 Sep 23 03:54:41.922249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1777/3467] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:41.938162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:41.939017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:42.001229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:42.015488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a644f910-5252-49e1-a13c-bf8ae72b1a5c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.578649 Sep 23 03:54:42.016656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1691/3468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:41 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:42.139874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:42.153826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:42.157342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:42.161063 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22ce40dd-3048-4cd5-b7d3-9ec3e85e5b64 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1280 microversion: 2.47 time: 0.236664 Sep 23 03:54:42.164399 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1778/3469] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:41 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:42.430356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:42.430972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:42.433480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:42.444879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:42.445879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:42.446819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:42.450496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:42.451207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:42.453049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:42.589462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:42.610834 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e6a58d9-5035-42b9-abaa-8fc9e57fed2f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1260 microversion: 2.1 time: 0.184561 Sep 23 03:54:42.637816 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1692/3470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:42 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:43.042430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:43.042967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:43.057288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.059274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.059729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.062672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.065387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.067539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.187827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:43.188681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:43.199695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:43.203620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.204136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.204594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.205388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.205870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.206317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.406345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:43.416554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:43.424884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:43.426777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0362560-8eb4-418b-82a2-dd00f764dbe0 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.390228 Sep 23 03:54:43.426998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:43.427356 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1779/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:43 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:43.430535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f30c3e9-8fe7-4216-b154-d9cce036d15d tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1332 microversion: 2.47 time: 0.246602 Sep 23 03:54:43.432233 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1693/3472] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:43 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1332 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:43.644464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:43.645081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:43.653057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.653591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.658123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.659714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:43.662058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:43.662694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:43.817271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:43.828713 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71b501aa-b8b4-440a-95e6-800f3dae7587 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1266 microversion: 2.1 time: 0.188208 Sep 23 03:54:43.838803 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1780/3473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:43 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:44.450653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:44.451265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:44.459876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:44.461021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.461207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:44.474502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.474691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.475086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:44.475671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.475824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.476303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.476740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:44.477098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:44.482297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.483021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.483770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:44.745613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:44.757147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:44.765231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:44.766932 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c295643-29db-4520-abbb-410a7554139f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1338 microversion: 2.47 time: 0.311486 Sep 23 03:54:44.771075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1781/3474] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:44 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1338 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:44.856651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:44.857727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:44.869287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.870115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.871055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:44.872076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:44.872775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:44.873901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:45.254274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:45.286872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28a8e40f-fe0c-4c6c-96bc-1df52e40fdf6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1266 microversion: 2.1 time: 0.435048 Sep 23 03:54:45.290473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1782/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:44 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:45.406041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:45.419550 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd3ab519-c3c2-4c3f-86e1-ef54d9fb672b tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.972888 Sep 23 03:54:45.421043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1694/3476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:44 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:45.797056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:45.798619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:45.819197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:45.820137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:45.820769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:45.822104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:45.823349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:45.825096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:46.001779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:46.025986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:46.028033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:46.029697 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53de8a5d-cf5b-43ee-a627-42840942b671 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1338 microversion: 2.47 time: 0.237451 Sep 23 03:54:46.047929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1783/3477] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:45 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:46.311444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:46.312260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:46.331471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:46.332409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:46.333500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:46.335303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:46.343412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:46.344156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:46.443111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:46.443723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:46.483091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:46.494041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:46.494593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:46.495441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:46.523403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:46.523908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:47.118450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:47.136125 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d860c6d-c541-4b0f-b952-0a8963851d24 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 0.828260 Sep 23 03:54:47.137882 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1695/3478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:46 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:47.145953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:47.152768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:47.167807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:47.187500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:47.187500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:47.187500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:47.187500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:47.187500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:47.188117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:47.215603 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d26027b9-9f33-499f-80cc-a67383cf38f5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.773926 Sep 23 03:54:47.218578 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1784/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:46 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:47.495046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:47.516219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:47.518323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:47.519539 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-579f8a66-3704-490c-b79d-42750d5a1d8f tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1359 microversion: 2.47 time: 0.379861 Sep 23 03:54:47.520132 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1696/3480] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:47 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:47.552841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1176966544"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:47.556295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:47.575429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:47.577533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:47.578373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:47.582794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:47.584547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:47.585585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.123018 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-acef1ef3-b06e-4e6a-bb81-7031220b22f0 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "POST /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0/action" status: 202 len: 52 microversion: 2.47 time: 0.574332 Sep 23 03:54:48.126777 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1785/3481] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 03:54:47 2022] POST /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0/action => generated 52 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:54:48.138689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:48.139612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:48.154152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.155851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.166618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:48.170238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:48.170601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.177710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.178662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.179452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.213879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.218301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.222948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.224081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.225951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.230056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.307983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:54:48.509178 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b547520-53e4-481f-8204-b6e1a1a2a4c3 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 204 len: 0 microversion: 2.47 time: 0.375548 Sep 23 03:54:48.509958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1697/3482] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:54:48 2022] DELETE /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:54:48.539885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:48.545074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:48.570275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.571253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.571777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:48.573569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:48.574310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:48.576494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:49.925980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:49.932449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:49.936769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:49.944833 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-70db43ac-7210-4a68-916d-1fc6a738bb2a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 1.786870 Sep 23 03:54:49.949086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3cbd0874-d1e1-4855-bc3e-844bc76fc43d tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 1.438006 Sep 23 03:54:49.951422 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1698/3483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:48 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:49.963785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:49.965528 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1786/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:48 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:49.978116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:49.978871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b314f4-c223-4f76-aebb-d556dfccf369", "tag": "ea5a3f6a-650c-41d3-a073-97ddd46d5e90"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:49.990217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:49.994490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:49.995059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:49.995602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:49.996027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:49.997081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:49.997427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:49.997577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:49.998205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:50.019606 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] Creating event network-changed:ea5a3f6a-650c-41d3-a073-97ddd46d5e90 for instance 68b314f4-c223-4f76-aebb-d556dfccf369 on n-h1-858495-2 Sep 23 03:54:50.035288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1702d7f1-9614-42a4-beb6-4a8073aba18b req-0c0179df-2145-4991-a82e-0206282a94fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067964 Sep 23 03:54:50.041487 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1787/3485] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:50.186192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:50.201276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:50.203704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd413b421c9ea4464b683aa680deb5be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1db4a8d1e34f94935e8f4d4a0e459b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:50.206064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d9b9e2bf-ea4d-4834-87ec-340d84b218e6 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 200 len: 1365 microversion: 2.47 time: 0.252557 Sep 23 03:54:50.224087 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1699/3486] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:49 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:54:50.973500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:50.974207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:50.977759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:50.978395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:50.989485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:50.990290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:50.990926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:50.991831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:50.992670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:50.993132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:50.993645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:50.993780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:50.994132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:50.994829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:50.995286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:50.995710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:51.400045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:51.697055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=10 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:52.149021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=24 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:52.276092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:52.286390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52fc8b67-79e5-4edb-88aa-5c23eeab6a6a tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 1.312354 Sep 23 03:54:52.288682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:52.292266 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1700/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:50 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:52.310229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:52.313472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] [instance: 18ca99e0-653a-4a74-aacb-0cf691ccfea0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:52.320248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e03480bb-9fe5-4922-92db-b9fbe7b5c867 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 1.351737 Sep 23 03:54:52.333139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:52.333887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:52.334352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:52.335143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1788/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:50 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:52.335282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:52.335642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:52.336258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:52.346451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b471f-72b5-4406-8d77-b732d7ec7414", "name": "network-vif-plugged", "status": "completed", "tag": "da175bb5-9b03-4342-9753-3117b80b497e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:52.367625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:52.369375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:52.369527 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] HTTP exception thrown: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. Sep 23 03:54:52.370222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Request method failure captured: Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 HTTP/1.1 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4AfTQtNVXgSvEyuVmj6Um3q_A7romz0xd1Jh8xI1iHJU9Z8WSO1-bxvZl2-0ycLJxArK9KlMJ8bus91oEur0BGIu4SqXSaqeEzXlfjx3s6SVq74zMbjcGEiJjUN5VzefpMqBgwLLNkNJY-wMwEACpQ1LkMgRJC6DsiVW7Js-sV6Nk Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 2b1db4a8d1e34f94935e8f4d4a0e459b Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAaction247Test-1002023661 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2b1db4a8d1e34f94935e8f4d4a0e459b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2b1db4a8d1e34f94935e8f4d4a0e459b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2b1db4a8d1e34f94935e8f4d4a0e459b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2b1db4a8d1e34f94935e8f4d4a0e459b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAaction247Test-1002023661 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 2b1db4a8d1e34f94935e8f4d4a0e459b Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAaction247Test-1002023661 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAaction247Test-1002023661-project Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: d413b421c9ea4464b683aa680deb5be7 Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAaction247Test-1002023661-project Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '18ca99e0-653a-4a74-aacb-0cf691ccfea0'} Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:52.371310 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] Returning 404 to user: Instance 18ca99e0-653a-4a74-aacb-0cf691ccfea0 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe1986ac-a509-4b25-90d4-565388617291 tempest-ServersAaction247Test-1002023661 tempest-ServersAaction247Test-1002023661-project] 10.222.0.25 "GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0" status: 404 len: 111 microversion: 2.47 time: 0.077388 Sep 23 03:54:52.379273 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1701/3489] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:54:52 2022] GET /compute/v2.1/servers/18ca99e0-653a-4a74-aacb-0cf691ccfea0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:54:52.422282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] Creating event network-vif-plugged:da175bb5-9b03-4342-9753-3117b80b497e for instance cd4b471f-72b5-4406-8d77-b732d7ec7414 on n-h2-858495-2 Sep 23 03:54:52.433128 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fc675984-f534-4114-abca-7eb69bdb288d req-5127b3ee-e549-4986-9ef3-67b20c72f454 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096315 Sep 23 03:54:52.436792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1789/3490] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:53.318757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:53.319969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:53.327795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:53.328573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:53.330520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:53.337778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:53.338538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:53.339349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:53.351799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:53.353139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:53.371691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:53.372196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:53.372642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:53.373399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:53.373878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:53.374316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:54.030055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:54.054291 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d085854b-4d39-43f4-b439-98b9a0ea3ba5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1318 microversion: 2.1 time: 0.739848 Sep 23 03:54:54.060914 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1702/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:53 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:54.141841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:54.156174 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7409f267-d719-4324-a213-603828f3b218 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 0.810674 Sep 23 03:54:54.157448 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1790/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:53 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:55.082524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:55.083222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:55.091707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:55.092577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:55.093276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:55.094284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:55.094991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:55.095684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:55.180843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:55.181705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:55.191276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:55.194994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:55.196203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:55.199840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:55.200527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:55.201828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:56.044209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:56.054943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54f45c99-5be7-4e60-b33d-e97cbd8ca15c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1508 microversion: 2.1 time: 0.976358 Sep 23 03:54:56.077784 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1703/3493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:55 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1508 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:56.087612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:56.089690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b314f4-c223-4f76-aebb-d556dfccf369", "name": "network-vif-plugged", "status": "completed", "tag": "ea5a3f6a-650c-41d3-a073-97ddd46d5e90"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:56.111632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53d7923d-24d5-4f11-87e0-ec744e70b217 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 0.934286 Sep 23 03:54:56.118614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:56.119530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:56.120212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:56.129715 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1791/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:55 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:56.155544 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] Creating event network-vif-plugged:ea5a3f6a-650c-41d3-a073-97ddd46d5e90 for instance 68b314f4-c223-4f76-aebb-d556dfccf369 on n-h1-858495-2 Sep 23 03:54:56.163456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:56.164697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:56.172767 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0fd248d7-72a7-4c3d-a59a-026779bc70e1 req-a719ffe5-e816-47bf-ba52-6803907b098b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093510 Sep 23 03:54:56.173935 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1704/3495] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:56.193972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:56.201005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:56.202432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:56.206555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:56.208054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:56.209496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:56.544494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1291657077", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:56.641247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:54:57.172185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:57.185133 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec5cf24d-ab7b-4b23-8722-57567619b574 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1508 microversion: 2.1 time: 1.053557 Sep 23 03:54:57.188151 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1792/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:56 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1508 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:57.208435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:57.209869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:57.220948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:57.227645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:57.228389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:57.229447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:57.230607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:57.232506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:57.689208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:57.701244 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17e4c6a3-c1b0-4ff4-abc7-6a05d4ffd5fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.511613 Sep 23 03:54:57.702170 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1793/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:57.863600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-055f4ec6-0a37-4898-aad3-015371fddf6c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Action: 'create', calling method: .version_select at 0x7f0c8b868430>, body: {"keypair": {"name": "tempest-keypair-1681869498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuqdqCxGpb0/n5wDTpGhbfNgjmQL66uqBhwlvwzh6zB/VDF8NS/2JWrGn0+PYn5wIcbeEbOEf47b8HwfJ4bXUxOcDbKvu2QfLQGwtCpNVf/PYwPVMNfSmy28e21INqj3g=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:57.895349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-055f4ec6-0a37-4898-aad3-015371fddf6c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Getting quotas for project 5fb615de6ca54c88b4533348273fa8b2. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:57.897391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:57.910083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-055f4ec6-0a37-4898-aad3-015371fddf6c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Getting quotas for user 91cf6cb958da4e3bb65435fdd189fc14 and project 5fb615de6ca54c88b4533348273fa8b2. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:57.969805 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-055f4ec6-0a37-4898-aad3-015371fddf6c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263103 Sep 23 03:54:57.978679 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1794/3498] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:54:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:54:57.988857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:57.990888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:58.004806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:54:58.005786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:54:58.006526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:54:58.007072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:54:58.007562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:54:58.010229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.011138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.011938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.013773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.014584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.018772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.030473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.031105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.031622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.034054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.037001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.037608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.107775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:54:58.127997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:54:58.181451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:54:58.184338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:54:58.295258 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1121fb19-214a-472a-9978-961dda22724e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.031012 Sep 23 03:54:58.306049 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1705/3499] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:54:58.311311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:54:58.313944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:58.348495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.349013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.349495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.356275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.356926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.357418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.571594 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a2c67e63-54b4-461f-8c3f-95dd80bfcde5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1080 microversion: 2.1 time: 0.269939 Sep 23 03:54:58.586507 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1706/3500] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:54:58 2022] PUT /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1080 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:58.594209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:58.595222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:58.604321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.605015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.605995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.607646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.608626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.609702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.647685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:58.651022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:54:58.662742 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6160569-44af-480c-bdee-2a69803fa79a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1308 microversion: 2.1 time: 0.680880 Sep 23 03:54:58.680340 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1795/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:57 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:58.701699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-94d5dd31-4568-43ed-8101-b8ec2b125a1c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:58.705933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-94d5dd31-4568-43ed-8101-b8ec2b125a1c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:58.856091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-94d5dd31-4568-43ed-8101-b8ec2b125a1c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:58.888237 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-94d5dd31-4568-43ed-8101-b8ec2b125a1c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1215 microversion: 2.1 time: 0.190391 Sep 23 03:54:58.906998 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1796/3502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:58 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:58.936860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:58.942546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:58.965581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:58.967219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.969987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.972490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.975064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:58.976819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:58.978184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:58.982645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3e2d58f-f39e-44c1-9e03-9d73e0e14ced tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.393677 Sep 23 03:54:58.983937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1707/3503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:58 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:59.015716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:59.017130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:59.042188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.042720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.049833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:59.051210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.051714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.052165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:59.393101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:59.410733 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f073485-1312-4ec6-9b25-3b62c45dd483 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1506 microversion: 2.1 time: 0.481707 Sep 23 03:54:59.413339 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1797/3504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:58 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:54:59.447255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:59.448354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:59.456795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.457760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.458575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:59.459939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.460827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.461644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:59.733205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:54:59.750918 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fca931b-c120-4b51-b38d-ddc2d6587748 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.738999 Sep 23 03:54:59.751651 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1708/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:59 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:54:59.758146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:54:59.759011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:54:59.780688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.781558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.782199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:54:59.783671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:54:59.784304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:54:59.789986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:00.898019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:00.909157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17aadc55-571f-42f7-a442-89239ee7300c tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1506 microversion: 2.1 time: 1.474093 Sep 23 03:55:00.912696 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1798/3506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:59 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1506 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:00.933094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1938284114"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:00.943747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:00.961742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:00.962710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:00.963413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:00.964668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:00.966690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:00.967410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:01.522489 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-182774ea-86d6-4bd5-b478-e91aacc9bd1b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.600191 Sep 23 03:55:01.523414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1799/3507] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:55:00 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 23 03:55:01.559682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:01.562187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:01.583301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:01.583816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:01.584256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:01.584972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:01.585457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:01.585889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:01.709733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:01.724483 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14e3e904-9c10-4ad1-b880-b60be5cb7c25 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1487 microversion: 2.1 time: 1.970654 Sep 23 03:55:01.726795 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1709/3508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:54:59 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1487 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:01.745263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:01.750603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:01.759347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:01.775703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd872cce-7926-4e25-93db-3138310d9205 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1273 microversion: 2.1 time: 0.249068 Sep 23 03:55:01.789381 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1800/3509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:01 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:01.789631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:01.922579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-525014872", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:01.939387 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-893c955b-6622-44a8-b69d-39ade23c7290 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "PUT /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1082 microversion: 2.1 time: 0.206101 Sep 23 03:55:01.962484 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1710/3510] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:55:01 2022] PUT /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1082 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:01.973336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:01.974682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:01.988043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:01.994284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:01.995077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:02.002674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:02.003290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:02.007519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:02.023366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:02.707691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:02.725700 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd5de65e-e5c8-406a-897b-c713021b18e5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1508 microversion: 2.1 time: 0.761651 Sep 23 03:55:02.752221 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1711/3511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:01 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1508 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:02.765635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:02.766272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:02.786124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:02.804164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:02.807064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:02.809495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:02.817805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:02.818168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:04.096439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:04.098063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:04.100759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:04.101576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:04.103889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:04.122281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:04.124362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:04.125077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:04.126279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:04.129858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:04.131141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:04.214707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:04.239910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:04.277797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:04.281471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:04.373871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2fcefc9-be3c-45eb-a7f3-2ac02896d07d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458624 Sep 23 03:55:04.376095 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1801/3512] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:55:04.397781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:04.398706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:04.405872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:04.406469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:04.406982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:04.408332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:04.408863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:04.409380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:04.842564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:04.858101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ec35d8a-f92e-4178-8ff5-878996f216ec tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1508 microversion: 2.1 time: 2.101213 Sep 23 03:55:04.883391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1712/3513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:02 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1508 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:04.890207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8793e1fa-7b32-4ae2-9b6e-2c959360b3f2"}], "security_groups": [{"name": "tempest-securitygroup--810091540"}], "key_name": "tempest-keypair-1681869498", "user_data": "}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:05.008397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:05.020295 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9941e921-a3d1-4e33-a01f-b04e10b16dcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 0.642678 Sep 23 03:55:05.022590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1802/3514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:04 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:05.029912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1131c86f-b5fa-4610-9c76-46e6513d9763 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:05.033224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1131c86f-b5fa-4610-9c76-46e6513d9763 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:05.247580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1131c86f-b5fa-4610-9c76-46e6513d9763 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:05.264429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1131c86f-b5fa-4610-9c76-46e6513d9763 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1208 microversion: 2.1 time: 0.238860 Sep 23 03:55:05.266117 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1803/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:05 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1208 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:05.279607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:05.280552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:05.290828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:05.291936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:05.293103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:05.294094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:05.295847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:05.296485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:05.327780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] validate_networks() for [('8793e1fa-7b32-4ae2-9b6e-2c959360b3f2', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:05.369820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:55:05.523747 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-91541863-edd2-4788-827d-e0c1a92c12ae tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 204 len: 0 microversion: 2.1 time: 0.254788 Sep 23 03:55:05.524768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1804/3516] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:05 2022] DELETE /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:55:05.590358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Action: 'create', calling method: .version_select at 0x7f0c93401c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:05.613513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Getting quotas for project 3a72956da6e4414b9f39319e345da432. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:05.619711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Getting quotas for user 348d969cb76f479c9fd182d3c5cc9c05 and project 3a72956da6e4414b9f39319e345da432. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:05.756128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Getting quotas for project 3a72956da6e4414b9f39319e345da432. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:05.782990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Getting quotas for user 348d969cb76f479c9fd182d3c5cc9c05 and project 3a72956da6e4414b9f39319e345da432. Resources: {'server_groups'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:05.824555 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba478404-f045-44b6-beae-b24a42e84cb1 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.298076 Sep 23 03:55:05.832134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1805/3517] 10.222.0.25 () {62 vars in 1214 bytes} [Fri Sep 23 03:55:05 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:55:05.838183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:05.839385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:05.851467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:05.852018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:05.852469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:05.859056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:05.859857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:05.860916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:05.924357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:55:06.031545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Instance is already in deleting state, ignoring this request Sep 23 03:55:06.032349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f71312bc-2c29-4b96-bcc2-259f9f19e9e1 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 204 len: 0 microversion: 2.1 time: 0.199135 Sep 23 03:55:06.033278 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1806/3518] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:05 2022] DELETE /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:55:06.038048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2e6cffd-077d-413e-9a7a-6ffa1bf5134e tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:06.066429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2e6cffd-077d-413e-9a7a-6ffa1bf5134e tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031910 Sep 23 03:55:06.067014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1807/3519] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 23 03:55:06 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:55:06.077926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-plugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:06.090818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:06.091294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:06.091816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:06.112794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] Creating event network-vif-plugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:55:06.119704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1412c7c6-5cbe-4e74-9210-628cd4c86e5b req-41506abf-1edf-40b7-8a26-975e32acd24a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045634 Sep 23 03:55:06.120949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1808/3520] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:06.130539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:06.133600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:06.145602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:06.146189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:06.146653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:06.147484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:06.148266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:06.148773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:06.959062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:06.969157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:06.970265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:06.970848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:06.971377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:06.972502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:06.975659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9ae2184-fafc-42d7-ae0c-2b48cbab6b13 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1514 microversion: 2.1 time: 0.852489 Sep 23 03:55:06.979555 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1809/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:06 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1514 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:06.990489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:06.991709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:07.002989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.008207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.009063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.010165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.010630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.012050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.012673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.014215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.017280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.018036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.024979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.025971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.087790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Getting quotas for project 5fb615de6ca54c88b4533348273fa8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:07.095517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Getting quotas for user 91cf6cb958da4e3bb65435fdd189fc14 and project 5fb615de6ca54c88b4533348273fa8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:07.119973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:07.123595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:07.205828 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2a783af-8bab-48b3-ac49-a3786a04daec tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.320971 Sep 23 03:55:07.207084 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1713/3522] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:55:07.222553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1b6c079-cd45-4e87-a286-c40dbceed720 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:07.276817 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1b6c079-cd45-4e87-a286-c40dbceed720 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21" status: 200 len: 235 microversion: 2.64 time: 0.066574 Sep 23 03:55:07.288459 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1714/3523] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Sep 23 03:55:07 2022] GET /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21 => generated 235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:55:07.326710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:07.336305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:07.378207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.378716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.379166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.381283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:07.382192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:07.382633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:07.498148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:07.514830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b37a57e-2b9d-4b85-b71a-42726916fcde tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 0.533170 Sep 23 03:55:07.515429 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1810/3524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:06 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:07.532086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae0978d1-04bc-4149-88d6-c045333b76a9 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:07.533444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ae0978d1-04bc-4149-88d6-c045333b76a9 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:07.622194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:07.640455 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb0e4308-39e8-4296-875c-6d38991b90b7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1266 microversion: 2.1 time: 0.350543 Sep 23 03:55:07.641402 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1715/3525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:07 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:07.647796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6683bfb7-dcb4-4787-80d7-878506c0f554 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:07.708779 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6683bfb7-dcb4-4787-80d7-878506c0f554 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21" status: 204 len: 0 microversion: 2.64 time: 0.065347 Sep 23 03:55:07.712333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1716/3526] 10.222.0.25 () {60 vars in 1307 bytes} [Fri Sep 23 03:55:07 2022] DELETE /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:55:07.728649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a9b376d-9e95-4eba-8b6b-848fc13eaa42 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:07.746913 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5a9b376d-9e95-4eba-8b6b-848fc13eaa42 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] HTTP exception thrown: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a9b376d-9e95-4eba-8b6b-848fc13eaa42 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Request method failure captured: Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21 HTTP/1.1 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4Zln7Pupcm0wOz8I16HcZgXyvkxhYaIsPDOooPFF6MD1jbf9vbXK4NGfmEHXYwZRZS8o6FTLPK4OrMztDTGcq1aqSeZqxxY09slVoUzQpZr2IsU01XpGuXhPZvuf8IyMiF4wIsGdsLVDitbsSu2Lb7_TI0Sqmf8uVL3xJl-RpbNuY Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.64 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 3a72956da6e4414b9f39319e345da432 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroup264TestJSON-606360407 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3a72956da6e4414b9f39319e345da432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3a72956da6e4414b9f39319e345da432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3a72956da6e4414b9f39319e345da432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3a72956da6e4414b9f39319e345da432"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroup264TestJSON-606360407 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 3a72956da6e4414b9f39319e345da432 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroup264TestJSON-606360407 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroup264TestJSON-606360407-project Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 348d969cb76f479c9fd182d3c5cc9c05 Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroup264TestJSON-606360407-project Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'ae3a681c-898e-44c6-beef-85af8150ca21'} Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:07.756765 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a9b376d-9e95-4eba-8b6b-848fc13eaa42 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] Returning 404 to user: Instance group ae3a681c-898e-44c6-beef-85af8150ca21 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a9b376d-9e95-4eba-8b6b-848fc13eaa42 tempest-ServerGroup264TestJSON-606360407 tempest-ServerGroup264TestJSON-606360407-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21" status: 404 len: 117 microversion: 2.64 time: 0.038428 Sep 23 03:55:07.765902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1717/3527] 10.222.0.25 () {60 vars in 1307 bytes} [Fri Sep 23 03:55:07 2022] DELETE /compute/v2.1/os-server-groups/ae3a681c-898e-44c6-beef-85af8150ca21 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:55:07.857649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ae0978d1-04bc-4149-88d6-c045333b76a9 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:07.867411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae0978d1-04bc-4149-88d6-c045333b76a9 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1226 microversion: 2.1 time: 0.350526 Sep 23 03:55:07.871131 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1811/3528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:07 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1226 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:08.006410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:08.007120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:08.020096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:08.023173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:08.026068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:08.027041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:08.031305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:08.032011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:08.539048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:08.539681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:08.552208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:08.552755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:08.557669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:08.558482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:08.558964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:08.563894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:09.643859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:09.655185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e175b1b-c900-4983-a5f7-9d70aef103e3 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1514 microversion: 2.1 time: 1.653198 Sep 23 03:55:09.661052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1718/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:08 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1514 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:09.678019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:09.681006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:09.696161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:09.696664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:09.699081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:09.702390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:09.702978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:09.703432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.133780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:10.143432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:10.160311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f238c14-2884-4ef8-b078-23f68a259d6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1266 microversion: 2.1 time: 0.496248 Sep 23 03:55:10.182991 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1719/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:09 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:10.198319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:10.201570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:10.221978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.224724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.233382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.234841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.236161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.236789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.555303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:10.570158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97d852a4-2ca7-468b-bb63-08c4fbc99f96 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1284 microversion: 2.1 time: 0.381843 Sep 23 03:55:10.571762 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1720/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:10 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1284 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:10.592874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b471f-72b5-4406-8d77-b732d7ec7414", "name": "network-vif-deleted", "tag": "da175bb5-9b03-4342-9753-3117b80b497e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:10.620417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.621178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.621837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.637607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] Creating event network-vif-deleted:da175bb5-9b03-4342-9753-3117b80b497e for instance cd4b471f-72b5-4406-8d77-b732d7ec7414 on n-h2-858495-2 Sep 23 03:55:10.643355 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-172c69db-102d-425b-a454-f3d79e77c07f req-7bf9d0f3-ce48-4bcc-8870-e37f24672642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066886 Sep 23 03:55:10.644190 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1721/3532] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:10.691375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:10.692206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:10.694370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:10.710582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:10.713501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.713947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.714396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.715428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.718164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.718781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.724877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51ce5044-33c5-41c9-840f-0152f88eed2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 2.188471 Sep 23 03:55:10.737379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1812/3533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:08 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:10.791816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:10.792770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:10.793467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:10.794100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lazy-loading 'fault' on Instance uuid cd4b471f-72b5-4406-8d77-b732d7ec7414 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:55:11.024140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb763b81c4da4dea80f92bf1de1d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46500f7bd44b4d9f9c02c3228ff55038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:11.037182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db009d42-9503-43cf-9f82-0b7e82bff954 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 200 len: 1308 microversion: 2.1 time: 0.350644 Sep 23 03:55:11.053736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1722/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:10 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:11.194218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:11.195222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:11.208179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.209077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.209808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.210781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.216967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.217716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.597956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:11.598578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:11.609393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.616100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:11.625000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa67f00d-c533-4da7-bdb7-15c3505bd8d7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.434525 Sep 23 03:55:11.628144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.628614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.629393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.629603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1813/3535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:11 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:11.629864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.630567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.755479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:11.757642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:11.770799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.771691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.772943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.778210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:11.779024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:11.779701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:11.812167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:12.288737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:12.309099 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6350ebdf-7903-40b7-bc54-a7b3d136d0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1284 microversion: 2.1 time: 0.709143 Sep 23 03:55:12.310089 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1723/3536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:11 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1284 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:12.315517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.322117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: cd4b471f-72b5-4406-8d77-b732d7ec7414] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.336983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.337830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.338464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.339387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.340041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.340704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.381493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] HTTP exception thrown: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Request method failure captured: Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 HTTP/1.1 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kew5AFxc9XuZ_VHrz9jf3cHPnM4BDD_gRioE3-KmFU7g16KCLkQlELgbF3dB1roSvNlEuwWu6_Ho0uHwxrUhlYbMMiwjLPOGBpF4xFxZuDh0BmcPDjOe3juZBOw0m_LSJu6QBnEJyVjd-uumuB_BPjuECODaaCIHE-ytl95V0S_g Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bb763b81c4da4dea80f92bf1de1d2d54 Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cd4b471f-72b5-4406-8d77-b732d7ec7414'} Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.383433 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. Sep 23 03:55:12.390617 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.392596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Returning 404 to user: Instance cd4b471f-72b5-4406-8d77-b732d7ec7414 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:12.393911 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ad45493-ed65-4f06-930e-c2b45e9c2385 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414" status: 404 len: 111 microversion: 2.1 time: 0.082683 Sep 23 03:55:12.394940 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1724/3537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:12 2022] GET /compute/v2.1/servers/cd4b471f-72b5-4406-8d77-b732d7ec7414 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:12.409036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.412581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.432313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.436528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.437687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.445571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.446111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.446569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.479243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] HTTP exception thrown: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Request method failure captured: Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 HTTP/1.1 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kew5AFxc9XuZ_VHrz9jf3cHPnM4BDD_gRioE3-KmFU7g16KCLkQlELgbF3dB1roSvNlEuwWu6_Ho0uHwxrUhlYbMMiwjLPOGBpF4xFxZuDh0BmcPDjOe3juZBOw0m_LSJu6QBnEJyVjd-uumuB_BPjuECODaaCIHE-ytl95V0S_g Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bb763b81c4da4dea80f92bf1de1d2d54 Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'b17df0aa-2a19-4428-9147-2477e5dc3691'} Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:12.481229 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.486886 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.506262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Returning 404 to user: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:12.507590 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89b57d7a-726b-444e-a32d-f2656602793f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 404 len: 111 microversion: 2.1 time: 0.105085 Sep 23 03:55:12.510580 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1725/3538] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:12 2022] DELETE /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:12.531305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.532884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: b17df0aa-2a19-4428-9147-2477e5dc3691] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.555632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.558023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.558822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.562274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.564327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.565069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.619755 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] HTTP exception thrown: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Request method failure captured: Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 HTTP/1.1 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kew5AFxc9XuZ_VHrz9jf3cHPnM4BDD_gRioE3-KmFU7g16KCLkQlELgbF3dB1roSvNlEuwWu6_Ho0uHwxrUhlYbMMiwjLPOGBpF4xFxZuDh0BmcPDjOe3juZBOw0m_LSJu6QBnEJyVjd-uumuB_BPjuECODaaCIHE-ytl95V0S_g Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bb763b81c4da4dea80f92bf1de1d2d54 Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'b17df0aa-2a19-4428-9147-2477e5dc3691'} Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.628450 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. Sep 23 03:55:12.634205 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.636724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Returning 404 to user: Instance b17df0aa-2a19-4428-9147-2477e5dc3691 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:12.637875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f9fe1ae-11a3-4df0-a7e5-adeb58475cf7 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691" status: 404 len: 111 microversion: 2.1 time: 0.124898 Sep 23 03:55:12.639216 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1726/3539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:12 2022] GET /compute/v2.1/servers/b17df0aa-2a19-4428-9147-2477e5dc3691 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:12.650922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.652556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.664807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.666278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.667630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.668552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.670635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.671713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.721317 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] HTTP exception thrown: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Request method failure captured: Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 HTTP/1.1 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS1kew5AFxc9XuZ_VHrz9jf3cHPnM4BDD_gRioE3-KmFU7g16KCLkQlELgbF3dB1roSvNlEuwWu6_Ho0uHwxrUhlYbMMiwjLPOGBpF4xFxZuDh0BmcPDjOe3juZBOw0m_LSJu6QBnEJyVjd-uumuB_BPjuECODaaCIHE-ytl95V0S_g Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: bb763b81c4da4dea80f92bf1de1d2d54 Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '24e7d614-1a2f-4299-8bbd-2ed5a4d89068'} Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:12.723947 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Returning 404 to user: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:12.728180 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dadd5188-11f9-458b-b795-69b67515924f tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 404 len: 111 microversion: 2.1 time: 0.080362 Sep 23 03:55:12.729063 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1727/3540] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:12 2022] DELETE /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:12.741859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.742904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.758058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.759392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.762633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.764164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.771422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.772665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.797932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:12.820196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-815259f6-8553-4d7c-962c-f41afaacaac7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 1.069291 Sep 23 03:55:12.836462 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1814/3541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:11 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:12.842533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:12.855895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] [instance: 24e7d614-1a2f-4299-8bbd-2ed5a4d89068] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:12.870802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:12.896073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.897289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.898158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.901305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.902119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.905383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.923780 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] HTTP exception thrown: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Request method failure captured: Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 HTTP/1.1 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS1kew5AFxc9XuZ_VHrz9jf3cHPnM4BDD_gRioE3-KmFU7g16KCLkQlELgbF3dB1roSvNlEuwWu6_Ho0uHwxrUhlYbMMiwjLPOGBpF4xFxZuDh0BmcPDjOe3juZBOw0m_LSJu6QBnEJyVjd-uumuB_BPjuECODaaCIHE-ytl95V0S_g Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46500f7bd44b4d9f9c02c3228ff55038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 46500f7bd44b4d9f9c02c3228ff55038 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1312591918 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: bb763b81c4da4dea80f92bf1de1d2d54 Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1312591918-project Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '24e7d614-1a2f-4299-8bbd-2ed5a4d89068'} Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:12.925491 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] Returning 404 to user: Instance 24e7d614-1a2f-4299-8bbd-2ed5a4d89068 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0218d422-8504-4483-a914-451c0e3142c5 tempest-ServerDiskConfigTestJSON-1312591918 tempest-ServerDiskConfigTestJSON-1312591918-project] 10.222.0.25 "GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068" status: 404 len: 111 microversion: 2.1 time: 0.102007 Sep 23 03:55:12.932194 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1815/3542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:12 2022] GET /compute/v2.1/servers/24e7d614-1a2f-4299-8bbd-2ed5a4d89068 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:12.932901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f85146-3106-49a6-a33d-8eafd3d758f4", "tag": "4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:12.944981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:12.945500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:12.946306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:12.967049 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] Creating event network-changed:4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42 for instance e8f85146-3106-49a6-a33d-8eafd3d758f4 on n-h2-858495-2 Sep 23 03:55:12.973336 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-de7e93bb-508b-4066-b108-2c92de665c30 req-57684c4b-65ab-4c06-8d38-f6cb265d1380 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044729 Sep 23 03:55:12.974780 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1816/3543] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:13.354480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:13.355241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:13.365189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:13.366493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:13.367155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:13.369632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:13.370355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:13.372102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:13.720608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:13.734316 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2a2f527-28cc-4c2e-afaa-b653dd0c30f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 1.004411 Sep 23 03:55:13.738259 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1728/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:12 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:13.804619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:13.814999 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9f53a9e-b64a-4c3c-881f-a53ee06ef6d3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.480136 Sep 23 03:55:13.815953 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1817/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:13 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:13.852293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:13.853005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:13.861121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:13.861809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:13.862277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:13.863114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:13.864487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:13.869826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.127245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:14.135671 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c9c07a7-f298-457c-88e8-ab79fb7cd5ba tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 0.287293 Sep 23 03:55:14.139987 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1729/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:13 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:14.179963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:14.180883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:14.189022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:14.195811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.196697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.197781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.198734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.199800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.200457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.239706 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07f1155e-3353-40af-905d-be5db321fc44 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/ips" status: 200 len: 148 microversion: 2.1 time: 0.064262 Sep 23 03:55:14.248664 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1818/3547] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:55:14 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/ips => generated 148 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:14.778504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:14.780677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:14.802776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.803653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.804378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.805334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.806028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.807489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.842090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:14.842844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:14.852709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.861716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.863390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:14.866008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:14.874178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:14.876795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:15.330381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:15.347951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:15.356404 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49b5e03f-61d6-4202-8b5e-4f0a92eda56c tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.518236 Sep 23 03:55:15.360535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c3202c9-6699-4360-8abb-9ee3644e165f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.586124 Sep 23 03:55:15.361063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1819/3548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:14 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:15.363153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1730/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:14 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:15.368178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:15.370352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:15.374910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daee3c1f-38c6-49ea-a0c3-3a631f8132bd", "tag": "8616d18a-9eb0-4560-b85c-aa8a77317efa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:15.394893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:15.397816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:15.398876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:15.400109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:15.401149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:15.401878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:15.405770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:15.406477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:15.407589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:15.420986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] Creating event network-changed:8616d18a-9eb0-4560-b85c-aa8a77317efa for instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd on n-h1-858495-2 Sep 23 03:55:15.429093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4a8b61a9-d296-4147-aa7c-3a423a94a2a0 req-4b4372df-7d21-4660-8e34-6ed77d65e059 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066541 Sep 23 03:55:15.430423 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1820/3550] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:15.627989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:15.637596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1945e55c-3be3-43e6-91b0-f420f3a1f5d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 0.273068 Sep 23 03:55:15.639494 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1731/3551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:15 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:16.384388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:16.385263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:16.387528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:16.388800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:16.410605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:16.411006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:16.411152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:16.411506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:16.411631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:16.411950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:16.412669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:16.413128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:16.413579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:16.413979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:16.415287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:16.415905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:17.072381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:17.114069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:17.222392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:17.234117 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c1501c6-c085-4419-a0a1-e4b06860cdf7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.850594 Sep 23 03:55:17.234713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1732/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:16 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:17.247580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:17.248796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:17.249463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:17.267933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:17.268565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:17.269010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:17.273265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:17.273792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:17.274239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:17.274386 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e246261b-8f96-4e70-bb8e-5d6ce5b77aa0 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.889287 Sep 23 03:55:17.293878 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1821/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:16 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:17.317480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b33a329-dd8b-4c44-83a2-eba2ef92ef93"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:17.324256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:17.343456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:17.345315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:17.347972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:17.350357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:17.350817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:17.351241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:17.863133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=24 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:17.934339 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-178b1802-252f-4f95-9caa-8c19d53b09b7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635931 Sep 23 03:55:17.935276 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1822/3554] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:55:17 2022] POST /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:17.962363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de", "tag": "cbf6fdec-e8d7-4d65-9c1c-d3f561754872"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:18.019764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:18.020288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:18.020734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:18.068568 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] Creating event network-changed:cbf6fdec-e8d7-4d65-9c1c-d3f561754872 for instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de on n-h1-858495-2 Sep 23 03:55:18.083257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0696e4db-a75f-43ef-90cc-3cf3d4228550 req-e33769dd-6f34-4722-8c99-f8a6a72825ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146365 Sep 23 03:55:18.090176 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1823/3555] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:18.258553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:18.259270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:18.274035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:18.278771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:18.279284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:18.283469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:18.287609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:18.293285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:18.294130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:18.319712 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97ed4764-7f3c-4311-b0de-603cccc415c8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 1.083285 Sep 23 03:55:18.346903 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1733/3556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:17 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:18.372173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:18.372825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:18.394652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:18.395198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:18.396638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:18.398235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:18.399042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:18.399640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:19.215669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:19.244286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0db86a75-21ce-462e-b645-fe6f66f7c38d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.990706 Sep 23 03:55:19.245888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1824/3557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:18 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:19.254588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:19.267601 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c096a33f-55b7-4849-acc3-92dab079b13a tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.918283 Sep 23 03:55:19.272522 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1734/3558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:18 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:19.354277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:19.355434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:19.380316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:19.381266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:19.385699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:19.388478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:19.389268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:19.392647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:20.274687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:20.275311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:20.294777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:20.295216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:20.295669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:20.301541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:20.302032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:20.302480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:20.771550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:20.781535 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6d1ac7d-6392-41fa-981e-ade728b2f29c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 1.433883 Sep 23 03:55:20.786980 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1825/3559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:19 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:20.794092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:20.796754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:20.821533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:20.822319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:20.822972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:20.823957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:20.824596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:20.828105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:20.867192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:20.886448 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd34890b-b655-4bc9-bae9-14eaec7cb73f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.617695 Sep 23 03:55:20.891588 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1735/3560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:20 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:21.231823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:21.246997 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c6d537f-f7f7-4761-85c6-cabe1e37aa26 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.458563 Sep 23 03:55:21.248115 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1826/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:20 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:21.367234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f85146-3106-49a6-a33d-8eafd3d758f4", "name": "network-vif-plugged", "status": "completed", "tag": "4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:21.416623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:21.417120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:21.422841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:21.518471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] Creating event network-vif-plugged:4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42 for instance e8f85146-3106-49a6-a33d-8eafd3d758f4 on n-h2-858495-2 Sep 23 03:55:21.536823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-82a05e9c-e203-4a65-836a-a537068ade85 req-9c61ab40-0aab-474c-8200-e736b332b8f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170763 Sep 23 03:55:21.540647 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1736/3562] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:21.818489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:21.820620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:21.843333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:21.845872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:21.846949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:21.851335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:21.852202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:21.853134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:21.915830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:21.916960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:21.932463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:21.936249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:21.940636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:21.944838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:21.945649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:21.946347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:22.650328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:22.660018 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f76a6fa3-2e32-4c3b-b6ef-b1a63bb344c3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.748843 Sep 23 03:55:22.666485 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1737/3563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:21 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:22.676617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:22.684476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:22.701080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:22.701893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:22.702126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:22.702856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:22.703777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:22.704397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:22.706157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:22.727119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aff48e3b-c4cb-4f8c-b30c-12f7828b76b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1315 microversion: 2.1 time: 0.917548 Sep 23 03:55:22.739797 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1827/3564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:21 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:23.127682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:23.160431 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-815e51b9-09a6-488c-8ad5-9dc7e44bdf65 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.488200 Sep 23 03:55:23.161157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1738/3565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:22 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:23.695279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:23.697302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:23.713730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:23.714516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:23.715136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:23.717754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:23.718611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:23.719785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:23.762799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:23.763525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:23.783282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:23.784610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:23.785375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:23.786915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:23.787639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:23.788328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.591131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:24.602047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5c0a7e8-84c2-4e01-9ede-f2e2abaa7194 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.910660 Sep 23 03:55:24.614401 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1828/3566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:23 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:24.615578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daee3c1f-38c6-49ea-a0c3-3a631f8132bd", "name": "network-vif-plugged", "status": "completed", "tag": "8616d18a-9eb0-4560-b85c-aa8a77317efa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:24.639501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:24.652524 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da591549-323e-4f75-9ca6-5fb4c1b64da6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1502 microversion: 2.1 time: 0.893270 Sep 23 03:55:24.657662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:24.663564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:24.665785 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1739/3567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:23 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1502 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:24.667845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.681208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:24.685963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:24.696515 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] Creating event network-vif-plugged:8616d18a-9eb0-4560-b85c-aa8a77317efa for instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd on n-h1-858495-2 Sep 23 03:55:24.702558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:24.708487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:24.709316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.710522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:24.711317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:24.712040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.716171 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d90954e8-25b0-4d52-86ff-19b1b737e4d8 req-2e96fe9a-1810-4b99-9496-fa55677210a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109470 Sep 23 03:55:24.717044 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1829/3568] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:24.724975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:24.732677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:24.733305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:24.743972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:24.747816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:24.748525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.749554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:24.751854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:24.752587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:24.869529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:55:25.148858 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9f1f626-5987-4dfa-83ed-25a219f91354 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 204 len: 0 microversion: 2.1 time: 0.428779 Sep 23 03:55:25.154935 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1830/3569] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:24 2022] DELETE /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:55:25.176096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:25.179446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:25.202318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:25.207280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:25.208056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:25.210206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:25.214098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:25.215336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:25.411720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:25.437283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec8aff83-32f9-443b-acfe-357fd1b234e2 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.758336 Sep 23 03:55:25.440314 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1740/3570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:24 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:25.629692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:25.631052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:25.665437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:25.666222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:25.666935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:25.670707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:25.671377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:25.672023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:25.978327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:25.986249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:25.996383 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c87b3982-b399-4f9a-8312-e60dbc318139 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1508 microversion: 2.1 time: 0.837433 Sep 23 03:55:25.997233 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1831/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:25 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1508 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:26.409900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:26.433078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13024b9c-a1b0-4b62-a8fd-cdb1a7adfc6f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1308 microversion: 2.1 time: 0.809664 Sep 23 03:55:26.435501 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1741/3572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:25 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1308 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:26.465828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:26.466454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:26.499639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:26.508176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:26.508683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:26.509488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:26.509976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:26.510414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:27.027535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:27.028159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:27.040178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:27.040834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:27.041544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:27.044570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:27.045170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:27.045664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:28.565579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:28.579667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c7accde-85f6-465e-920e-3a5642bbd91f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1508 microversion: 2.1 time: 1.555790 Sep 23 03:55:28.590798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1742/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:27 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1508 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:28.601651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:28.612948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:28.635556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:28.636331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:28.642310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:28.643420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:28.644098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:28.644549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:28.705162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:28.721777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5ba327d-b902-403c-b3b0-d2bc5ee9c56d tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 2.256947 Sep 23 03:55:28.722401 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1832/3574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:26 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:28.892959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de", "name": "network-vif-plugged", "status": "completed", "tag": "cbf6fdec-e8d7-4d65-9c1c-d3f561754872"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:28.946509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:28.948951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:28.949701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.000592 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] Creating event network-vif-plugged:cbf6fdec-e8d7-4d65-9c1c-d3f561754872 for instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de on n-h1-858495-2 Sep 23 03:55:29.018950 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-753e5007-e70f-4cc4-9d3d-8c944781ef54 req-8ac8e4bc-f2b9-435a-8f80-1c5fc07b6f74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130732 Sep 23 03:55:29.021956 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1833/3575] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:29.116497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f85146-3106-49a6-a33d-8eafd3d758f4", "name": "network-vif-deleted", "tag": "4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:29.146838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.147769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.148975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.168679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] Creating event network-vif-deleted:4bfc74ba-fb3d-4e93-8d2f-a0e9a68d9d42 for instance e8f85146-3106-49a6-a33d-8eafd3d758f4 on n-h2-858495-2 Sep 23 03:55:29.182918 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5f8c7bcc-34fe-47eb-bfef-d7bb7c0bd778 req-823846d6-e0b6-4f75-ad51-b70b3cb8cc26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082744 Sep 23 03:55:29.184742 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1834/3576] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:29.357843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:29.371548 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-512a1c99-c0a1-457f-908a-9416b7d5581b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1488 microversion: 2.1 time: 0.779199 Sep 23 03:55:29.375527 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1743/3577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:28 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1488 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:29.409895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:29.410541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:29.443986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.447688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.450140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.451420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.451902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.452335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.606146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:29.606873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:29.622334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.623118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.623626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.628217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.628947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.633115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.705819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.706323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.706982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.707614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'fault' on Instance uuid e8f85146-3106-49a6-a33d-8eafd3d758f4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:55:29.832501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:29.848406 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b96190bb-686a-45a0-a85c-c12db361ea9a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 200 len: 1305 microversion: 2.1 time: 0.246264 Sep 23 03:55:29.849701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1744/3578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:29 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 1305 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:29.879101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:29.880310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:29.920996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.922966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.929223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:29.933332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:29.934127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:29.934827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.180446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:30.231055 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de2f6ba2-835d-411b-bc52-8391fa8e2c26 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1487 microversion: 2.1 time: 0.828823 Sep 23 03:55:30.231667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1835/3579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:29 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1487 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:30.264018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:30.264993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:30.297465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.298546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.299249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.300441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.301023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.301623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.565952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:30.574856 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84b56e69-ff39-43ad-8adb-2529131884b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1351 microversion: 2.1 time: 0.723780 Sep 23 03:55:30.580438 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1745/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:29 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1351 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:30.873983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:30.875381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:30.888861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.889798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.890527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.891700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.892449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.893119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.928140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:30.937178 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 03:55:30.943474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ebe84dd-9a35-4724-baa5-ef707e51820e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1488 microversion: 2.1 time: 0.690345 Sep 23 03:55:30.944665 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1836/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:30 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1488 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 HTTP/1.1 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e8f85146-3106-49a6-a33d-8eafd3d758f4'} Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:30.947867 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 03:55:30.953671 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:55:30.955938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:30.957140 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6cf73d83-d944-4a81-8899-a1d1829327e7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 404 len: 111 microversion: 2.1 time: 0.087577 Sep 23 03:55:30.958441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1746/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:30 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:55:30.977969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:30.978958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:30.988944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.989794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.990422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:30.991331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:30.991946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:30.992724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:31.076265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:55:31.236511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1879760680", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:31.273237 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4b68cb4-ad7e-4c83-880c-36e71e8bc6b9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 204 len: 0 microversion: 2.1 time: 0.295980 Sep 23 03:55:31.275054 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1837/3583] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:30 2022] DELETE /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:55:31.285737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:31.286440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:31.312716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:31.313199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:31.313678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:31.314392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:31.314846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:31.315270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:31.419542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:31.864160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:31.872831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa53730c-9775-4456-ae0c-8b489434b3d3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1494 microversion: 2.1 time: 0.591777 Sep 23 03:55:31.877275 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1838/3584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:31 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1494 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:31.887149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:31.890032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:31.906650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:31.907468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:31.910475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:31.911103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:31.913583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:31.916848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:32.607436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:32.621208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d3fd44c-31b4-4a31-abbb-28912a793a41 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1541 microversion: 2.1 time: 0.742255 Sep 23 03:55:32.624018 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1839/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:31 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1541 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:32.646976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:32.647838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:32.655566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:32.656440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:32.657075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:32.658114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:32.658749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:32.660572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:32.960509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a33fb9e1-104e-4137-b0fb-95d62faf2815 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.316858 Sep 23 03:55:32.965099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1840/3586] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:55:32 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de/os-interface => generated 284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:32.976752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:32.986091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:33.002571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:33.007538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:33.008135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:33.008901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:33.009386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:33.010237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:33.108082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:33.109305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:33.110089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:33.110769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:33.111445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:33.138314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:33.139239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:33.140035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:33.141666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:33.142385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:33.143159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:33.172143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:33.180333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:33.205386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:33.208148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:33.286933 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52315dac-42ea-4a13-b641-86cc1fcd8ec3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.058295 Sep 23 03:55:33.289205 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1747/3587] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:55:33.325987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93158f28-c149-4b66-ad8f-8a0d6bcfa11d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:33.327193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93158f28-c149-4b66-ad8f-8a0d6bcfa11d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:33.493402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:33.517677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fab31aa4-8df3-41c5-a4b5-1cfe548f7c0d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1494 microversion: 2.1 time: 0.542574 Sep 23 03:55:33.535688 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1841/3588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:32 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1494 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:33.675437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93158f28-c149-4b66-ad8f-8a0d6bcfa11d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:33.689647 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93158f28-c149-4b66-ad8f-8a0d6bcfa11d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1215 microversion: 2.1 time: 0.380419 Sep 23 03:55:33.690811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1748/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:33 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:34.542368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:34.543154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:34.552669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:34.556174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:34.557882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:34.560189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:34.561230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:34.562927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:34.712799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:34.713962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:34.731177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:34.731814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:34.732542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:34.733547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:34.738077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:34.738611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.226431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:35.235714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17043284-079b-411a-82f1-c7b7dc4089c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1219 microversion: 2.1 time: 0.527272 Sep 23 03:55:35.236282 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1749/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:34 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1219 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:35.256644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:35.257608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:35.268059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:35.268562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:35.269012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.269766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:35.270241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:35.270683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.466951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:35.499135 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-597cfb7a-647e-4965-81a8-91f06f3ff468 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1494 microversion: 2.1 time: 0.948180 Sep 23 03:55:35.501109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1842/3591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:34 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1494 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:35.517627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:35.550585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-607f8e9d-7d24-4e36-809e-7aec18c614b0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: .version_select at 0x7f0c93358160>, body: {"keypair": {"name": "tempest-keypair-436125065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPQvsEHw4Svt6AShSOP29U8bLEeov1RjHuBHMcm57WlNQ8UX5D+CH4err6uFBj5e/4NMzYvt7HwXvKt5yo4WHaKxWSOI3F4hNW9p9I1Me8gtrpk2WKq/3W9r7hGurOjtw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:35.557953 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f8118ea-3a63-41f7-b0f1-3abbdb213213 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.310769 Sep 23 03:55:35.580515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1750/3592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:35 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:35.588442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-703531412"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:35.591610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:35.603522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:35.604601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:35.605955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.607408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:35.608106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:35.609528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-607f8e9d-7d24-4e36-809e-7aec18c614b0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:35.609756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.651154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-607f8e9d-7d24-4e36-809e-7aec18c614b0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:35.717061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-607f8e9d-7d24-4e36-809e-7aec18c614b0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.214407 Sep 23 03:55:35.726390 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1843/3593] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:55:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:35.881926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de", "tag": "cbf6fdec-e8d7-4d65-9c1c-d3f561754872"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:35.912929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:35.919808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:35.924181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:35.979765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] Creating event network-changed:cbf6fdec-e8d7-4d65-9c1c-d3f561754872 for instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de on n-h1-858495-2 Sep 23 03:55:35.994157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-227b022e-f04d-48bc-ba9b-ecc350bb396c req-9ed443b4-fe2c-4a83-9870-603ef89d5e6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119319 Sep 23 03:55:36.000012 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1844/3594] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:36.068399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daee3c1f-38c6-49ea-a0c3-3a631f8132bd", "name": "network-vif-deleted", "tag": "8616d18a-9eb0-4560-b85c-aa8a77317efa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:36.087781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.089948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.092137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.121480 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] Creating event network-vif-deleted:8616d18a-9eb0-4560-b85c-aa8a77317efa for instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd on n-h1-858495-2 Sep 23 03:55:36.133081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f4f1e730-7e5a-4d38-9caa-c99cdc183c72 req-17643e5a-1fdd-4af9-9c72-fe2a445e2207 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070664 Sep 23 03:55:36.134096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1845/3595] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:36.205671 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-910d3dc2-87eb-4a40-90ad-f4778c7ae016 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.622418 Sep 23 03:55:36.207152 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1751/3596] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:55:35 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Sep 23 03:55:36.260293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:36.261175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:36.277146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.277795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.278298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.279066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.279745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.280449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.463822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:36.484249 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c299d2e-a9f3-4503-9e81-13e99867e4d5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1273 microversion: 2.1 time: 0.228961 Sep 23 03:55:36.485625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1846/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:36 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:36.527198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:36.528210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:36.545316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.546133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.547318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.548723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.549443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.550061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.617243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:36.622696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:36.624009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:36.625232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lazy-loading 'fault' on Instance uuid daee3c1f-38c6-49ea-a0c3-3a631f8132bd {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:55:36.799660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:36.811450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2efe686a-e0cf-42e4-b0ca-589c1f428c94 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 200 len: 1298 microversion: 2.1 time: 0.288391 Sep 23 03:55:36.814717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1752/3598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:36 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:37.179367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-unplugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:37.204262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.205026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.205691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.235543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] Creating event network-vif-unplugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:55:37.250698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fc70d1ee-06c4-4b31-b376-e6ae70d3ae1e req-80dff8a1-b881-4a73-9426-fc00c181abce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077095 Sep 23 03:55:37.251619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1847/3599] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:37.513695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:37.514299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:37.521637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.530897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.531567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.532489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.533135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.533757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.658724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:37.670181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63327870-413b-4a0c-9732-869307df27b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1273 microversion: 2.1 time: 0.160288 Sep 23 03:55:37.671433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1753/3600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:37 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:37.840300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:37.841309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:37.854911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.855596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.859425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.861715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.862328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.871379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.901923 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd HTTP/1.1 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'daee3c1f-38c6-49ea-a0c3-3a631f8132bd'} Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:37.908693 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:55:37.914075 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:37.924800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:37.926316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fb35b58-af54-425d-bdff-2f6c11fbd4ed tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 404 len: 111 microversion: 2.1 time: 0.090578 Sep 23 03:55:37.927052 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1848/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:37 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:37.935309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:37.936101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:37.954929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.955439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.955888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.956608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:37.957273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:37.957732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:37.985368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:55:38.087622 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42cb378c-2c44-4803-b336-0df5b4fb65de tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 204 len: 0 microversion: 2.1 time: 0.155796 Sep 23 03:55:38.089686 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1754/3602] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:55:37 2022] DELETE /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:55:38.123155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:38.124284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:38.151071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:38.151971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:38.152739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:38.154828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:38.155501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:38.156179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:38.585750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:38.597954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42ea0d00-60da-4ca1-b88d-90238cb90f55 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1493 microversion: 2.1 time: 0.502382 Sep 23 03:55:38.599272 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1849/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:38 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1493 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:38.698463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:38.700990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:38.710512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:38.712014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:38.715314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:38.716301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:38.716938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:38.720791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:38.756539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:39.489961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:39.526478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7efc552a-2577-47c0-aaf4-705d74b11d7f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 0.832536 Sep 23 03:55:39.532134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1755/3604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:38 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:39.621825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:39.623094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:39.635368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:39.636556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:39.638141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:39.639987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:39.641168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:39.648026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:40.561523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:40.564920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:40.578423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:40.579126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:40.579934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:40.581191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:40.583240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:40.584786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:40.790471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:40.805495 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c918ca0-e5f6-4e46-a6c1-d31c346ae796 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1493 microversion: 2.1 time: 1.182551 Sep 23 03:55:40.807303 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1850/3605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:39 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1493 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:40.860400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-plugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:40.890653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:40.891137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:40.892534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:40.924091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] Creating event network-vif-plugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:55:40.940051 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7debc3fb-a2b2-468d-b3fb-0a3d7b4e7ae0 req-9a5e6619-4cbd-4681-b2b9-fdac1acd5831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082212 Sep 23 03:55:40.952644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1851/3606] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:41.350533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31157afe-3d76-47fd-9f14-5c5e00300c76", "tag": "ea5a6007-f3b1-4d86-ab55-b05788f4bce5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:41.385568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:41.386119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:41.392331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:41.427283 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] Creating event network-changed:ea5a6007-f3b1-4d86-ab55-b05788f4bce5 for instance 31157afe-3d76-47fd-9f14-5c5e00300c76 on n-h2-858495-2 Sep 23 03:55:41.445783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e04a0ee7-8b26-418c-8c31-ba217285104a req-012a4ae2-09d7-4844-bb10-b8dc25c4ed10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094038 Sep 23 03:55:41.447733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1852/3607] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:55:41.470995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1804477344", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477af16e-1c5b-4384-8f7b-9015a1b1fdab"}], "security_groups": [{"name": "tempest-securitygroup--1017732710"}], "key_name": "tempest-keypair-436125065", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:41.665494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:41.674217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b1cd1cf-4de8-41cd-8ff9-629ed6245512 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 1.122535 Sep 23 03:55:41.679520 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1756/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:40 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:41.757713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] validate_networks() for [('477af16e-1c5b-4384-8f7b-9015a1b1fdab', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:41.838639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:41.839643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:41.842566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:41.852990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:41.859777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:41.860503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:41.861487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:41.862205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:41.862895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:43.075932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:43.084709 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a59991fe-5b27-4c8e-8f57-499a64bfeecf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 200 len: 1493 microversion: 2.1 time: 1.250209 Sep 23 03:55:43.088931 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1757/3609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:41 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 1493 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:43.131206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:43.135246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:43.168830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:43.171558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:43.172337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:43.173017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:43.176973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:43.177723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:43.178366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:43.681366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:43.841287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:44.078902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:44.118751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3b3998f-789b-480f-b928-99372f91eca5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 0.993874 Sep 23 03:55:44.133464 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1758/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:43 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:44.148397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b314f4-c223-4f76-aebb-d556dfccf369", "name": "network-vif-deleted", "tag": "ea5a3f6a-650c-41d3-a073-97ddd46d5e90"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:44.203369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:44.206617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:44.207270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:44.235361 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] Creating event network-vif-deleted:ea5a3f6a-650c-41d3-a073-97ddd46d5e90 for instance 68b314f4-c223-4f76-aebb-d556dfccf369 on n-h1-858495-2 Sep 23 03:55:44.244833 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e81123a2-1076-45de-b2f4-23bbd76e7ca3 req-e21ae581-87ed-4c3e-83d2-cf5cf2e28d47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118078 Sep 23 03:55:44.246248 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1759/3611] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:44.556720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1524747308", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:44.580813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:44.581239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:44.581795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:44.582205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:44.582616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:44.624675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:44.626634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:44.630386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:44.631485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:44.632265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:44.633278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:44.690773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:44.717248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] validate_networks() for [('46d4637c-6257-49e1-8d2f-90d804562166', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:44.721593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:44.768184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:44.777271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:44.872886 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89ebb0d7-f6f0-4f55-bdf2-89870639ed65 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.406184 Sep 23 03:55:44.875083 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1853/3612] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:55:44.899249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:44.900274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:44.946826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:44.953768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:44.954937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:44.955843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:44.956472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:44.957082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:44.960583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:45.021862 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 HTTP/1.1 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '68b314f4-c223-4f76-aebb-d556dfccf369'} Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:55:45.025002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:55:45.030394 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:55:45.035401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:55:45.037982 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfbdf291-b615-4d0a-8f96-49e529fe3524 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 404 len: 111 microversion: 2.1 time: 0.153212 Sep 23 03:55:45.041578 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1854/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:44 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:55:45.050250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f48dfcb1-0ace-49fe-88fa-4c285eccfc6b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:45.053321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f48dfcb1-0ace-49fe-88fa-4c285eccfc6b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:45.402087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f48dfcb1-0ace-49fe-88fa-4c285eccfc6b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:45.412184 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f48dfcb1-0ace-49fe-88fa-4c285eccfc6b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1241 microversion: 2.1 time: 0.367475 Sep 23 03:55:45.412792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1855/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:45 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1241 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:45.426335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:45.429774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:45.455549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:45.456209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:45.458288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:45.461546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:45.462764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:45.465545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:45.950602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:45.951756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:45.952810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:45.953627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:45.954333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:45.979153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:45.979655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:45.980108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:45.980848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:45.981311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:45.981771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:46.067385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Getting quotas for project 6f20556a60e946f5bffafdbac4b76964. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:46.081196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Getting quotas for user 8f85b0d0ad0044fbb1189575d448dd47 and project 6f20556a60e946f5bffafdbac4b76964. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:46.118391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:46.128085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:46.173939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:46.189441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc23ea3a-111a-4c13-ac52-8ff61c49c784 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 0.774188 Sep 23 03:55:46.190060 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1856/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:45 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:46.204268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-468183820", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:46.282425 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71ce28f8-8b15-4343-ba0f-5e09627ac1a5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.034668 Sep 23 03:55:46.290893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1760/3616] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:55:46.302375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad541f5d-c934-4c7f-8d94-569746bc3e39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:46.304768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad541f5d-c934-4c7f-8d94-569746bc3e39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:46.416406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:46.962568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad541f5d-c934-4c7f-8d94-569746bc3e39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:46.972116 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad541f5d-c934-4c7f-8d94-569746bc3e39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1214 microversion: 2.1 time: 0.678871 Sep 23 03:55:46.972720 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1761/3617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:46 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1214 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:47.004004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:47.005296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:47.020474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:47.022098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:47.024145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:47.025718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:47.027493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:47.028284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:47.649243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:47.662008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56c8e215-72e2-4fe7-9ff7-b24c9c3e7e18 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1293 microversion: 2.1 time: 0.667524 Sep 23 03:55:47.673615 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1762/3618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:46 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1293 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:47.681139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:47.692716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:47.713057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:47.726178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:47.726649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:47.727413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:47.727879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:47.728318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.178695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:49.191752 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-defa600e-e37b-43f2-8b89-5752f2ee4715 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 1.519052 Sep 23 03:55:49.217855 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1763/3619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:47 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:49.226932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:49.228671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:49.247258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.248485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.249707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.250611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.251244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.254026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.535411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:49.541378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:49.541834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:49.551467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:49.552220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:49.552814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:49.569535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-833af4f7-376c-4fe3-a5c1-b64ec23d6ff3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1272 microversion: 2.1 time: 0.350134 Sep 23 03:55:49.572363 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1764/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:49 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:49.576129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.579878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:49.581961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.590028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.591267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.591919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.593601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:49.594562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.618119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.625340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.626123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.627067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:49.631191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:49.631855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:49.660702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:49.688508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:49.734114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:49.739561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:49.847576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-816c6f0d-7aef-4cd7-8cfe-5aef718257e0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.656246 Sep 23 03:55:49.848568 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1857/3621] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:55:49.860571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cafeef78-cbfa-444f-8bd7-ea757d1bbe48 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:49.861562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cafeef78-cbfa-444f-8bd7-ea757d1bbe48 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:49.882823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:49.892038 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2330e7f7-8fb6-4d6c-9cad-bbb557d97eae tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1299 microversion: 2.1 time: 0.318385 Sep 23 03:55:49.900481 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1765/3622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:49 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1299 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:50.227065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:50.227805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:50.247888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.249520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.250286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:50.251284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.257281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.258096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:50.402840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cafeef78-cbfa-444f-8bd7-ea757d1bbe48 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:50.431914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cafeef78-cbfa-444f-8bd7-ea757d1bbe48 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1208 microversion: 2.1 time: 0.572396 Sep 23 03:55:50.434814 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1858/3623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:49 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1208 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:50.597188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:50.598662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:50.611786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.612406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.612973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:50.613906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.623136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.626025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:50.911203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:50.920383 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38fe0290-69da-42c6-b54c-aa743a40f07d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1272 microversion: 2.1 time: 0.326981 Sep 23 03:55:50.923068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1859/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:50 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:50.931822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:50.957250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:50.984579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.988819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.989644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:50.994830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:50.995730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:50.999641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:51.279657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:51.292435 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b00d5043-2cae-431d-acb2-9df08e9d8297 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1299 microversion: 2.1 time: 0.364310 Sep 23 03:55:51.293703 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1860/3625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:50 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1299 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:51.439693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:51.448420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbdc3f5c-bf9b-4b9f-80b3-2b3733f7768f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 1.225778 Sep 23 03:55:51.471036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:51.475205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:51.480357 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1766/3626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:50 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:51.483763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:51.490037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:51.490797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:51.491779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:51.492487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:51.493173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:51.639332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:51.658138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20aa96e7-7359-4115-b40a-73bb736bbf7a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1204 microversion: 2.1 time: 0.202940 Sep 23 03:55:51.658866 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1861/3627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:51 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1204 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:51.948952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:51.949934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:51.963171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:51.966468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:51.966468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:51.970516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:51.972705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:51.973508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:52.319093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:52.319884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:52.332105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:52.336403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:52.336937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:52.339852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:52.340341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:52.340781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:52.876296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:52.885908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ee4a280-b91e-4f8a-87aa-4a179a9cf59b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 0.571024 Sep 23 03:55:52.897873 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1862/3628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:52 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:53.127187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-365831657", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "99d28534-6fc5-44d8-a524-446c6308131e"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:53.271790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:53.283173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] validate_networks() for [('99d28534-6fc5-44d8-a524-446c6308131e', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:55:53.289974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c977d02-6c54-4ea6-965e-625fe2d76085 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 1.345934 Sep 23 03:55:53.290998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1767/3629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:51 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:53.307066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:53.307703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:53.336039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:53.339162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:53.339804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:53.342716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:53.344713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:53.347604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:54.966245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:54.975933 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20c6f0e3-0bc9-4c00-9461-1fe9fffcbb7b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 1.683872 Sep 23 03:55:54.976529 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1768/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:53 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:54.990529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:54.991603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:55.002023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.002830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.003437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.004690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.005315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.005939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.236422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:55.253117 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9edbdfd1-0c16-4f9e-9176-5c6ff5fd23f2 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1266 microversion: 2.1 time: 0.267217 Sep 23 03:55:55.255016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1769/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:54 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:55.260552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31157afe-3d76-47fd-9f14-5c5e00300c76", "name": "network-vif-plugged", "status": "completed", "tag": "ea5a6007-f3b1-4d86-ab55-b05788f4bce5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:55.271864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.272832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.273502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.288751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] Creating event network-vif-plugged:ea5a6007-f3b1-4d86-ab55-b05788f4bce5 for instance 31157afe-3d76-47fd-9f14-5c5e00300c76 on n-h2-858495-2 Sep 23 03:55:55.298967 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-59d0c1dd-b514-453c-a215-79485e98ec54 req-188d1d56-df36-48d3-bd78-627c7c8e0895 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041963 Sep 23 03:55:55.301034 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1770/3632] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:55.307178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:55.308411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:55.310780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:55:55.311844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:55:55.312237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:55:55.312647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:55:55.313254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:55:55.316513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.317199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.317848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.318727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.319354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.319952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.325862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.326667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.327140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.328103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.328749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.329193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.365707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Getting quotas for project c542205803d34c65b2610f91185b9630. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:55:55.373439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Getting quotas for user cb0400b3435d4a0cb5c6806bb55ec582 and project c542205803d34c65b2610f91185b9630. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:55:55.399746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:55:55.406279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:55:55.519692 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6788058-e627-4d40-898b-ad0e96cc278b tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.620575 Sep 23 03:55:55.521754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1863/3633] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:55:55.532827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5", "tag": "b0860e42-7cae-4e3e-b5e3-06d6e87acbd4"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:55.554918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.557339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.558080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.579532 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] Creating event network-changed:b0860e42-7cae-4e3e-b5e3-06d6e87acbd4 for instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 on n-h1-858495-2 Sep 23 03:55:55.586630 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1278fa4f-7ffd-41c5-b835-5aee1ee17557 req-df108508-79eb-421b-b3c8-b93321c17cfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062805 Sep 23 03:55:55.595533 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1864/3634] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:55.601995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:55.603409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:55.616083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.616996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.618396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.620382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:55.622571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:55.623582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:55.877381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:55.903870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ced8a7e-3de7-4e2b-981b-04f082dad621 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 0.600530 Sep 23 03:55:55.905711 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1771/3635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:55 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:55.926262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cabe5798-7225-4e66-a65e-1405ab3a31b9 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:55.927574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cabe5798-7225-4e66-a65e-1405ab3a31b9 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:56.024182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:56.090283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cabe5798-7225-4e66-a65e-1405ab3a31b9 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:56.098077 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cabe5798-7225-4e66-a65e-1405ab3a31b9 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1216 microversion: 2.1 time: 0.190062 Sep 23 03:55:56.098663 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1772/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:55 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:56.114084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:56.114964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:56.138436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.145092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.153265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:56.154899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.155555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.156360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:56.438269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:56.450226 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58968ca5-f4bb-40c8-8c0e-b53ad78758e8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 0.852872 Sep 23 03:55:56.450862 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1865/3637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:55 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:56.474766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:56.482168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:56.495326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.501658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.502479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:56.504392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.505050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.505768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:56.683288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:56.708732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-35ff8701-3d29-47bb-9287-a1cd5d6fc623 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1266 microversion: 2.1 time: 0.237725 Sep 23 03:55:56.710509 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1866/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:56 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:56.775377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:56.791524 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c0477b1-7afe-469e-abd9-d87a24a8b53a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1315 microversion: 2.1 time: 0.686824 Sep 23 03:55:56.792753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1773/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:56 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:56.929125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:56.930083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:56.937262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.944362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.945118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:56.946305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:56.947135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:56.947736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.127277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:57.127995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:57.147975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.148489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.148940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.155281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.155792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.156251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.299568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:57.309198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-754813e5-e213-415c-90f3-96f442d45d71 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1268 microversion: 2.1 time: 0.186703 Sep 23 03:55:57.325802 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1774/3640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:57 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:55:57.461920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:57.476628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38de60a9-813d-4c82-b7aa-7cacb0791fd1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 0.548445 Sep 23 03:55:57.477436 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1867/3641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:56 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:57.477653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:57.478539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:57.491595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.492366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.492978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.494120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.494773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.495371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.738446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:57.740273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:57.760304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.772804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.773833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.774870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.775437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.776088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.878712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:57.888071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ee97f201-4026-4bb6-ad12-3b0de2380e27 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 0.414351 Sep 23 03:55:57.909937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1775/3642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:57 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:57.915217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:57.916062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:57.923797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.924539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.925165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.926066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:57.926698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:57.927296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:57.932182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:55:59.022207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:59.035461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d636830-fd1f-4767-b80b-28c594405f28 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 1.302143 Sep 23 03:55:59.036828 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1868/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:57 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:59.052980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:59.053928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:59.061619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.063592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.064842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.070201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.070926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.071528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.082013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:59.090128 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f70bb98-b589-4950-ba7f-9f3c3739eb0d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1502 microversion: 2.1 time: 1.178699 Sep 23 03:55:59.096504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1776/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:57 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1502 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:59.103658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8d5cd8-9873-49e6-af27-20b2bffcef76", "tag": "6a023019-e2a7-4bf5-b71c-f6d474657436"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:55:59.166038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.177317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.178191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.223098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] Creating event network-changed:6a023019-e2a7-4bf5-b71c-f6d474657436 for instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 on n-h1-858495-2 Sep 23 03:55:59.241035 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a1ec1ba6-bb07-467a-bb7f-cd4f16422dfa req-4d913d38-ccc2-4680-9c33-b8b3c7cc5279 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142578 Sep 23 03:55:59.250370 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1777/3645] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:55:59.257950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:59.266277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:59.285131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.293114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.294023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.298323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.299092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.301521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.755159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:55:59.771264 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b42f7160-e9d3-4860-bf20-d1206209485a tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1274 microversion: 2.1 time: 0.732995 Sep 23 03:55:59.773335 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1869/3646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:59 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1274 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:55:59.801001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:55:59.801001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:55:59.835043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.835603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.836052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:55:59.838974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:55:59.839463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:55:59.839895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:00.355520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:00.363747 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-090330ea-782f-4483-be02-1fc6e49912ab tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 1.111452 Sep 23 03:56:00.368734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1778/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:59 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:00.374292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:00.374917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:00.397092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:00.397629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:00.398077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:00.398797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:00.399263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:00.399697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:00.983271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:01.017859 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a21c850-9a21-4339-bdb1-3f14981fa00f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 1.240398 Sep 23 03:56:01.020134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1870/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:55:59 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:01.043449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:01.053436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:01.067051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:01.075143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:01.078748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:01.079302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:01.079630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00958857-017e-46c3-95c9-4fcf4b5d4c51 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.707917 Sep 23 03:56:01.081269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:01.082898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:01.083639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:01.097944 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1779/3649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:00 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:01.206088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:01.231147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-80307f93-ad43-4f09-8c4e-97f15ff1cf25 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1274 microversion: 2.1 time: 0.209365 Sep 23 03:56:01.232392 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1871/3650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:01 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:01.395029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:01.396528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:01.406321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:01.413247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:01.415874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:01.416895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:01.418829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:01.430088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:01.765890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:01.774442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3d2530a-2940-4033-95ff-510073399b90 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 0.383210 Sep 23 03:56:01.781997 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1780/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:01 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:01.902674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "957b7f2f-31b4-4baa-8077-00a5beaeef47", "tag": "4b2d79e3-c490-4db8-9282-4361af7b52a3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:01.929696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:01.932739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:01.933196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:01.980064 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] Creating event network-changed:4b2d79e3-c490-4db8-9282-4361af7b52a3 for instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 on n-h2-858495-2 Sep 23 03:56:02.004838 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e5e3306d-01de-451e-a7ad-09204818d6dd req-716494cd-9fc0-44be-b539-afd34c46cdc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102043 Sep 23 03:56:02.007654 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1872/3652] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:02.048939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:02.049612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:02.059892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.060312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.060808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.064531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.065025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.065513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.107070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:02.107814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:02.134084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.136358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.139317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.143818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.147738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.152275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.568203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:02.586732 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24a9290f-d1a9-455c-afa2-e26a040b130b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 0.543462 Sep 23 03:56:02.592007 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1781/3653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:02 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:02.604568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58d49f92-58b3-4560-8871-26a0ac8bb78b"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:02.612270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:02.627891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.632512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.633211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.639309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.640376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.641327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.657698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:02.667802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c76095d-70d9-4b43-9ed3-e323f1857ec9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.566346 Sep 23 03:56:02.668400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1873/3654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:02 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:02.688939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:02.693458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:02.700916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.701753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.702364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:02.703260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:02.703886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:02.704483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:03.137238 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8683873-d2f6-42ed-8f37-56294e72dd24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543191 Sep 23 03:56:03.137921 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1782/3655] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:56:02 2022] POST /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:03.170224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5", "name": "network-vif-plugged", "status": "completed", "tag": "b0860e42-7cae-4e3e-b5e3-06d6e87acbd4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:03.207633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:03.218059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:03.223933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:03.265240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] Creating event network-vif-plugged:b0860e42-7cae-4e3e-b5e3-06d6e87acbd4 for instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 on n-h1-858495-2 Sep 23 03:56:03.276874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-faa5e3bc-39a1-49e9-b326-bcccec7c36a1 req-20a58d1a-582f-44a1-a209-534ff7fbd585 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136778 Sep 23 03:56:03.277838 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1783/3656] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:03.283620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:03.297170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:03.303754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:03.304248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:03.313910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:03.314691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:03.315174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:03.316048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:04.819434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:04.825115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:04.840972 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7268be58-1ff6-474e-b079-72e5ec4d3c11 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 1.559330 Sep 23 03:56:04.844301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e15a274b-3908-4501-9c82-1829af72feef tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 2.161710 Sep 23 03:56:04.844891 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1874/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:02 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:04.849825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:04.850624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:04.861620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:04.864126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:04.864806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:04.865800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:04.868275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:04.869210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:04.872172 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1784/3658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:03 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:04.886762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:04.890182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:04.913111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:04.919584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:04.920188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:04.926254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:04.926882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:04.927424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:05.341190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:05.388200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=26 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:05.408409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:05.422704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28ead02c-be2b-4a4b-a734-d320e27936d5 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1314 microversion: 2.1 time: 0.570379 Sep 23 03:56:05.423615 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1875/3659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:04 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:05.690100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:05.710101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-afbffd0b-b21d-41c4-8a7b-aa271a85d9ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.835397 Sep 23 03:56:05.710619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1785/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:04 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:05.869804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:05.870621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:05.872486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:05.873982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:05.877334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:05.894008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:05.894539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:05.895302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:05.895774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:05.896208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:05.896964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:05.897128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:05.897763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:05.898728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:05.899471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:05.900140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:05.906721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:06.099172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:06.409534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:06.418317 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b098f257-6654-4ef1-9c44-eb399294f5de tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.552842 Sep 23 03:56:06.419493 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1876/3661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:05 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:06.450234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:06.451158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:06.464199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:06.465118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:06.465843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:06.466924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:06.467615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:06.468287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:06.678578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:06.688631 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0098bf5f-9e35-4dd5-b3af-1ca4efb3a032 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 0.821233 Sep 23 03:56:06.694152 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1786/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:05 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:06.739718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:06.740512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:06.749271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:06.750443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:06.751073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:06.754455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:06.755111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:06.758270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:07.441447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:07.450567 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ba4c0c5-2025-4a0c-b927-3df7d33d8439 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1501 microversion: 2.1 time: 1.004108 Sep 23 03:56:07.468083 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1877/3663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:06 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1501 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:07.487045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d5cd8-9873-49e6-af27-20b2bffcef76", "name": "network-vif-plugged", "status": "completed", "tag": "6a023019-e2a7-4bf5-b71c-f6d474657436"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:07.528648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:07.529135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:07.529607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:07.567217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] Creating event network-vif-plugged:6a023019-e2a7-4bf5-b71c-f6d474657436 for instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 on n-h1-858495-2 Sep 23 03:56:07.574221 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-604b039d-9b73-42e1-bfd6-9846c0d333eb req-6a61d0ac-62dc-4806-a92f-aa203b46596c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104209 Sep 23 03:56:07.575576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1878/3664] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:07.583534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:07.597084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:07.606318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:07.607320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:07.607938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:07.610292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:07.611202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:07.611642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:08.379129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:08.393530 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-25c526d6-6111-473c-9d5d-344acf23768d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.812602 Sep 23 03:56:08.396338 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1879/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:07 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:08.412178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:08.416716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:08.432554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:08.435109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:08.438823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:08.439464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:08.440236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:08.443009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:08.446566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:08.494361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lazy-loading 'flavor' on Instance uuid 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:56:08.657659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d01cfdca-d9ea-4dcc-97fa-0f32681f1b8c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "POST /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5/action" status: 200 len: 32 microversion: 2.1 time: 0.259676 Sep 23 03:56:08.659185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1880/3666] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:08 2022] POST /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:56:08.670216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:08.671292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:08.680033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:08.680905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:08.681638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:08.683000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:08.683757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:08.684422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:09.011824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:09.024081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cfb401e1-32f9-49f6-9762-ad48da6378dc tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 2.288498 Sep 23 03:56:09.038415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1787/3667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:06 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:09.052746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b", "tag": "cf714bb6-00a9-483f-b89e-22d0519c5ef1"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:09.082019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:09.082869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:09.084426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:09.141637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] Creating event network-changed:cf714bb6-00a9-483f-b89e-22d0519c5ef1 for instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b on n-h2-858495-2 Sep 23 03:56:09.141637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c5012c2a-cba7-4abe-8526-2e5958213b82 req-bdd0a58d-3311-41d7-a251-c5fd273f58ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073821 Sep 23 03:56:09.141637 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1788/3668] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:09.141637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:09.141637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:09.146758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:09.147264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:09.147711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:09.155540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:09.156923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:09.161976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.108356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:10.124492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2894ccd2-f6ac-41f8-8255-9edfe170dbb8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1367 microversion: 2.1 time: 1.463332 Sep 23 03:56:10.125241 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1881/3669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:08 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1367 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:10.137897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:10.139621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:10.147200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.148558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.149456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.150957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.152667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.153272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.299555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:10.309336 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bfa03206-af8e-44e6-9aca-0cac1b3ac092 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 1.193249 Sep 23 03:56:10.331140 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1789/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:09 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:10.337864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:10.338830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:10.347497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.348327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.349070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.350260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.350924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.351618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.567133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:10.577385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-960ba597-a514-4864-8974-a3ad6ab6eece tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.449531 Sep 23 03:56:10.578294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1882/3671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:10 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:10.600793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:10.601657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:10.622090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.622795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.623455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.624703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:10.625391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:10.626008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:10.799192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:10.829959 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbc831ef-35c6-4c1c-a6bb-611f79dfc17b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.497296 Sep 23 03:56:10.831022 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1790/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:10 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:10.958847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:10.968250 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-acb200c4-38bc-45ee-84c5-7d60864b547c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.376387 Sep 23 03:56:10.969417 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1883/3673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:10 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:10.992351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1167994671"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:10.995083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:11.004287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.004878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.005407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.006338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.007154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.007794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.154142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:11.157018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:11.167685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.168298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.168747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.171815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.172002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.174975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.291692 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79bcf1a0-4ac9-45a1-a7e4-0424c128c16c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.302342 Sep 23 03:56:11.296829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1791/3674] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:10 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 23 03:56:11.305045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "957b7f2f-31b4-4baa-8077-00a5beaeef47", "name": "network-vif-plugged", "status": "completed", "tag": "4b2d79e3-c490-4db8-9282-4361af7b52a3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:11.318097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.318851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.319419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.336497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:11.366248 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] Creating event network-vif-plugged:4b2d79e3-c490-4db8-9282-4361af7b52a3 for instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 on n-h2-858495-2 Sep 23 03:56:11.371702 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6b94b65f-b64f-4975-9681-6ea377fcb080 req-de9a052d-0069-4c3c-8dd4-4ded11dcba67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071518 Sep 23 03:56:11.372749 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1792/3675] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:11.378705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:11.381924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:11.392990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.393784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.394576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.396532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.398244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.399845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.606427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:11.618101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3f1f407-bc1b-48f6-8cbc-59500c363545 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1555 microversion: 2.1 time: 0.471675 Sep 23 03:56:11.621203 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1884/3676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:11 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1555 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:11.637331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:11.637988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:11.668432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:11.670105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.670615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.674258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.676580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.679216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.679813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.684133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c85b542-9554-4a23-adb5-9726f92e9a4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.310015 Sep 23 03:56:11.685758 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1793/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:11 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:11.708892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:11.709848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:11.717118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.717872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.718484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.719999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:11.720701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:11.721303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:11.999874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:12.012436 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-466f0096-f97b-4f43-921a-ef064bbf635d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.389840 Sep 23 03:56:12.014425 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1885/3678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:11 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:12.022014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:12.022865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:12.031964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.032702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:12.033009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.033760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:12.034617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.035492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.036063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:12.042318 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2db572af-b77b-405c-85dd-0245d03871df tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.355464 Sep 23 03:56:12.057840 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1794/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:11 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:12.064908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:12.065964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:12.071874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:12.073309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.073832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.074276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:12.074984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.075444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.076437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:12.143257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2211263-4d7c-42a7-b2da-90d8e48b33f7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127286 Sep 23 03:56:12.145068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1886/3680] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:56:12 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:12.351033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:12.361224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-145cda6d-4ba8-45ec-b3be-be7e57287b52 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.302143 Sep 23 03:56:12.362072 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1795/3681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:12 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:12.710259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:12.710949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:12.723665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.724536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.725256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:12.728992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:12.729755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:12.730203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.036271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:13.037184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:13.045551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.046404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.047053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.047978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.048720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.049267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.069378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:13.089090 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86717316-f19e-4f53-83f6-73c4d27912fa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.382413 Sep 23 03:56:13.090590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1887/3682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:12 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:13.099307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:13.100227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:13.110673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.111918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.112759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.113719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.114395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.115115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.861099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:13.870122 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7adda21c-0e5e-41b9-93cc-f244f8f13482 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.837787 Sep 23 03:56:13.870938 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1796/3683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:13 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:13.876433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:13.877051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:13.884163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.885523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.886191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.887146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.887845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.888327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.952019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:13.962952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07dbf797-d2db-4ffa-b581-17b9f0173b69 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.870471 Sep 23 03:56:13.963554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1888/3684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:13 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:13.969493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-unplugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:13.982454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:13.983027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:13.983525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:13.996271 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] Creating event network-vif-unplugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:56:14.002908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-18de1245-4140-4dae-8381-3b6ec3086b34 req-f865c143-2f3c-4169-a819-51fc8098e63e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037692 Sep 23 03:56:14.004000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1889/3685] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:14.011002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8d5cd8-9873-49e6-af27-20b2bffcef76", "tag": "6a023019-e2a7-4bf5-b71c-f6d474657436"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:14.021384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.022148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.022688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.035157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] Creating event network-changed:6a023019-e2a7-4bf5-b71c-f6d474657436 for instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 on n-h1-858495-2 Sep 23 03:56:14.040661 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8780cacb-0394-4236-94ec-8f24369af44d req-46b00849-6ca3-477c-94d8-3bbafdd24183 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035023 Sep 23 03:56:14.041283 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1890/3686] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:14.114171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:14.115103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:14.123515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.124304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.124938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.127185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.127895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.128558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.147501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:14.158344 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6c7803f-bd9e-438c-9d7d-0df46656b708 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1308 microversion: 2.1 time: 0.285919 Sep 23 03:56:14.159199 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1797/3687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:13 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:14.414717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:14.424323 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-85ceac77-152c-4bec-9318-9b4a479e4893 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1686 microversion: 2.1 time: 0.314585 Sep 23 03:56:14.435622 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1891/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:14 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1686 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:14.461613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:14.461613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:14.464046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.464768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.465422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.466699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.467392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.468015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.507872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:14.643148 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91895c87-0074-46bc-a2d4-631e64747f87 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 204 len: 0 microversion: 2.1 time: 0.189426 Sep 23 03:56:14.644037 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1798/3689] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:14 2022] DELETE /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:14.652176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:14.652851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:14.659593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.660171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.660742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.661601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.662164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.662672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.826054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:14.836321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54030dfa-ef3a-4796-a5c1-549673cceadb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1665 microversion: 2.1 time: 0.187052 Sep 23 03:56:14.850481 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1892/3690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:14 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:14.895959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:14.897325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:14.903808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.904564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.905019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.905764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.906231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.906671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:14.988753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:14.989481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:14.998182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:14.999187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:14.999896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.001052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.002044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.002732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.011596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:15.319493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:15.330346 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6f80a60-58d3-4812-b600-6dcca79a2a52 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.438641 Sep 23 03:56:15.347435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1799/3691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:14 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:15.353781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:15.354665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:15.363456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.364657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.365477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.366499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.367480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.368114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.449879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:15.465464 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e01c502f-df1e-46f6-a5af-b2b2def35cf2 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.480901 Sep 23 03:56:15.468415 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1893/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:14 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:15.478722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:15.479681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:15.488712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.489215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.489695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.490400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.490900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.491278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.779740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:15.788302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bba4430c-5b4d-41b7-a219-9827ca6d32f9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1487 microversion: 2.1 time: 0.439423 Sep 23 03:56:15.801902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1800/3693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:15 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1487 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:15.803560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:15.812120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f603899-a7c1-4309-b6ec-2195c906999f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1686 microversion: 2.1 time: 0.340164 Sep 23 03:56:15.812567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:15.828377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:15.829141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1894/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:15 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1686 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:15.835399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.836688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.837063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.837919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.838451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.838971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.861653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:15.863038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:15.874121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.876075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.877938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.880257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.882018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.883880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.922920 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4da7db5-994b-4812-b4d7-655a83fd07f4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "PUT /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1082 microversion: 2.1 time: 0.115089 Sep 23 03:56:15.923927 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1801/3695] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:56:15 2022] PUT /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1082 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:15.942611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:15.943241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:15.949402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.950160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.951335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:15.952057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:15.952520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:15.953110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.210944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:16.220128 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a0fd059-8396-452f-981c-fa33ce0889bb tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1665 microversion: 2.1 time: 0.363279 Sep 23 03:56:16.227721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:16.243843 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b991ec71-8bff-4897-b899-2e9933de0b96 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1508 microversion: 2.1 time: 0.304061 Sep 23 03:56:16.244498 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1802/3696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:15 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:16.245508 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1895/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:15 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1665 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:16.268980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.269860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.276173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.276659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.277318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.278044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.278718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.280002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.355978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.357978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.379590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.380101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.380596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.381320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.381828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.389232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.631038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:16.655217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2b79a7e-eede-4206-b379-1fce40103920 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1508 microversion: 2.1 time: 0.379496 Sep 23 03:56:16.656471 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1803/3698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:16 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:16.661802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.662750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.669310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.670038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.670861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.671748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.672435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.680654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.688505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:16.700333 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-228a8cce-f8c8-45e2-821c-1fe1aab6d2a9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.347594 Sep 23 03:56:16.714111 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1896/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:16 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:16.725953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.730596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.761336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.761839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.764856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.766545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.766818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.767249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.808952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:16.903057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:16.912621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af714731-8eeb-427a-81cf-b46be82a6948 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.254626 Sep 23 03:56:16.922332 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1804/3700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:16 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:16.926933 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fd8926c-25ef-44db-9f1a-136f9296d13d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 204 len: 0 microversion: 2.1 time: 0.210147 Sep 23 03:56:16.930006 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1897/3701] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:16 2022] DELETE /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:16.931655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.932767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.939173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:16.939688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.940312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:16.940499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.941109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.942040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.942726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.943364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.946928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.947418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.947909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:16.948651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:16.949106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:16.950255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.267712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:17.281257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e46dcc6c-4f13-4217-807b-3568fb6b7747 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.355562 Sep 23 03:56:17.295000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1805/3702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:16 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:17.305145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-plugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:17.307366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:17.316572 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8410c685-8628-4c3a-a005-5317b36055d0 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1514 microversion: 2.1 time: 0.381799 Sep 23 03:56:17.330212 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1898/3703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:16 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:17.330306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.330306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.330306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.330503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:17.330676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:17.342873 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] Creating event network-vif-plugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:56:17.346701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.347210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.347671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.348383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.349430 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4d6f2ff7-0e83-48b9-888f-9b2c1a5a49fa req-9774d656-11e6-4f46-b735-5d5aef110215 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048091 Sep 23 03:56:17.350530 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1806/3704] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:17.350909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.351422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.626853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:17.636911 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10328f74-50cf-4b21-921c-4baccbbcc0f3 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1665 microversion: 2.1 time: 0.315154 Sep 23 03:56:17.639021 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1899/3705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:17 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1665 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:17.725511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:17.726636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:17.737675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.741878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.742553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.743388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.743933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.748709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.936079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:17.936861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:17.948223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.949025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.953126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.954313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:17.954950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:17.957655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:17.975868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:17.980015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:17.988327 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4f03a503-bfed-4bf9-b662-d4c7debc661c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.267822 Sep 23 03:56:17.993790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1807/3706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:17 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:18.244817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:18.255516 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2327c638-e586-4aea-911b-4661b79b9297 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.323801 Sep 23 03:56:18.265388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1900/3707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:17 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:18.308444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:18.309406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:18.322394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.334415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.335099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.335927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.336472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.337013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.347838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:18.348708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:18.367544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.368426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.373820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.375436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.376740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.378639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.651811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:18.665710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba0bcc2d-4705-429a-9d99-4024b049011f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.361908 Sep 23 03:56:18.681377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1808/3708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:18 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:18.681377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:18.681619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:18.695264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.696697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.697266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.698023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:18.698485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:18.698916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:18.709313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:18.723559 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-654cc6ff-374d-43f7-9f2f-7ab3cc09c519 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1514 microversion: 2.1 time: 0.379401 Sep 23 03:56:18.737868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1901/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:18 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:18.807865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:18.818066 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-acfbfb8a-1438-4aa7-8ff4-487d4815e848 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1598 microversion: 2.1 time: 0.144125 Sep 23 03:56:18.818983 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1809/3710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:18 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1598 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:19.019088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:19.020815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:19.035653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.042269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.045488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.046541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.047186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.050226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.261317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:19.271435 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9d6be04-7d31-40ad-a920-b72790b03ae8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.256557 Sep 23 03:56:19.273031 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1902/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:19 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:19.285040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:19.286372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:19.296368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.298470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.299200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.299995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.300642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.301218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.388263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b", "name": "network-vif-plugged", "status": "completed", "tag": "cf714bb6-00a9-483f-b89e-22d0519c5ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:19.426704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.428344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.431056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.467793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] Creating event network-vif-plugged:cf714bb6-00a9-483f-b89e-22d0519c5ef1 for instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b on n-h2-858495-2 Sep 23 03:56:19.476821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1e0ecc68-d1de-477c-b85c-09bcb3281a22 req-c4ff59fe-fa9e-4903-bafc-945b757b430c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094322 Sep 23 03:56:19.478594 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1903/3712] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:19.703676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:19.704781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:19.726125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.727012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.728979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:19.730496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:19.732624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:19.733166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.423668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:20.433804 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42154d05-79ea-4026-979e-fa9fd763f93c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 1.153195 Sep 23 03:56:20.452898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1810/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:19 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:20.480443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:20.482818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:20.490826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:20.493886 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-358d2587-68f3-4f72-8827-aadda68787ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.799500 Sep 23 03:56:20.508704 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1904/3714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:19 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:20.517317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.518661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:20.522236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:20.526689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.533051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.533907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.534404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.534986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.535701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.536338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.537244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.537966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.538590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.539289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.599124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.599788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.600807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.605502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lazy-loading 'fault' on Instance uuid d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:56:20.802299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cf6cb958da4e3bb65435fdd189fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb615de6ca54c88b4533348273fa8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:20.817095 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f09a24a-b1b9-4318-a34b-2489f49cdd4e tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 200 len: 1316 microversion: 2.1 time: 0.302745 Sep 23 03:56:20.819059 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1905/3715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:20 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:20.828191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de", "name": "network-vif-deleted", "tag": "cbf6fdec-e8d7-4d65-9c1c-d3f561754872"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:20.845711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:20.846457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:20.847027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:20.908443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] Creating event network-vif-deleted:cbf6fdec-e8d7-4d65-9c1c-d3f561754872 for instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de on n-h1-858495-2 Sep 23 03:56:20.939428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c0d3ef83-aa7e-4db8-8232-3e68ed2ca2e8 req-c410d81c-b6c0-4537-95ca-d0f0e98bebf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119153 Sep 23 03:56:20.940060 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1906/3716] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:20.979824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:20.994503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:21.001343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:21.011671 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-831dfa21-3216-433b-9bbf-a4b297b8e694 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1514 microversion: 2.1 time: 0.556728 Sep 23 03:56:21.015575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1811/3717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:20 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:21.028111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:21.029948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:21.047099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.048323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.050017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.052335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.053648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.054712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.057323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.064005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.064590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.068430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.068930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.073813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.113058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:21.307090 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c231d4fc-7cf6-4e97-b2f2-15ab1ad9083b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 204 len: 0 microversion: 2.1 time: 0.288243 Sep 23 03:56:21.308332 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1812/3718] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:21 2022] DELETE /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:21.326003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:21.327052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:21.342106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.342926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.344278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.345242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.345935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.346823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.750726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:21.763369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67d658e1-2568-4109-930d-d77bf8f4a614 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.820744 Sep 23 03:56:21.768831 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1907/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:20 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:21.776959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:21.783457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:21.795304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.795805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.796243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.796959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.797434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.797859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.828790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:21.849780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a66ed77f-6603-4c86-b4e8-e08f4a536bdf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1554 microversion: 2.1 time: 0.534334 Sep 23 03:56:21.851152 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1813/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:21 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1554 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:21.856191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:21.857647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:21.873932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.878265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.881375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:21.883654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:21.890856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:21.909457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.219211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:22.231990 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1fe632ca-c84b-48de-82f2-300944931080 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1316 microversion: 2.1 time: 0.461003 Sep 23 03:56:22.232858 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1908/3721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:21 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:22.237597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "957b7f2f-31b4-4baa-8077-00a5beaeef47", "name": "network-vif-deleted", "tag": "4b2d79e3-c490-4db8-9282-4361af7b52a3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:22.261052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.261894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.262517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.266995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:22.278417 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] Creating event network-vif-deleted:4b2d79e3-c490-4db8-9282-4361af7b52a3 for instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 on n-h2-858495-2 Sep 23 03:56:22.293693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-253a9436-ad5f-4b55-a32d-8f19cdc432f9 req-ff816c6e-3d3c-4d92-8549-53d7cd49f9ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059070 Sep 23 03:56:22.295190 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1909/3722] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:22.300786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:22.301786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] [instance: d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:22.310537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.311678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.312817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.313962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.314695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.315357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.346170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] HTTP exception thrown: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Request method failure captured: Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de HTTP/1.1 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4Ql-_Eq17Gcz2cuRqiF76FT4XOXpw3M-gpsnnwfEVU8qNlft12QZW0IQWOa3HNDcNCOxlJkZ8FkfES1nhm8KmSeg2aoog4yzbZ_RE0SFogViQl3_yTZo_GHK4ryUei5EpepxW_vnO0Xrp22ie2_tW14kOSjpnIczSsjBYu_CxDjA4 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5fb615de6ca54c88b4533348273fa8b2 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestFqdnHostnames-1156401741 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fb615de6ca54c88b4533348273fa8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fb615de6ca54c88b4533348273fa8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fb615de6ca54c88b4533348273fa8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fb615de6ca54c88b4533348273fa8b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestFqdnHostnames-1156401741 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5fb615de6ca54c88b4533348273fa8b2 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1156401741 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestFqdnHostnames-1156401741-project Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 91cf6cb958da4e3bb65435fdd189fc14 Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestFqdnHostnames-1156401741-project Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd0d9ab2d-eb66-49d7-96c9-8b43cf51d5de'} Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:22.348009 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. Sep 23 03:56:22.352674 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:22.356816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Returning 404 to user: Instance d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:22.357962 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73c7361d-1ecf-4c68-a81c-f923a4df6ba8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de" status: 404 len: 111 microversion: 2.1 time: 0.061462 Sep 23 03:56:22.359019 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1910/3723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:22 2022] GET /compute/v2.1/servers/d0d9ab2d-eb66-49d7-96c9-8b43cf51d5de => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:22.364088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:22.364919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:22.374439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.375480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.376072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.379170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:22.382224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.382783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.387275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.393620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08de775e-1787-4b5c-afe7-c5c23aa60a3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.540968 Sep 23 03:56:22.394561 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1814/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:21 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:22.399422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9000ed70-bcdd-41d8-9ca9-0b508f41e9b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] Calling method '.version_select at 0x7f0c8a4deca0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:22.445137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9000ed70-bcdd-41d8-9ca9-0b508f41e9b8 tempest-ServersTestFqdnHostnames-1156401741 tempest-ServersTestFqdnHostnames-1156401741-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681869498" status: 202 len: 0 microversion: 2.1 time: 0.046505 Sep 23 03:56:22.446427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1815/3725] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 03:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681869498 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:56:22.534546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:22.554105 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ec82ff1-546a-481b-ae19-d6ea310e521c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 200 len: 1472 microversion: 2.1 time: 0.186366 Sep 23 03:56:22.556073 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1911/3726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:22 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:22.791580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:22.792276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:22.799551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.800090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.810334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.811602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.814448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.817708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.878041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:22.879860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:22.891487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.892257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.894520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:22.897075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:22.898060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:22.901897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:23.928587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:23.937405 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43ab4cfb-b370-43c1-99a7-1e079ca589ff tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 1.149792 Sep 23 03:56:23.956490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1816/3727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:22 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:23.956490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:23.956490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:23.968590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:23.969078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:23.969581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:23.970344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:23.971070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:23.971506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:23.988357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:24.002601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b96f8729-3dd3-4c2f-993f-53af815fa77f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1554 microversion: 2.1 time: 1.128580 Sep 23 03:56:24.021101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1912/3728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:22 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1554 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:24.041037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:24.047034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:24.063775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.064284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.064730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.065498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.065927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.071455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.690525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:24.708119 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b374f696-b362-43b9-9ec2-7efba38b8c49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1505 microversion: 2.1 time: 0.765100 Sep 23 03:56:24.708919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1817/3729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:23 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1505 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:24.713240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:24.713885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:24.724569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.725089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.730188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.731883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.732389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.732940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.747832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 HTTP/1.1 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '957b7f2f-31b4-4baa-8077-00a5beaeef47'} Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:24.749888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:24.753067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d671d2e6-0d13-4e6d-a04c-e1a32b27712e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 404 len: 111 microversion: 2.1 time: 0.041731 Sep 23 03:56:24.766043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1818/3730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:24 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:24.777236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:24.777957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:24.785425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.786320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.786798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.787616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.788161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.788688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.831989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:24.836488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5304a95-d690-41fc-b87a-05cc45f58e49 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/os-instance-actions/req-b6788058-e627-4d40-898b-ad0e96cc278b" status: 200 len: 313 microversion: 2.1 time: 0.066068 Sep 23 03:56:24.846334 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1819/3731] 10.222.0.25 () {58 vars in 1419 bytes} [Fri Sep 23 03:56:24 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/os-instance-actions/req-b6788058-e627-4d40-898b-ad0e96cc278b => generated 313 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:24.853413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:24.859834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:24.877038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:24.878154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.878928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.879373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.883899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:24.884586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:24.885006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:24.886869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a9e407c-143b-4be3-a994-d1079efb8fd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.864837 Sep 23 03:56:24.890645 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1913/3732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:24 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:24.903923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2058837564", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "fba38947-c4d3-431f-8109-f7d13a4d0046"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:24.999393 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79f93510-4938-483b-881b-1ddf3aa0e294 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "POST /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/action" status: 202 len: 0 microversion: 2.1 time: 0.150976 Sep 23 03:56:25.002320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] validate_networks() for [('fba38947-c4d3-431f-8109-f7d13a4d0046', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:56:25.019580 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1820/3733] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:24 2022] POST /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:56:25.041009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:25.042102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:25.071552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:25.072070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:25.073256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:25.076499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:25.077213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:25.077837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:25.928035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:25.937179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7412f72c-787c-4896-8577-1224c0d089b7 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.912677 Sep 23 03:56:25.949472 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1821/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:25 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:25.954450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:25.966393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:25.974125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:25.982259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:25.982903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:25.983846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:25.984496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:25.985113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:27.789320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:27.821266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fc8816e-fe8e-4d90-b292-4bb04b05f05d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1507 microversion: 2.1 time: 1.862601 Sep 23 03:56:27.822423 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1822/3735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:25 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1507 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:27.838972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:27.844072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:27.859242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:27.862162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:27.865041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:27.866229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:27.871240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:27.872040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:27.924899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:28.080182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:28.094617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da7b4645-c82c-4d07-b564-7784a08f61fd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1346 microversion: 2.1 time: 0.262193 Sep 23 03:56:28.106752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1823/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:27 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:28.120310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:28.120310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:28.123092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:56:28.123546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:56:28.123966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:56:28.124370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:56:28.124767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:56:28.126279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.126881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.127328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.128047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.129003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.129622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.176852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.177535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.181037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.182012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.182599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.183372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.231361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:56:28.242819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Getting quotas for user 9d9865d0aa5e4468a8da8460b8eb703a and project d7065f727ff24b929f9d4eef09e4a0cb. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:56:28.291461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:56:28.295805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:56:28.412554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-752a07d8-4d9e-4f3c-8b20-d7cc34a708be tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.519409 Sep 23 03:56:28.422907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1914/3737] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:56:28.428970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31157afe-3d76-47fd-9f14-5c5e00300c76", "name": "network-vif-deleted", "tag": "ea5a6007-f3b1-4d86-ab55-b05788f4bce5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:28.455335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.457429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.458115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.488684 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] Creating event network-vif-deleted:ea5a6007-f3b1-4d86-ab55-b05788f4bce5 for instance 31157afe-3d76-47fd-9f14-5c5e00300c76 on n-h2-858495-2 Sep 23 03:56:28.503962 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-14c64524-a504-4832-a7cc-bdf371325844 req-51131e52-a520-4982-9166-efd6f4437022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078978 Sep 23 03:56:28.505218 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1915/3738] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:28.518385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:28.519362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:28.534767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.535707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.536643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.537611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:28.541994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:28.542760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:28.620737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:28.635491 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-166362f4-afb8-42a8-97b9-dd32951d36c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.527479 Sep 23 03:56:28.638385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1824/3739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:28 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:28.655647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c0852e1-d38d-444c-ada6-5de954ece4ba tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:28.656439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c0852e1-d38d-444c-ada6-5de954ece4ba tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:29.260192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c0852e1-d38d-444c-ada6-5de954ece4ba tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:29.270553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c0852e1-d38d-444c-ada6-5de954ece4ba tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1209 microversion: 2.1 time: 0.627507 Sep 23 03:56:29.271095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1825/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:28 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1209 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:29.285754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:29.297926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:29.311946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:29.318312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:29.319003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:29.319929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:29.320546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:29.321119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:29.857458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:29.874724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9aef952-573d-41ef-a209-6278b39bb676 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 1.364890 Sep 23 03:56:29.875873 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1916/3741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:28 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:29.880981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:29.891206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:29.911821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:29.916028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:29.919468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:29.922945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:29.923441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:29.923887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:29.985147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:29.996838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7b3382e-0760-468f-ae6f-6b68786b7377 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1505 microversion: 2.1 time: 0.724401 Sep 23 03:56:29.997474 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1826/3742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:29 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:30.023822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.026026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.050762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.058000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.059693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.077475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.083696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.085205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.112384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:30.124351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19b01772-4c74-417c-b781-ca178d3dcb0c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1346 microversion: 2.1 time: 0.247240 Sep 23 03:56:30.125105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1917/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:29 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1346 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:30.130870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '.version_select at 0x7f0c8a4a4670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.145840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.163442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.163947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.172071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.173377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.174161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.175705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.312768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a028c41d-33d5-4a63-ab5f-db1d37992f83 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.185852 Sep 23 03:56:30.320647 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1918/3744] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Sep 23 03:56:30 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b/os-instance-actions => generated 611 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:30.336420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.339287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.351748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:30.357157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.370144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.371078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.372051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.375444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.377338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.585564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:30.607963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bccad2d-8f90-4d75-a1e0-93222723491d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.609391 Sep 23 03:56:30.613454 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1827/3745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:29 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:30.623937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.624663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.649639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:30.655279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.656475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.657251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.658427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.659068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.661804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.675909 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a7a209d-92a1-479f-983c-d50a24bd261b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1261 microversion: 2.1 time: 0.350578 Sep 23 03:56:30.678284 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1919/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:30 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1261 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:30.726017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:30.889329 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96ddc809-fd71-4382-9a18-f3ef20f0377d tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 204 len: 0 microversion: 2.1 time: 0.274391 Sep 23 03:56:30.912798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1828/3747] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:30 2022] DELETE /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:30.940937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.942425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.953064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:30.953797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:30.960444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.961565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.962313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.963256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.963765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.964210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.964939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.965480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.965901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:30.966007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:30.967470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:30.968639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.451663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:31.469794 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-efc8a09f-3211-4551-b820-3a06b687da87 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1511 microversion: 2.1 time: 0.545632 Sep 23 03:56:31.477997 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1829/3748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:30 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:31.510281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:31.512103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:31.523501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.531050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.531784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.532741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.533410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.535574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.607137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:31.618525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f57dd2b9-163e-4768-90d9-69dfb1651953 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.719794 Sep 23 03:56:31.648605 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1920/3749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:30 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:31.654298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:31.654915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:31.678611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.679367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.679959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.680839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.682842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.685379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.730058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:31.740171 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e0f4b14-afd4-4828-ad35-4725f01d1f61 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1346 microversion: 2.1 time: 0.260537 Sep 23 03:56:31.740771 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1830/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:31 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1346 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:31.782799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:31.791045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:31.799479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.807663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.814441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.818618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:31.823046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:31.825680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:31.973698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:31.991701 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31d36e23-bc03-4bde-9ee8-d2f65d2382b5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.333916 Sep 23 03:56:32.005941 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1921/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:31 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:32.045745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:32.054709 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-549ad748-3a7f-4800-a59e-ac0d98d17874 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1267 microversion: 2.1 time: 0.286439 Sep 23 03:56:32.055504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1831/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:31 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:32.498733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:32.499354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:32.513737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:32.516848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:32.517335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:32.519356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:32.519825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:32.520255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:32.653623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:32.654579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:32.670232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:32.672767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:32.674450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:32.677854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:32.679099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:32.679725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.218558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:33.233112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-958668cf-6cb7-46dd-9536-a0bd7781ebf9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.585454 Sep 23 03:56:33.235247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1832/3753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:32 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:33.249967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:33.250587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:33.270641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.271524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.272094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.273462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.274040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.274675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.509586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:33.530216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14ad08cd-f416-49fc-bb84-7be1bcc14ff0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1346 microversion: 2.1 time: 0.293350 Sep 23 03:56:33.545378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1833/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:33 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:33.551502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:33.553567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:33.556877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:33.574610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:33.591699 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-201e9cf3-1bf5-4acc-a528-caf22b80d27c tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1511 microversion: 2.1 time: 1.098985 Sep 23 03:56:33.594273 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1922/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:32 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1511 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:33.595848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.597419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.597986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.598809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.600221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.601029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.609913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:33.610698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:33.622689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.623760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.628797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:33.630427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:33.631045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:33.632422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:34.593038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:34.625787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca19af42-9163-4112-91fd-491b5c21ccf5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 1.080178 Sep 23 03:56:34.630239 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1834/3756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:33 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:34.650250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:34.658358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:34.682909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:34.686985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:34.689712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:34.705196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:34.706365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:34.710157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:34.988335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:35.002163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5bd2e7cf-0290-49e3-8831-a1b8b836fbdf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 1.400706 Sep 23 03:56:35.002843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1923/3757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:33 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:35.020860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:35.021423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:35.036443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.036938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.037391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.042309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.043510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.048359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.122406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.122912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.123362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.123818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'fault' on Instance uuid 31157afe-3d76-47fd-9f14-5c5e00300c76 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:56:35.131914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:35.144966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18c4aa52-1412-4650-a3fc-ded728a70caf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.505807 Sep 23 03:56:35.146551 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1835/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:34 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:35.154368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:35.155264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:35.182915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.195355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.205459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.206478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.207120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.207564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.276039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:35.291488 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e188c35-71ce-4373-9fc0-27e607516eeb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 200 len: 1351 microversion: 2.1 time: 0.283229 Sep 23 03:56:35.292084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1924/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:35 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 1351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:35.301095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b", "name": "network-vif-deleted", "tag": "cf714bb6-00a9-483f-b89e-22d0519c5ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:35.355441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.356093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.356741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.373464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lazy-loading 'fault' on Instance uuid 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:56:35.377089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.385880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.386392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.416707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] Creating event network-vif-deleted:cf714bb6-00a9-483f-b89e-22d0519c5ef1 for instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b on n-h2-858495-2 Sep 23 03:56:35.424154 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b6b8cc0b-be34-4ba1-8a78-996d8dbb5b71 req-fc2881c1-6503-4d25-acd5-ac851cf0e0f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126806 Sep 23 03:56:35.425701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1925/3760] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:35.534411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0400b3435d4a0cb5c6806bb55ec582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c542205803d34c65b2610f91185b9630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:35.546272 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc91aa6d-0619-402e-bd82-1a00f787ab55 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 200 len: 1306 microversion: 2.1 time: 0.398194 Sep 23 03:56:35.547477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1836/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:35 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 1306 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:35.656255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:35.657593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:35.686652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.692549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.697461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:35.701760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:35.703913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:35.708064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.030001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:36.031399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:36.043878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.049043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.049831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.050771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.051588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.059608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.408035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:36.422537 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da7e6c83-4fa3-4ef2-8581-959e08b20d4d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.774439 Sep 23 03:56:36.437965 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1926/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:35 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:36.451530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:36.452154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:36.469101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.473334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.474871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.475790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.477082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.479630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.514123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:36.534485 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2011d43b-904e-48ad-8d75-c68402896de7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.506628 Sep 23 03:56:36.569951 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1837/3763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:36 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:36.577368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:36.587554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:36.600872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.601454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.601903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.602626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.606491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.607376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.632529 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 HTTP/1.1 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '31157afe-3d76-47fd-9f14-5c5e00300c76'} Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.635130 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.639200 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.640384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:36.641446 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ee0b255-ec52-4010-a0d3-922f2dcc80a8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 404 len: 111 microversion: 2.1 time: 0.069010 Sep 23 03:56:36.642696 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1838/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:36 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:36.650242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:36.656659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] [instance: 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:36.669526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.670344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.670957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.671845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.672499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.673083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.704207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] HTTP exception thrown: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Request method failure captured: Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b HTTP/1.1 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS5HpttX0YUDRWJcXOhSssQlv7Er1lbYVq9PhcgltRY_fUQ5A02-TOnha4NRGZCc3ezOSMy_EGKJy22xHRmTvJzs1GfNPSD3NYwFqbdKK3mIhZRcgc7CoOxM0jhr7TVbzZ9IXoyL7lj6GK7mj2nPS4sr66L7MplcihPQIIIfx1ccT2A Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: c542205803d34c65b2610f91185b9630 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-InstanceActionsTestJSON-322102555 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c542205803d34c65b2610f91185b9630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c542205803d34c65b2610f91185b9630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c542205803d34c65b2610f91185b9630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c542205803d34c65b2610f91185b9630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-InstanceActionsTestJSON-322102555 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: c542205803d34c65b2610f91185b9630 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-InstanceActionsTestJSON-322102555 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-InstanceActionsTestJSON-322102555-project Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: cb0400b3435d4a0cb5c6806bb55ec582 Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-InstanceActionsTestJSON-322102555-project Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b'} Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.707346 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. Sep 23 03:56:36.711321 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.717529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] Returning 404 to user: Instance 8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:36.720262 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5159bbc-9ab4-4c66-aa8b-4fa13ee667b7 tempest-InstanceActionsTestJSON-322102555 tempest-InstanceActionsTestJSON-322102555-project] 10.222.0.25 "GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b" status: 404 len: 111 microversion: 2.1 time: 0.074926 Sep 23 03:56:36.723001 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1839/3765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:36 2022] GET /compute/v2.1/servers/8810f1c5-8cfb-4c6c-9c99-d8b465b3e79b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:36.877834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:36.880428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:36.892282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.892760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.897162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.897954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:36.898434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:36.898877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:36.927973 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76/os-volume_attachments HTTP/1.1 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '31157afe-3d76-47fd-9f14-5c5e00300c76'} Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:36.931491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 03:56:36.934861 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:36.936701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:36.937807 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-764bfbde-0af6-4490-8838-edc6d2c32f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064085 Sep 23 03:56:36.941928 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1840/3766] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:56:36 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:36.964030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:36.974106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc8f9718-50e7-48de-bc6b-c56c91a34a92 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.534906 Sep 23 03:56:36.981442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1927/3767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:36 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:37.276073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1861213641", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:37.404444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:56:37.453182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:37.454516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:37.467847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:37.469214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:37.469833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:37.472082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:37.473949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:37.476283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.207359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:38.286751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:38.552015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:38.557877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:38.574034 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2b72859-c065-4680-8643-1679df7f8f9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 1.125777 Sep 23 03:56:38.598294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1928/3768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:37 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:38.610871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:38.616211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:38.634894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.635724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.637875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.638900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.639614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.642261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.773936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:56:38.775016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:56:38.775774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:56:38.776339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:56:38.776903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:56:38.796129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.796865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.797489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.798856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.799579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.801993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.827774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:38.854813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:56:38.882224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:56:38.909743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:56:38.912106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:56:38.977135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2733b8be-99e2-4dbb-8ba6-b5fed5515f76 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705341 Sep 23 03:56:38.979457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1841/3769] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:56:38.985343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:38.986258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:38.992203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:38.994756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.995463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.996259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:38.997340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:38.998165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:38.998760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:39.000961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6611cde8-310d-45a6-9032-4146fac6257e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.398494 Sep 23 03:56:39.016968 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1929/3770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:38 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:39.031773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995a9025-d86f-4f31-a05c-9702b9cb06d1", "tag": "c1cb791f-0647-4e8c-b31f-2171bd13cf24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:39.088308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:39.088808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:39.089244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:39.129943 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] Creating event network-changed:c1cb791f-0647-4e8c-b31f-2171bd13cf24 for instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 on n-h1-858495-2 Sep 23 03:56:39.143936 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5da4f20b-4016-422e-b0c0-5cd6cc12b8b9 req-44d7cd16-ea5f-464c-9949-bffd4a672b78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125402 Sep 23 03:56:39.144724 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1930/3771] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:39.150328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b9ecf5c-6d4f-4daf-8a53-13234226878f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:39.151256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b9ecf5c-6d4f-4daf-8a53-13234226878f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:39.308177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b9ecf5c-6d4f-4daf-8a53-13234226878f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:39.322445 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b9ecf5c-6d4f-4daf-8a53-13234226878f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24" status: 200 len: 1215 microversion: 2.1 time: 0.172595 Sep 23 03:56:39.323084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1931/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:39 2022] GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:39.349722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abbb56ad-078e-40b9-afde-87495a89e620 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:39.351096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-abbb56ad-078e-40b9-afde-87495a89e620 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:39.398503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-abbb56ad-078e-40b9-afde-87495a89e620 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:39.465562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:39.481120 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8992d7d5-ba77-4468-b7eb-77a2469798c9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.500241 Sep 23 03:56:39.488038 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1842/3773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:38 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:39.523565 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-abbb56ad-078e-40b9-afde-87495a89e620 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24" status: 204 len: 0 microversion: 2.1 time: 0.177408 Sep 23 03:56:39.524371 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1932/3774] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:39 2022] DELETE /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:39.534462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:39.535173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:39.562626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 HTTP/1.1 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24'} Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:39.587964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:39.591719 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-598887bb-7ca6-452f-933e-fb802b1806f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24" status: 404 len: 111 microversion: 2.1 time: 0.060310 Sep 23 03:56:39.603715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1843/3775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:39 2022] GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:56:39.618994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:39.619619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:39.631121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:39.631613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:39.632054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:39.632772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:39.633242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:39.633714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:39.723289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-88669953", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:39.855684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:56:40.313180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:40.327374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-187641d4-c883-4640-9ae5-0dcda23f6cf9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.723890 Sep 23 03:56:40.328406 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1933/3776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:39 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:40.338374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:40.341056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:40.366766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:40.367644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:40.368314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:40.369245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:40.369933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:40.370568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:40.904864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:40.919873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ff3d554-3017-413a-9b67-df21b189830c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.586176 Sep 23 03:56:40.920322 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1934/3777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:40 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:40.924991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:40.925629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:40.942467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:40.943194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:40.946942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:40.947938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:40.948577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:40.949191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:41.492805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:41.502110 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d4ec7317-ffc6-48ce-bee3-c717df00103f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.580256 Sep 23 03:56:41.506072 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1935/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:40 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:41.516873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:41.517984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:41.533751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:41.534421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:41.535014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:41.535922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:41.537457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:41.538126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:41.570279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:56:41.571548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:56:41.572166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:56:41.572727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:56:41.573280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:56:41.595171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:41.595894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:41.596576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:41.598488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:41.599268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:41.600196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:41.623926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:56:41.632838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:56:41.650764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:56:41.655308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:56:41.770551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f65593c6-e1e8-4876-8559-b9f6c27c1b5f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050897 Sep 23 03:56:41.774554 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1844/3779] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:56:41.786103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fbfb720-a13b-479d-b156-41efd544e357 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:41.787534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0fbfb720-a13b-479d-b156-41efd544e357 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:41.939779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0fbfb720-a13b-479d-b156-41efd544e357 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:41.955344 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0fbfb720-a13b-479d-b156-41efd544e357 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1213 microversion: 2.1 time: 0.169158 Sep 23 03:56:41.956435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1845/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:41 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:41.969660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:41.970432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:42.002780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:42.003603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:42.003991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:42.004724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:42.005195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:42.005656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:42.309116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:42.324212 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d6e9cf4-eb32-4caa-bdd0-6ad713a628cc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1681 microversion: 2.1 time: 0.814230 Sep 23 03:56:42.326720 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1936/3781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:41 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1681 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:42.535933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:42.538075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:42.555509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:42.558165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:42.560780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:42.563434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:42.564679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:42.568868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:43.690586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:43.694811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:43.715145 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f3691ef-6eb3-4883-8d07-6f00721ed800 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 1.185575 Sep 23 03:56:43.722451 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d9c14de-dcf6-4d1b-88e1-20ece7b90064 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 1.764724 Sep 23 03:56:43.723333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1846/3782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:41 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:43.727748 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1937/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:42 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:43.743430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:43.744616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:43.745589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:43.754022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:43.761240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:43.761833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:43.762291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:43.763006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:43.766434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:43.767423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:43.768099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:43.770411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:43.770847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:43.771562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:43.772179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:43.773972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:43.952937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:43.965640 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e066ee7-7184-43c3-b889-19ed273d88cb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1265 microversion: 2.1 time: 0.241082 Sep 23 03:56:43.969532 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1847/3784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:43 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:44.516157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:44.529176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86679a8e-cde5-49fe-87c4-1403cf948f6b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.790999 Sep 23 03:56:44.535439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1938/3785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:43 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:44.754456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:44.755150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:44.758760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:44.759938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:44.774229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:44.776296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:44.776777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:44.776885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:44.778190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:44.778873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:44.779884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:44.780550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:44.781843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:44.782620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:44.785971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:44.786447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:45.346601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:45.360954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:45.375320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0512ef8b-6b71-4a36-982b-b476b9f80709 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1507 microversion: 2.1 time: 0.619585 Sep 23 03:56:45.376500 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6bd79ec3-4f08-4b9d-a945-feed64f03e70 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.626046 Sep 23 03:56:45.377672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1939/3786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:44 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:45.381981 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1848/3787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:44 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:45.391935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:45.392979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:45.403220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:45.404324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:45.405085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:45.406354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:45.407080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:45.407788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:45.600105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:45.623936 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86b612d2-15e3-421f-a44d-3379a84b94b2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1271 microversion: 2.1 time: 0.242890 Sep 23 03:56:45.624693 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1940/3788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:45 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:45.715505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:45.716378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:45.731001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:45.731841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:45.732339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:45.733058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:45.733791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:45.734302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:46.238499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:46.267941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96f764f5-0c2a-4c4d-83a6-520e11ebc9e8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.546281 Sep 23 03:56:46.280941 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1849/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:45 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:46.417727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:46.418963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:46.422151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:46.428845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:46.432027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:46.432521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:46.439610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:46.440675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:46.441298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:46.442230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:46.445412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:46.446066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:46.448708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:46.450042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:46.450520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:46.450956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:47.085815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:47.101372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f4c4f3c-f717-45ae-8032-4343567b3a05 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1487 microversion: 2.1 time: 0.684333 Sep 23 03:56:47.115661 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1941/3790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:46 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1487 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:47.168831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:47.169778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:47.190473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:47.195459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:47.196160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:47.197208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:47.202035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:47.202547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:47.271285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:47.279521 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11433c5e-2260-46ff-9bd8-55421854edf9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.866043 Sep 23 03:56:47.285970 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1850/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:46 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:47.445786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-833538265", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:47.558188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] validate_networks() for [('46d4637c-6257-49e1-8d2f-90d804562166', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:56:47.857716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:47.870554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8b1b0f94-7382-40f8-9578-ea5e932bc4d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.726507 Sep 23 03:56:47.882922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1942/3792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:47 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:47.889258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995a9025-d86f-4f31-a05c-9702b9cb06d1", "name": "network-vif-plugged", "status": "completed", "tag": "c1cb791f-0647-4e8c-b31f-2171bd13cf24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:47.900300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:47.901276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:47.902540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:47.919209 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] Creating event network-vif-plugged:c1cb791f-0647-4e8c-b31f-2171bd13cf24 for instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 on n-h1-858495-2 Sep 23 03:56:47.926488 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c40b28ca-d52f-40f3-9ca1-f5c88e77334f req-94543432-fcc2-46bd-a093-76f741cd674c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041727 Sep 23 03:56:47.927893 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1943/3793] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:48.060482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:48.061390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:48.084207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.088240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.088892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.089713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.090181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.090609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.508355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:48.517188 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2c7262f-a63f-48fa-b850-67a52ae27c21 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.461957 Sep 23 03:56:48.517819 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1944/3794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:48 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:48.535443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:48.536059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:48.559029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.560011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.560604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.561510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.562266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.563777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.851154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:56:48.852104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:56:48.852710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:56:48.853718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:56:48.854102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:56:48.886973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.887681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.889832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.892617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:48.893861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:48.896073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:48.942249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Getting quotas for project 6f20556a60e946f5bffafdbac4b76964. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:56:48.953082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Getting quotas for user 8f85b0d0ad0044fbb1189575d448dd47 and project 6f20556a60e946f5bffafdbac4b76964. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:56:48.986493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:48.999058 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24a758a6-3923-4b70-ba64-043c231fd17d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1309 microversion: 2.1 time: 0.475341 Sep 23 03:56:48.999526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:56:49.000244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1945/3795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:48 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:49.008262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:49.015894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:49.019387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:56:49.050595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:49.052066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:49.052784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:49.053777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:49.054466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:49.055109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:49.139370 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30287ed6-62a1-4f17-ae8f-06ba865b06bc tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.697484 Sep 23 03:56:49.140359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1851/3796] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:56:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:56:49.145440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:49.146336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:49.155723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:49.156224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:49.156689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:49.158348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:49.159083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:49.159947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:49.450657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:50.100709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:50.110042 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22a71a96-6827-48db-9b18-0496818012ee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.968552 Sep 23 03:56:50.117301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1852/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:49 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.119906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:50.132011 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e17d099f-5c56-4b63-a6c8-ec293698defd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 1.129778 Sep 23 03:56:50.132722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:50.133593 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1946/3798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:49 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.137496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.142638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:50.143856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.152637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.153541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.154126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.159195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.161993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.162960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.163866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.168050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.168766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.169126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.169245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.169865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.263194 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83807720-b795-417b-8792-0e9e164d420d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/ips" status: 200 len: 147 microversion: 2.1 time: 0.125392 Sep 23 03:56:50.263873 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1947/3799] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:56:50 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/ips => generated 147 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:50.269720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:50.279830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.297412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.298511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.301494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.304261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.305938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.307754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.333463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:50.343368 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d29d4ff1-123e-451f-8e9d-f0675af18ddf tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1209 microversion: 2.1 time: 0.224840 Sep 23 03:56:50.348004 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1853/3800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:50 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.358729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f3afb5-28e2-4e6f-b52a-13f884b4fab8", "tag": "4bc531c6-7395-4d26-88b5-46f2d36d457d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:50.380231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.381733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.382328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.414838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] Creating event network-changed:4bc531c6-7395-4d26-88b5-46f2d36d457d for instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 on n-h2-858495-2 Sep 23 03:56:50.430504 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d2e9fcfb-344a-4e41-9a5a-947dd8628783 req-1d24e3a9-55e9-458f-9b55-6e5e38104bd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080580 Sep 23 03:56:50.431164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1854/3801] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:50.436560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:50.437275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.455097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.458951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.459713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.460737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.461374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.462314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.694888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:50.703346 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47f8897d-f0dc-497a-a90b-c115bde7b506 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1489 microversion: 2.1 time: 0.437551 Sep 23 03:56:50.709634 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1948/3802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:50 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1489 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.715095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-unplugged", "status": "completed", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:50.732292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.733014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.733684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.737138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:50.747280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:50.756920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] Creating event network-vif-unplugged:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 03:56:50.759631 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97d791c1-d7f7-4bee-995f-76f5ffb7427b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.327189 Sep 23 03:56:50.760352 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1855/3803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:50 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.772224 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ce8e8774-216f-453d-a6e6-a9304877825b req-5699a978-23ac-4ec0-98bd-0fa6fbfb9820 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061022 Sep 23 03:56:50.773380 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1949/3804] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:50.775808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b33a329-dd8b-4c44-83a2-eba2ef92ef93"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:50.781382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.781706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2101203002"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:50.784297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.791056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.791609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.792202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.793084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.793564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.793987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.796639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.797212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.797758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.799298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.801878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.802490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.908113 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69463805-ab36-4078-8649-e879f67c1149 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "PUT /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1074 microversion: 2.1 time: 0.132978 Sep 23 03:56:50.909181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1950/3805] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:56:50 2022] PUT /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1074 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:50.918568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:50.920948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:50.937140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.938781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.939530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:50.942145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:50.942878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:50.943507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.017252 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/os-volume_attachments HTTP/1.1 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 74 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: {"volumeAttachment": {"volumeId": "2b33a329-dd8b-4c44-83a2-eba2ef92ef93"}} Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '6e8d5cd8-9873-49e6-af27-20b2bffcef76', 'body': {'volumeAttachment': {'volumeId': '2b33a329-dd8b-4c44-83a2-eba2ef92ef93'}}} Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:56:51.023756 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad Sep 23 03:56:51.028007 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:56:51.029909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 400 to user: Invalid volume: volume 2b33a329-dd8b-4c44-83a2-eba2ef92ef93 is already attached to instances: 6014c14c-d670-4333-a033-a26367fa56ad {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:51.030937 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17deba7c-c393-4646-831b-b0f0e47450d7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.268883 Sep 23 03:56:51.032224 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1856/3806] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:56:50 2022] POST /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76/os-volume_attachments => generated 174 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:56:51.037926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:51.038880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:51.048055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.048778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.049530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.051130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.052097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.053862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.098040 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a54a0eb6-ad3e-49c4-822d-0d1a4070c693 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.187329 Sep 23 03:56:51.101971 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1951/3807] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:50 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:56:51.105944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:51.107025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:51.114244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.115181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.115965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.117278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.118453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.119184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.164033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:56:51.289627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f6637e3-442b-4634-b623-c5c30ca1217d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 204 len: 0 microversion: 2.1 time: 0.188571 Sep 23 03:56:51.291001 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1952/3808] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:56:51 2022] DELETE /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:56:51.300514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:51.301063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:51.308710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.310263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.310709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.311421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.311881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.312309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.668549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:51.676626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-179449d2-e551-4e68-89cd-eba5065d2da3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1500 microversion: 2.1 time: 0.642797 Sep 23 03:56:51.677218 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1857/3809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:51 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1500 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:51.686808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:51.693368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:51.707759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.708562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.709290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.712086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.715241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.715892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.784269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:51.799147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8ef8543-3cfb-42d3-971e-a990e485061d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1670 microversion: 2.1 time: 0.504628 Sep 23 03:56:51.800213 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1953/3810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:51 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1670 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:51.809815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:51.810437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:51.825527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.827008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.829844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:51.831946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:51.832970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:51.833634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.052140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:52.061020 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b95d6259-05a4-492b-9812-cc1a1eb61546 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.378457 Sep 23 03:56:52.084099 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1858/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:51 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:52.093870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:52.095634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:52.100956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:52.122244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.122843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.123359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.124144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.124801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.125434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.272511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:52.286026 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-deef6a40-54a5-4fe4-934d-013cd3faae33 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1271 microversion: 2.1 time: 0.200307 Sep 23 03:56:52.287194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1859/3812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:52 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:52.297297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:52.298109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:52.300278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:52.320035 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9a8a04e-c7aa-45ed-8961-b7f45de0d506 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1679 microversion: 2.1 time: 0.518077 Sep 23 03:56:52.321974 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1954/3813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:51 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1679 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:52.334747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.336293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.336755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.337552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.338006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.338442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.824816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:52.830825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:52.842644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:52.848718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.849760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.850802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.851844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.852736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.854419 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b2f2d6b-b173-48e9-af01-8fc9348155c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1500 microversion: 2.1 time: 0.564277 Sep 23 03:56:52.855858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.857894 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1860/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:52 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:52.888647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:52.897940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:52.898695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:52.902808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:52.984183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 03:56:53.041066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:53.099108 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd42a84e-3302-402e-aa34-bb692c5f6706 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "POST /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1/action" status: 202 len: 0 microversion: 2.1 time: 0.214355 Sep 23 03:56:53.106408 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1861/3815] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:52 2022] POST /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:56:53.118469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:53.122845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:53.140976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:53.141518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:53.144535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:53.145446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:53.145943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:53.147746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:53.937460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:53.950136 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0040d588-1ce1-428c-8c1f-1409e4bb24c4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.838443 Sep 23 03:56:53.953018 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1862/3816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:53 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:53.967298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:53.968021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:53.984105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:53.984626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:53.986324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:53.987262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:53.990075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:53.990696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.010266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:54.018845 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1b91c54-8a4b-483f-a479-83194f668c98 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1670 microversion: 2.1 time: 1.196835 Sep 23 03:56:54.022380 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1955/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:52 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1670 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:54.039084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:54.039753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:54.049182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.051754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.052936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.053694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.060040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.060558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.364725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:54.385578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1be43b72-b989-4ec4-b816-3d46032167db tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1271 microversion: 2.1 time: 0.359514 Sep 23 03:56:54.396135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1956/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:54 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:54.410138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:54.413258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:54.440064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:54.493506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.499045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.499527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.502056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.502359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.502799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.801581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:54.826135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-909b20be-3dcb-4928-b9c9-3abf421d5ddf tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.869516 Sep 23 03:56:54.828651 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1863/3819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:53 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:54.978500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:54.980180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:54.988964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.989717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.990357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:54.991395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:54.992230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:54.992868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:55.430718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:55.440408 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4112cdcb-a880-4eee-be00-2fc168fec6e0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1679 microversion: 2.1 time: 1.041819 Sep 23 03:56:55.454972 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1957/3820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:54 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1679 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:55.486696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:55.489508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:55.498881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:55.499380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:55.499807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:55.500515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:55.500969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:55.501408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:55.609737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:55.620091 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-221912a9-3f8f-41ca-a5dc-a1d578618db0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.644600 Sep 23 03:56:55.621518 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1864/3821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:54 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:55.638116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:55.638997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:55.649658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:55.650591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:55.651336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:55.652831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:55.654431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:55.655142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:55.974023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:55.983677 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cdbd184c-77bf-49c6-ac72-2ee29ee49b39 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1271 microversion: 2.1 time: 0.360860 Sep 23 03:56:56.004004 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1865/3822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:55 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:56.015846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:56.016845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:56.029040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.031761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.032481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.033464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.035270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.035968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.218504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:56.234193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22572841-1f83-4228-ac87-94f759f85709 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.758825 Sep 23 03:56:56.250162 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1958/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:55 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:56.259459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:56.262135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:56.268707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.269204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.269988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.271126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.271732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.272301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.340650 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31cabea4-4d95-4e0a-8b17-a9aa2d91f634 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 200 len: 322 microversion: 2.1 time: 0.084826 Sep 23 03:56:56.347352 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1959/3824] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:56:56 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:56:56.352965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:56.356236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:56.363493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.364194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.364822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.365943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.366884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.367620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.685894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:56.693928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ab16baf-e2b6-4f6e-9016-46c0404c270a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.688275 Sep 23 03:56:56.694530 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1866/3825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:56 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:56.704683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:56.705300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:56.725328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.728477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.728933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.729737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:56.730202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:56.730635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:56.954300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:56.971132 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e46b3791-a694-42fa-b3dd-df77996b4c4d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 200 len: 1611 microversion: 2.1 time: 0.269425 Sep 23 03:56:56.974079 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1867/3826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:56 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 1611 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:56.983133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:56.986538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:57.001002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.004573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.005140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.006399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.008239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.011928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.018333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:57.033690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8cc6e3a8-52a3-4221-9b4c-0d1de3f8dadf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.684684 Sep 23 03:56:57.036707 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1960/3827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:56 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:57.056295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d5cd8-9873-49e6-af27-20b2bffcef76", "name": "network-vif-deleted", "tag": "6a023019-e2a7-4bf5-b71c-f6d474657436"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:57.077212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.077728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.078168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.112102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] Creating event network-vif-deleted:6a023019-e2a7-4bf5-b71c-f6d474657436 for instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 on n-h1-858495-2 Sep 23 03:56:57.127492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ea0f24d7-faf1-41c1-81d4-4a40d6a974a5 req-c85e90a8-8530-4587-b070-89bfa3d03d85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087526 Sep 23 03:56:57.129040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1961/3828] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:57.144320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:57.145105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:57.179218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.179720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.180159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.185219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.185927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.187330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.433487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:57.441605 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a488b77-4094-4493-a93e-ca0793c2e4fa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.464646 Sep 23 03:56:57.446011 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1868/3829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:56 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:57.457204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:57.458143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:57.476808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.481611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.482527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.486258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.487214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.487781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.855496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:57.870664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31aa1958-26dc-40bf-9b19-026e2952a90a tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 0.735275 Sep 23 03:56:57.886526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1962/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:57 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:57.886526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:57.886526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:57.894207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:57.898294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.899325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.902021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.902879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.903391 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd9f9898-de65-44bc-b611-21000450e122 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.456209 Sep 23 03:56:57.903511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.906003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.923500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1869/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:57.930398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:57.931027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:57.938720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.939430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.940026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:57.940924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:57.941571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:57.942156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.303027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:58.317956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:58.329013 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c1f2a4a-103a-4325-b887-5483db7d4e60 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.454435 Sep 23 03:56:58.331834 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a95ca032-93fb-40a8-80a3-eed0a34d1e60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.406695 Sep 23 03:56:58.331961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1963/3832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:57 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:58.345441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1870/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:58.345623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:58.348587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:58.358614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:58.359604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:58.363781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.364291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.364744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.365502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.365971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.366410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.370401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.372473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:58.373695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.374686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.377425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.378427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.380772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.404232 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 HTTP/1.1 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6e8d5cd8-9873-49e6-af27-20b2bffcef76'} Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:56:58.409171 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 03:56:58.413679 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:56:58.416041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:56:58.418293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7d8ce16-fad4-4ad5-8b52-bddac8ca414d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 404 len: 111 microversion: 2.1 time: 0.085379 Sep 23 03:56:58.424784 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1964/3834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:58 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:56:58.430058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ba7a28a-ab37-47fc-a8fa-1b7bf3135098 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '.version_select at 0x7f0c8a4a4c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:58.454081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ba7a28a-ab37-47fc-a8fa-1b7bf3135098 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436125065" status: 202 len: 0 microversion: 2.1 time: 0.027837 Sep 23 03:56:58.459081 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1965/3835] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436125065 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:56:58.486748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:58.487572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:58.501456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.502194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.502790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.504362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.504997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.506255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.888483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:58.914193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-286e046c-8ca7-44c8-ba5c-c4d309fc128e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.438103 Sep 23 03:56:58.921751 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1966/3836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:58 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:58.928711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f3afb5-28e2-4e6f-b52a-13f884b4fab8", "name": "network-vif-plugged", "status": "completed", "tag": "4bc531c6-7395-4d26-88b5-46f2d36d457d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:58.935102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:58.947313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:58.947792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:58.949392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:58.965883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=22 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:56:58.971883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] Creating event network-vif-plugged:4bc531c6-7395-4d26-88b5-46f2d36d457d for instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 on n-h2-858495-2 Sep 23 03:56:58.972786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:58.986987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-53dcd47e-dca7-4e01-8206-1132f10b1421 req-c58bddde-f298-45bd-98e2-b9ebbd3cfcfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061303 Sep 23 03:56:58.992300 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1967/3837] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:56:58.997125 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8891074-9d19-478d-8810-9cde0866d22e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.642445 Sep 23 03:56:58.998673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:58.999012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:58.999474 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1871/3838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:58 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:56:59.012815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:59.013332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:59.013789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:59.014503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:59.014962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:59.015390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:59.184172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2134070491", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "035b98c4-22a0-4a66-81a1-f3cedd6f6f67"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:56:59.282637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] validate_networks() for [('035b98c4-22a0-4a66-81a1-f3cedd6f6f67', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:56:59.568795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:56:59.576948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e596e12d-b4fa-4d3d-9578-55e8e595b46b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 0.583313 Sep 23 03:56:59.578146 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1968/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:58 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:56:59.582928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:56:59.583809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:56:59.590585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:59.591386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:59.592060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:56:59.592981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:56:59.593717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:56:59.594369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:00.599446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:00.616138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-968dc608-9df4-4fb5-b62f-cde3abf9615c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 1.036708 Sep 23 03:57:00.628810 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1969/3840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:56:59 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:00.658744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:00.662071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:00.683960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:00.684829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:00.686306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:00.687293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:00.690790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:00.693286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.148563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:01.152522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:01.153117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:01.153834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:01.154540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:01.155142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:01.158133 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e35f58db-0695-4207-a873-df33996b0bcf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1313 microversion: 2.1 time: 0.527770 Sep 23 03:57:01.163041 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1970/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:00 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:01.168047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb053fb-07f5-4654-a002-fbd0e92a4088", "tag": "f0a4eb10-3eaf-4037-8591-3d200650b5ea"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:01.183887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.184395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.185024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.185312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.186748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.190165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.190799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.194419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.194877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.233102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:01.234594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] Creating event network-changed:f0a4eb10-3eaf-4037-8591-3d200650b5ea for instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 on n-h2-858495-2 Sep 23 03:57:01.239994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:01.255366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:01.257008 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0ea56587-4c25-42a0-91ba-1e0b761d7538 req-8e0e0688-f956-4380-b381-39aa3fb5185b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084190 Sep 23 03:57:01.258142 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1971/3842] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:01.258577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:01.263914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:01.264615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:01.278671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.281448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.281926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.283843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.284318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.285897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.333052 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91fb1721-ddc6-4377-b403-9dc7bf2d2c90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152180 Sep 23 03:57:01.334477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1872/3843] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:57:01.370663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-caa4f6b4-8921-404d-8e0f-c85a63d12d31 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:01.371522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-caa4f6b4-8921-404d-8e0f-c85a63d12d31 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:01.536251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-caa4f6b4-8921-404d-8e0f-c85a63d12d31 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:01.545321 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-caa4f6b4-8921-404d-8e0f-c85a63d12d31 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1215 microversion: 2.1 time: 0.202214 Sep 23 03:57:01.545953 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1873/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:01 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:01.661410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:01.663509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:01.697924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.702311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.702807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:01.703569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:01.704041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:01.704481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.296207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:02.318444 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3897b456-e5f4-446e-93a4-8a2dca66dfd9 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 1.059026 Sep 23 03:57:02.319052 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1972/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:01 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:02.329939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:02.331993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:02.332566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:02.340884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.341480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.341982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.342859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.343459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.344026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.355003 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c26bb9db-5fa6-4be3-8678-32447d558d2d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.699845 Sep 23 03:57:02.372389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1874/3846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:01 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:02.381159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:02.382396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:02.389748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.390598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.391583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.393376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.394063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.395371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.486356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lazy-loading 'services' on Instance uuid 6014c14c-d670-4333-a033-a26367fa56ad {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:02.623081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4b390b4-03bc-4101-84e5-787458fbdffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments/2b33a329-dd8b-4c44-83a2-eba2ef92ef93" status: 202 len: 0 microversion: 2.1 time: 0.302701 Sep 23 03:57:02.634979 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1973/3847] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 03:57:02 2022] DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments/2b33a329-dd8b-4c44-83a2-eba2ef92ef93 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:02.650517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:02.654695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:02.667380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.668190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.669010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.670138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.671061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.671737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.686282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:02.699782 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e0fb8b5-2eda-473c-af3b-20be67dd0783 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1500 microversion: 2.1 time: 0.325807 Sep 23 03:57:02.724542 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1875/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:02 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1500 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:02.731135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:02.735029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:02.745146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.745703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.746156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.746880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.747460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.749283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.801444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:02.810743 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cdf19dfa-8692-43a9-95dd-2781a481ef60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1267 microversion: 2.1 time: 0.171221 Sep 23 03:57:02.811262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1974/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:02 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:02.812087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e93ac95-0eca-4ad8-a7eb-af15349696d5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085537 Sep 23 03:57:02.812681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1876/3850] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:02 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:02.819196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:02.824244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:02.831906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.832792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.833512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.835179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:02.835925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:02.836555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:02.990223 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93ec843b-6386-4d0e-b2d8-de4acb9ffe97 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8/action" status: 202 len: 0 microversion: 2.1 time: 0.172170 Sep 23 03:57:02.990927 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1975/3851] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:02 2022] POST /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:03.001484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:03.002200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:03.020261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:03.024719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:03.028016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:03.029007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:03.029828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:03.030141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:03.342766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:03.343469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:03.357009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:03.357417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:03.357861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:03.367812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:03.371927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:03.376515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.054661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:04.063050 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef400388-59d9-4222-9ea8-ff6827b50b25 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 0.724657 Sep 23 03:57:04.068003 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1976/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:03 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:04.072990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:04.074140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:04.084922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:04.089001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.089528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.089973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.090683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.091143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.091573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.094263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0768fcec-a3cc-4cff-86da-4b5c6f1837af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1505 microversion: 2.1 time: 1.097322 Sep 23 03:57:04.094853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1877/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:02 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:04.140964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:04.156624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:04.184157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.188269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.188758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.191472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.192747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.194375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.335920 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40fa5d60-944c-4c6c-9823-f866f388cbe2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221183 Sep 23 03:57:04.348466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1878/3854] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:04 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:04.364918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:04.365990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:04.386719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.394485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.395271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.403074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:04.404375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:04.405050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:04.953704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:04.957573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:04.970093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c9c6d74-9e39-4101-94fc-5f9dde0893be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1273 microversion: 2.1 time: 0.617585 Sep 23 03:57:04.971321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1879/3855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:04 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:05.094338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:05.095766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:05.113462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:05.114374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:05.114969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:05.115980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:05.116733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:05.117330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:05.262934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:05.276005 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c3cfa17-517d-4dfb-bc62-1ab88b65e24f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 1.205833 Sep 23 03:57:05.277310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1977/3856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:04 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:05.288579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:05.290013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:05.305072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:05.307853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:05.308347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:05.312052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:05.315578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:05.316246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:06.165029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:06.177875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f94e6373-d123-4f84-9186-14d11bff616e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 1.089502 Sep 23 03:57:06.183027 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1880/3857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:05 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:06.205141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:06.216168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:06.228150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:06.232585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:06.233916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:06.235058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:06.238651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:06.240556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:06.378869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02c889e9-7092-442f-8e94-3e24faab8bf8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194319 Sep 23 03:57:06.379845 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1881/3858] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:06 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:06.397501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:06.399568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:06.425114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:06.427357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:06.429044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:06.430894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:06.431660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:06.432812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.209080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:08.220324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d59bf564-5109-453f-a98d-dda96163e190 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1485 microversion: 2.1 time: 2.941922 Sep 23 03:57:08.264544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1978/3859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:05 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1485 bytes in 2987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:08.271603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:08.272446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:08.290143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.290955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.294599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.295729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.299153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.299792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.608375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:08.622431 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8eb295ed-0def-422b-b1b2-c15955083e90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 2.235207 Sep 23 03:57:08.637796 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1882/3860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:06 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:08.661413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:08.662073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:08.686494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.693146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.694260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.695064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.695595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.695985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.887916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:08.897381 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c719ff6a-90a4-493a-850d-d4fa4adf3914 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.631067 Sep 23 03:57:08.902420 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1979/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:08 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:08.911281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:08.926598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:08.938223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.938722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.942445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:08.943365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:08.946812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:08.947474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.030394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb4d8c5a-8ebb-4b07-ab00-da036f5e09be tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123512 Sep 23 03:57:09.034090 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1980/3862] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:08 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:09.050686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:09.051893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:09.058829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.059908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.064685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.065618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.066250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.066860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.105169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:09.154917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:09.258159 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e3335b9-da62-4d08-95b9-83db61255f20 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 204 len: 0 microversion: 2.1 time: 0.221848 Sep 23 03:57:09.265024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1981/3863] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:09 2022] DELETE /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:57:09.278599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:09.280964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:09.297263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.301670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.302982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.304761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.305718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.307608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.724166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:09.735475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb3b51ba-9237-48da-b725-fddb162d0325 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 1.095829 Sep 23 03:57:09.753779 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1883/3864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:08 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:09.765846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:09.766979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:09.782654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.783344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.784076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:09.785372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:09.788733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:09.789384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.531445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:10.554571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f7744fa-9131-491e-a788-bb9a312d29f7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1491 microversion: 2.1 time: 1.282680 Sep 23 03:57:10.561621 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1982/3865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:09 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1491 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:10.577503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb053fb-07f5-4654-a002-fbd0e92a4088", "name": "network-vif-plugged", "status": "completed", "tag": "f0a4eb10-3eaf-4037-8591-3d200650b5ea"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:10.619022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.620412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.621610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.656867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] Creating event network-vif-plugged:f0a4eb10-3eaf-4037-8591-3d200650b5ea for instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 on n-h2-858495-2 Sep 23 03:57:10.669321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-12dd49f7-eee2-46cf-94e1-399418514709 req-ce97b005-5c8e-4169-af9f-00ca007631c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105189 Sep 23 03:57:10.670407 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1983/3866] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:10.685458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:10.686445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:10.708114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:10.727875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.728686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.729423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.729651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76b249f4-753c-426f-bbcb-25dd2dbaefcc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 0.971742 Sep 23 03:57:10.730985 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1884/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:09 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:10.732031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.732618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.742799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:10.743038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.748489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:10.758564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.758668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.759022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.773023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.775617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.777475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.878870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ebfe794-c21e-400c-9296-252ddc1ebe4f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142924 Sep 23 03:57:10.880905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1885/3868] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:10 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:10.888181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:10.889149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:10.915775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.918559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.920777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:10.921831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:10.927396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:10.928661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:11.224432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:11.541116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:11.649007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:11.662905 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-566d587c-cf98-4c06-afdb-16299b9d4c17 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.990431 Sep 23 03:57:11.664213 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1984/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:10 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:11.670754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:11.671875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:11.678961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:11.680438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:11.681332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:11.683311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:11.690209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:11.691081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:11.911042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:11.923623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2015a2a-4d12-4027-add4-0f2cf705c4bb tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1313 microversion: 2.1 time: 1.041179 Sep 23 03:57:11.924598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1886/3870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:10 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1313 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:11.931145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:11.934435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:11.943731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:11.944473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:11.944915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:11.945841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:11.946298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:11.946923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:12.776151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:12.806475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f28363a1-d247-4877-8bb8-6eacf4ee6aa6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1491 microversion: 2.1 time: 1.138164 Sep 23 03:57:12.811375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1985/3871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:11 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1491 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:12.834837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:12.846487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:12.865307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:12.866338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:12.866933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:12.867915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:12.873342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:12.874718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:12.963001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-825ee5a0-b488-4258-af0e-3e1b73896a06 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147473 Sep 23 03:57:12.969629 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1986/3872] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:12 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:12.979928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c5121e9-aed2-4507-9356-8f4f3c94aa05", "tag": "98d69ed5-7935-4d53-9900-ce2121f6a5ad"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:12.994540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:12.996817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:12.998085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:13.019530 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] Creating event network-changed:98d69ed5-7935-4d53-9900-ce2121f6a5ad for instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 on n-h1-858495-2 Sep 23 03:57:13.028234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fcb3d095-19fa-46ef-b97d-7a8ec67d5222 req-72a600f6-ab38-4cfd-8556-c8cd1e029326 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057794 Sep 23 03:57:13.036731 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1987/3873] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:13.045624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:13.047182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:13.057694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:13.058746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:13.059342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:13.061982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:13.062659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:13.063502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:13.578204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:13.590394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a988a13-f459-41be-9168-11cb5ad1ac3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 1.664518 Sep 23 03:57:13.608805 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1887/3874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:11 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:13.619135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:13.620151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:13.628910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:13.629858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:13.630592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:13.631542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:13.632213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:13.633540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.064154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:14.078155 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b16b9826-ad86-4daa-8c83-23cf52f3535d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1499 microversion: 2.1 time: 0.467443 Sep 23 03:57:14.083235 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1888/3875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:13 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1499 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:14.096023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:14.099597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:14.114711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.118401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.119356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.120286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.122655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.123133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.143127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:14.158331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9de87ab-eeeb-49d6-adc0-1872c1bcc8bb tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 1.119428 Sep 23 03:57:14.160153 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1988/3876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:13 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:14.169619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:14.176260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:14.191424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.193987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.196310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.201280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.202237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.203158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.316811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc41159c-4b24-473a-b73a-4da03b04cd3f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155335 Sep 23 03:57:14.318553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1989/3877] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:57:14 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:57:14.334773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:14.349755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:14.368618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.372264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.373424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.377052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.378109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.378964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.409330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:14.420829 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-778fe87c-5912-43da-89f8-cf796e318abf tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1449 microversion: 2.1 time: 0.332797 Sep 23 03:57:14.426873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1889/3878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:14 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1449 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:14.484353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lazy-loading 'flavor' on Instance uuid 7eb053fb-07f5-4654-a002-fbd0e92a4088 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:14.684580 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-26f95e6e-3e1e-416a-b62d-1fb3bd27f406 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "POST /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088/action" status: 200 len: 32 microversion: 2.1 time: 0.363447 Sep 23 03:57:14.686264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1990/3879] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:14 2022] POST /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:57:14.708771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:14.710131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:14.722029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.722853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.723834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.724852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:14.725622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:14.727462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:14.818893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:14.828825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-204437591", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:14.982671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] validate_networks() for [('6a600d9b-3e70-4d6e-bc25-a8e544c972a5', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:57:15.128569 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e155220-e8a0-4acb-a995-b95266f2a5eb tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 204 len: 0 microversion: 2.1 time: 0.439092 Sep 23 03:57:15.130170 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1991/3880] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:14 2022] DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:57:15.143714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:15.148601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:15.159767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.161278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.165051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:15.168906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.170259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.172498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:15.601805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:15.610835 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b787c3b9-7de6-466e-88cb-dadcb89bc27c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 0.478556 Sep 23 03:57:15.626188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1992/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:15 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:15.636285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:15.636930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:15.647148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.647697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.648084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:15.649114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.649610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.650044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:15.932146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:15.943501 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8296c11a-fa3d-4909-b50a-adb0b2e9d045 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.315878 Sep 23 03:57:15.947925 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1993/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:15 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:15.953907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:15.956125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:15.964294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.966684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.969974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:15.976298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:15.978193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:15.980081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.032058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:16.032592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:16.034033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:16.034629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:16.035201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:16.048570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.049602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.050281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.051431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.052102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.052765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.079771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Getting quotas for project 67b324b095344940aa0a247a9a81976c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:16.086744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Getting quotas for user 7887710dc71a4df0b8c7d441a8aed964 and project 67b324b095344940aa0a247a9a81976c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:16.102381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:16.105886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:16.160865 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fcd268fb-d958-4c9d-a49f-e780cf906de0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732600 Sep 23 03:57:16.162344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1890/3883] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:57:16.173893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:16.174837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:16.184614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.185505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.186174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.187545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.188221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.188939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.486894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:16.490228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:16.503660 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab967681-8579-4f8b-8596-f2482bf7302b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1680 microversion: 2.1 time: 0.553373 Sep 23 03:57:16.504456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1994/3884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:15 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1680 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:16.545872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:16.546609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:16.573755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.574033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.574487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.575281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.586011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.586527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.689490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:16.693648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.694218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.694673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.695140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'fault' on Instance uuid 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:16.736119 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6da79e6d-fb2c-4778-97c7-25402d2fb5e1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.570910 Sep 23 03:57:16.742724 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1891/3885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:16 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:16.772183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f3afb5-28e2-4e6f-b52a-13f884b4fab8", "name": "network-vif-deleted", "tag": "4bc531c6-7395-4d26-88b5-46f2d36d457d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:16.797048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:16.799921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:16.816079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:16.844543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] Creating event network-vif-deleted:4bc531c6-7395-4d26-88b5-46f2d36d457d for instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 on n-h2-858495-2 Sep 23 03:57:16.867351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f072c1e2-08b8-4c5b-90f3-e156d3fb3dad req-092dc35d-e2eb-42e4-82ae-66debda4dafc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118255 Sep 23 03:57:16.868260 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1892/3886] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:16.879174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01b55eda-7f90-4aca-8142-444cfd636995 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:16.882905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01b55eda-7f90-4aca-8142-444cfd636995 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:16.923723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:17.146012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:17.183529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-616910a1-3687-4ca3-834c-afd31aebad3b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 200 len: 1303 microversion: 2.1 time: 0.660584 Sep 23 03:57:17.184200 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1995/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:16 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 1303 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:17.191834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:17.192699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:17.201130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:17.204294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:17.204908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:17.205857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:17.208719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:17.209373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:17.281458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01b55eda-7f90-4aca-8142-444cfd636995 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:17.290460 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01b55eda-7f90-4aca-8142-444cfd636995 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1223 microversion: 2.1 time: 0.420083 Sep 23 03:57:17.294681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1893/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:16 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1223 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:17.317043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:17.319856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:17.340055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:17.343031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:17.343845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:17.348466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:17.349935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:17.351230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:18.343816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:18.352272 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0bffa39c-597f-49f7-85e2-1d44dc449fad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 1.166682 Sep 23 03:57:18.365899 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1996/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:17 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:18.374503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:18.375372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:18.382714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:18.382714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:18.383151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:18.383872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:18.384598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:18.385238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:18.465072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:18.491482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e9e5926c-b62c-46fa-a5b2-ea77c77d4b28 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 1.183119 Sep 23 03:57:18.491482 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1894/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:17 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:18.493143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:18.495524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:18.514248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:18.515189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:18.515879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:18.516861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:18.517591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:18.518265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.568567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:19.576915 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9226f5b6-bbd6-46cc-a73d-4fe18d4df27a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1680 microversion: 2.1 time: 1.209567 Sep 23 03:57:19.579635 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1997/3891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:18 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1680 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:19.584628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:19.585320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:19.591866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.592547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.593157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.594028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.594532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.594952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.614916 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 HTTP/1.1 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '04f3afb5-28e2-4e6f-b52a-13f884b4fab8'} Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:19.617170 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 03:57:19.621650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:19.623100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:19.624150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8cc403c4-62e0-4815-91ee-04afd2c52fa1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 404 len: 111 microversion: 2.1 time: 0.043380 Sep 23 03:57:19.625212 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1998/3892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:19 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:19.630499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:19.631527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:19.639168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:19.641478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.642192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.642837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.643755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.644855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.645519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.784832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:19.796005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-993dcd7b-964d-4bd3-96f5-b599ed90e1d9 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 1.311457 Sep 23 03:57:19.798582 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1895/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:18 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:19.805599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5121e9-aed2-4507-9356-8f4f3c94aa05", "name": "network-vif-plugged", "status": "completed", "tag": "98d69ed5-7935-4d53-9900-ce2121f6a5ad"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:19.815066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:19.824355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03800453-c072-4975-8761-8467eebb5a6c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1281 microversion: 2.1 time: 0.197665 Sep 23 03:57:19.824949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 1999/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:19 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1281 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:19.827324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.827817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.828250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.852469 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] Creating event network-vif-plugged:98d69ed5-7935-4d53-9900-ce2121f6a5ad for instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 on n-h1-858495-2 Sep 23 03:57:19.855095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:19.858458 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-88b9d059-0919-446c-87ae-bb881a027058 req-917174c3-db20-4c7c-b5f2-6e5729d03e3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057527 Sep 23 03:57:19.859483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:19.859622 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1896/3895] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:19.867118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:19.868055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:19.875068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.875421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.875911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.876506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.877657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.878266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.878383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.878748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.879322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:19.881667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:19.882181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:19.882624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:20.411053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:20.423997 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52c3be64-13ff-4eeb-9930-912b92f6cce4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.562176 Sep 23 03:57:20.425654 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1897/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:19 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:20.433127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1419242695", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:20.471694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:20.480860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-43105b5f-f1b8-41b4-ad0c-39ad26ee9da2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1315 microversion: 2.1 time: 0.636688 Sep 23 03:57:20.486385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2000/3897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:19 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:20.567865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:57:20.601747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:20.602344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:20.617442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:20.618213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:20.618655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:20.619937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:20.620403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:20.620833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:20.892903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:20.902279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e5cb48a-01f3-4d0e-8091-70d611e8b7e7 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1612 microversion: 2.1 time: 0.304564 Sep 23 03:57:20.902872 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2001/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:20 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1612 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:20.921890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:20.922721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:20.929794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:20.930518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:20.931135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:20.932591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:20.933199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:20.933809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.368548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:21.385294 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-74d1cdc5-108b-4d79-b2b5-31f91a078f31 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.473960 Sep 23 03:57:21.413983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2002/3899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:20 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:21.425866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:21.432748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:21.445679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.446448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.448339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.449770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.450586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.451178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.616990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:21.631523 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f292460c-4cd4-4f30-a941-95472468847b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1281 microversion: 2.1 time: 0.215969 Sep 23 03:57:21.632135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2003/3900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:21 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:21.646601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:21.647620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:21.654457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.655213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.655825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.656825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.657504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.658114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.957897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:21.958428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:21.959405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:21.959821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:21.960239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:21.979508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.980264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.980869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:21.981789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:21.985373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:21.986023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.061475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:22.069314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:22.101186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:22.104156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:22.200634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:22.214217 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cde929fd-2ee6-4bd3-b8c2-032dcf2ba821 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.783816 Sep 23 03:57:22.221456 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1898/3901] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:57:22.227496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:22.228357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:22.231976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50a4fa61-d450-4ad5-96bd-05c8aa610810 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.595499 Sep 23 03:57:22.232632 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2004/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:21 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:22.254246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.255602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.256767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.258305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.258990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.260149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.268272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6014c14c-d670-4333-a033-a26367fa56ad", "name": "network-vif-deleted", "tag": "809d0bdd-d415-41c3-9771-3761b2a3f136"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:22.304370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.304840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.305276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.348167 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] Creating event network-vif-deleted:809d0bdd-d415-41c3-9771-3761b2a3f136 for instance 6014c14c-d670-4333-a033-a26367fa56ad on n-h2-858495-2 Sep 23 03:57:22.358225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d1c52487-c98d-4524-8998-95b2c4dc3e42 req-9a7dc161-1d46-4a05-832f-a2dd01ced6c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118510 Sep 23 03:57:22.363202 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2005/3903] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:22.375683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:22.378295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:22.387734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.388468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.389066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.389973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.390575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.391170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.433469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:22.434209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:22.434991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:22.435589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lazy-loading 'fault' on Instance uuid 6014c14c-d670-4333-a033-a26367fa56ad {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:22.659926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:22.668269 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f29ee90-ae2f-406c-85f5-eabec711224b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 200 len: 1331 microversion: 2.1 time: 0.302476 Sep 23 03:57:22.672227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2006/3904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:22 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 1331 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:22.680581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afd871bb-6e47-4a86-bbc7-626be3cdfa00 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:22.686825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-afd871bb-6e47-4a86-bbc7-626be3cdfa00 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:23.388702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-afd871bb-6e47-4a86-bbc7-626be3cdfa00 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:23.407515 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-afd871bb-6e47-4a86-bbc7-626be3cdfa00 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1215 microversion: 2.1 time: 0.733691 Sep 23 03:57:23.408888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2007/3905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:22 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1215 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:23.415036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:23.415893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:23.423285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:23.424038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:23.424642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:23.425648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:23.426262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:23.426855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:23.439230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:23.450332 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a0075b1-6a81-4c26-830b-618a186e75b8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1501 microversion: 2.1 time: 1.227338 Sep 23 03:57:23.451134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1899/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:22 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1501 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:23.456926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:23.457735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:23.464540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:23.465904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:23.466724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:23.487888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:23.492965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:23.496305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:23.501343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:24.047932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:24.057445 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e0494be5-b06a-4f9d-bbde-5a3cd17f073b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1510 microversion: 2.1 time: 0.646076 Sep 23 03:57:24.059689 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2008/3907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:23 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1510 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:24.071125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:24.072554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:24.088459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.090642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.095854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.096693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.097245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.097796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.256243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:24.270289 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-077da6c1-a06b-4f24-87cd-63b03d8082fd tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.817987 Sep 23 03:57:24.271037 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1900/3908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:23 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:24.278967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:24.299598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.302052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.302758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.334761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 03:57:24.421775 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d897b959-1e3e-4b7c-b3f6-32b4eea79899 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05/action" status: 202 len: 0 microversion: 2.1 time: 0.148617 Sep 23 03:57:24.423939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1901/3909] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:24 2022] POST /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:24.435149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:24.435868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:24.455382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.461547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.462016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.462857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.463333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.463771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.497574 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad HTTP/1.1 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6014c14c-d670-4333-a033-a26367fa56ad'} Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:24.513084 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 03:57:24.517391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:24.528835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:24.534556 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f317534-4ea5-47e2-9ae8-64860c2e8dd8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 404 len: 111 microversion: 2.1 time: 0.109371 Sep 23 03:57:24.542269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1902/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:24 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:24.574299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:24.591670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:24.631095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.631677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.635307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.636603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.640817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.642797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.927492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:24.942918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:24.943547 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45cd3af3-2dcc-432d-bf36-e6494d344102 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1285 microversion: 2.1 time: 0.397971 Sep 23 03:57:24.964898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc0d69a4-6c91-4048-9caa-cefb85d1aa04 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.901181 Sep 23 03:57:24.968368 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2009/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:24 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:24.968504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1903/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:24 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1285 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:24.974419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:24.975180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:24.982073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.982867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.983488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.984256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:24.985321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:24.985800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:24.989804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32a5c58c-56d8-40c5-9ffd-0f1553ecd62a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '.version_select at 0x7f0c8ab14310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:25.030838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32a5c58c-56d8-40c5-9ffd-0f1553ecd62a tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869624744" status: 202 len: 0 microversion: 2.1 time: 0.061096 Sep 23 03:57:25.036253 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1904/3913] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:57:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869624744 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:25.085980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:25.087109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:25.105266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.107485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.110127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.112436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.114983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.115636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.295729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:25.316648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03e1e786-e060-4253-a55d-68c36961287e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.337312 Sep 23 03:57:25.328344 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2010/3914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:24 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:25.336925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:25.338171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:25.368758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.369266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.371094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.372217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.372688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.373178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.486006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:25.497771 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93c164fa-68d3-4708-a2ff-09f7cd2a5e21 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1487 microversion: 2.1 time: 0.417948 Sep 23 03:57:25.498965 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1905/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:25 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1487 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:25.521585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1088095792"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:25.524078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:25.530742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.531315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.531919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.532792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.533415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.534004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.624817 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b76e2f3-8c0a-41aa-bd78-f815cc110425 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "PUT /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1060 microversion: 2.1 time: 0.107407 Sep 23 03:57:25.640794 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1906/3916] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 03:57:25 2022] PUT /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1060 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:25.648455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:25.651255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:25.659281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.660014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.660471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.661465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.661878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.663314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:25.944891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:25.955094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-85944feb-e2e5-4d2d-b768-4dc6d92814d3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.625566 Sep 23 03:57:25.956453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2011/3917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:25 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:25.976672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:25.981210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:25.996160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:25.996663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:25.999269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.002496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.003354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.004040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.173319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:26.182406 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d0085b9-2380-4f7c-a2be-6faed079b2ad tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1273 microversion: 2.1 time: 0.216383 Sep 23 03:57:26.193075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2012/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:25 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:26.193075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:26.193075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:26.197585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.198350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.199117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.200042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.200704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.201366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.205936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:26.294401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:26.303010 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21257ff5-c1c6-4cc0-9146-5f08a5c25c9c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1487 microversion: 2.1 time: 0.660072 Sep 23 03:57:26.317190 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1907/3919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:25 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1487 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:26.317190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9540e210-0bef-4202-86f6-3f9156155c6f", "tag": "dcd7845b-4aa9-46d3-aa3e-4b00c221386b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:26.320391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.321467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.322541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.337096 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] Creating event network-changed:dcd7845b-4aa9-46d3-aa3e-4b00c221386b for instance 9540e210-0bef-4202-86f6-3f9156155c6f on n-h2-858495-2 Sep 23 03:57:26.343285 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4f25a248-32ec-40b7-9e28-57f1ebdf3444 req-052bfdf4-3299-4a87-84a1-dd3c2b4d758c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 Sep 23 03:57:26.344614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1908/3920] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:26.360807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b8d236e-acc1-4f5e-94ef-6b678cf0ba98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: .version_select at 0x7f0c8a305a60>, body: {"keypair": {"name": "tempest-keypair-738579876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwI5L6iLxP6xsJvt5Bh0gohCL0cIbg5PgLIduqiK+B9C3wj8i/gVacIuZUgs+Lzwze5NGfI4oHpBYBy2aJkjxb8XLOx5oOlx1ZYA/woYWChAKaSm3jVgOzlSuL3v3wLMg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:26.380909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7b8d236e-acc1-4f5e-94ef-6b678cf0ba98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:26.391570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-7b8d236e-acc1-4f5e-94ef-6b678cf0ba98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:26.426888 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b8d236e-acc1-4f5e-94ef-6b678cf0ba98 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080714 Sep 23 03:57:26.434127 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1909/3921] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:57:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:26.434127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:26.438333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:26.445978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.448677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.449332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.450418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.451081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.451705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.590697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:26.606603 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39926f57-859d-492e-9290-98c8fc3fe1e0 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.416362 Sep 23 03:57:26.608076 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2013/3922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:26 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:26.622685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:26.625118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:26.637953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.638519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.638893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.639610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:26.640056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:26.640482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:26.955661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:26.969465 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0659bcea-a99d-4509-bd02-4c9eabf7b1c1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1487 microversion: 2.1 time: 0.540426 Sep 23 03:57:26.970147 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1910/3923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:26 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1487 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:27.017002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:27.017691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:27.047122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.048732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.049205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.053128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.053976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.060785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.677154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:27.689858 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d646fda2-2b17-4308-ad44-4408846b78f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 1.079643 Sep 23 03:57:27.691135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2014/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:26 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:27.697984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:27.699108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:27.706449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.707333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.708181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.710155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.710863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.711528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.770097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:27.838298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:27.846941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6486f33c-555a-47ea-b11e-2f1e5d51b11d tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.844586 Sep 23 03:57:27.850163 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1911/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:26 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:27.867730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:27.868355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:27.875279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.875784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.876231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.876948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.877703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.878139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.933304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dcdf65a-4a8c-4a77-81e0-d8639641986f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 204 len: 0 microversion: 2.1 time: 0.238825 Sep 23 03:57:27.938325 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2015/3926] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:27 2022] DELETE /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:57:27.944140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:27.945055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:27.953164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.954489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.955115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:27.955996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:27.956622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:27.957203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:28.282055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:28.292547 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0ea9fbec-0b89-43f6-a809-98832b20b70e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.440880 Sep 23 03:57:28.299030 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1912/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:27 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:28.311240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:28.312482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:28.324866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:28.325752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:28.330199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:28.331268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:28.331932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:28.332563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:28.357280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:28.369707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a321050d-b454-4102-b898-c3b79663a768 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.426125 Sep 23 03:57:28.370841 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2016/3928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:27 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:28.618980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-510734801", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477af16e-1c5b-4384-8f7b-9015a1b1fdab"}], "security_groups": [{"name": "tempest-securitygroup--974524457"}], "key_name": "tempest-keypair-738579876", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:28.674102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:28.681930 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f3da19a-6c5e-4101-9b2d-8bae265c822f tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1493 microversion: 2.1 time: 0.381602 Sep 23 03:57:28.682510 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1913/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:28 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1493 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:28.718506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:28.719933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:28.728103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:28.728836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:28.729538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:28.731117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:28.731991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:28.732892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:28.816696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] validate_networks() for [('477af16e-1c5b-4384-8f7b-9015a1b1fdab', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:57:29.082098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:29.091565 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-894b9613-c546-465e-ba56-222c8b659143 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.377378 Sep 23 03:57:29.094238 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1914/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:28 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:29.115201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:29.115863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:29.134505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:29.135103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:29.135755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:29.136559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:29.137155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:29.137990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:29.489550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:29.497295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43af2b0d-ac97-49ca-9b40-fdf414e025f7 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.401699 Sep 23 03:57:29.501856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1915/3931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:29 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:29.506968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:29.515839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:29.536570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:29.537312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:29.537924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:29.538791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:29.539403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:29.540007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.014444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:30.014963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:30.015354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:30.015770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:30.016197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:30.032350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.037560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.038029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.038987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.039486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.039929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.083601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:30.092355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:30.101476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:30.117798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:30.118297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b4aa6c8f-b19f-4d81-b8c6-f5f37930556f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.614890 Sep 23 03:57:30.118946 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1916/3932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:29 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:30.122101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:30.139530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:30.142920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:30.156911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.157804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.158405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.174272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.174775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.175222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.253148 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06b633c7-83f2-44cb-b6da-6b598c8ef015 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.641872 Sep 23 03:57:30.262999 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2017/3933] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:57:30.270295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:30.276776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:30.284172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.284671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.285710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.286686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.287354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.287953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.328962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.329758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.330388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.331178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lazy-loading 'fault' on Instance uuid 995a9025-d86f-4f31-a05c-9702b9cb06d1 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:30.536351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:30.546045 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56978bda-3cc6-4db7-af42-81438427c39d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 200 len: 1310 microversion: 2.1 time: 0.281528 Sep 23 03:57:30.550167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2018/3934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:30 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:30.561433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e346b663-e628-4790-b102-70ead520bcef", "tag": "e2ed51b2-15d4-4606-a5ce-7f2652c6c96a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:30.582378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.583117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.583619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.595420 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] Creating event network-changed:e2ed51b2-15d4-4606-a5ce-7f2652c6c96a for instance e346b663-e628-4790-b102-70ead520bcef on n-h1-858495-2 Sep 23 03:57:30.600547 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-32da0717-87ce-44ec-842c-e1a820003a28 req-64f73b9f-4709-4a78-96e9-ef1dac7a2d0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048925 Sep 23 03:57:30.601622 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2019/3935] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:30.607504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995a9025-d86f-4f31-a05c-9702b9cb06d1", "name": "network-vif-deleted", "tag": "c1cb791f-0647-4e8c-b31f-2171bd13cf24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:30.620589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.621075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.621561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.643556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] Creating event network-vif-deleted:c1cb791f-0647-4e8c-b31f-2171bd13cf24 for instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 on n-h1-858495-2 Sep 23 03:57:30.651286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d3ecbf37-aaf2-4c28-9649-ebab944ad91b req-fde1ca16-e468-4b1f-8e14-594b80961d99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047133 Sep 23 03:57:30.652538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2020/3936] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:30.686447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:30.687900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:30.704880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.706037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.706653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.707563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:30.708168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:30.710364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:30.872624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:30.882820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-904d1105-ffd4-46a1-a5d3-6d4877bb1a30 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.762811 Sep 23 03:57:30.886320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1917/3937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:30 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:30.910869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a88e561-50df-4531-84b9-c837f96bbc24 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:30.911494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7a88e561-50df-4531-84b9-c837f96bbc24 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:31.096839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7a88e561-50df-4531-84b9-c837f96bbc24 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:31.105630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a88e561-50df-4531-84b9-c837f96bbc24 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1240 microversion: 2.1 time: 0.218111 Sep 23 03:57:31.109621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1918/3938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:30 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:31.116158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:31.118051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:31.139755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:31.140605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:31.141269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:31.142289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:31.143099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:31.144082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:31.200826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:31.302492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:31.322261 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e02a1aea-a38f-4e77-979b-db7de28b2cd5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.668489 Sep 23 03:57:31.323315 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2021/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:30 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:31.327794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:31.328395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:31.343505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:31.344219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:31.344942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:31.346233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:31.346868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:31.347440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.029945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:32.131724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:32.153849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3e17499-0440-4e3e-8d17-5b1fc8f4eef3 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 1.042840 Sep 23 03:57:32.167676 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1919/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:31 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:32.172627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.182564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.199949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.201098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.202848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.205600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.206448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.207296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.228025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:32.233338 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 HTTP/1.1 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '995a9025-d86f-4f31-a05c-9702b9cb06d1'} Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.236631 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.240242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.240891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04901dd5-8205-4350-9d11-ce9251cf86bd tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.912934 Sep 23 03:57:32.240971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e251cf1-9a15-4db5-86ce-8b48202741f8 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 404 len: 111 microversion: 2.1 time: 0.069230 Sep 23 03:57:32.240971 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1920/3941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.241092 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2022/3942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:31 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:32.258177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.259562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.266975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.268095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.273618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.274365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.274929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.275842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.275988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.276598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.276816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.277241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.278244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.279132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.279746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.281775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.475916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:32.484947 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-acd5ad77-45c3-451c-8cca-48e08a3436b6 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1300 microversion: 2.1 time: 0.243090 Sep 23 03:57:32.485988 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2023/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:32.491839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.492342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.499395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.499897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.500618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.501301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.501773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.502623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.532952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 HTTP/1.1 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '995a9025-d86f-4f31-a05c-9702b9cb06d1'} Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.536158 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.539528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.541042 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-508636f1-0b77-49a3-a981-27369d4cb44c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 404 len: 111 microversion: 2.1 time: 0.052830 Sep 23 03:57:32.542279 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2024/3944] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:32 2022] DELETE /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.549951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.552033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.561123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.562246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.562801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.563877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.564633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.565276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.643023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:32.658797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb60e722-14d5-46a8-aecf-41e7b20309e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.402695 Sep 23 03:57:32.659845 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1921/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:32.664623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.666275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 995a9025-d86f-4f31-a05c-9702b9cb06d1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.679335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.680162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.680690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.682093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.682814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.685519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.702457 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 HTTP/1.1 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '995a9025-d86f-4f31-a05c-9702b9cb06d1'} Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.704550 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.708909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 995a9025-d86f-4f31-a05c-9702b9cb06d1 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.717450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a97f8fa1-1150-41b2-9295-8857f8627ba7 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1" status: 404 len: 111 microversion: 2.1 time: 0.056252 Sep 23 03:57:32.718294 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1922/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/995a9025-d86f-4f31-a05c-9702b9cb06d1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.727537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.729164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.739899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.740536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.741264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.741906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.742600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.745096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.766956 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 HTTP/1.1 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '957b7f2f-31b4-4baa-8077-00a5beaeef47'} Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.770731 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6c6bfb40-bf5c-4ca5-9d35-4d48d5f4f1da tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 404 len: 111 microversion: 2.1 time: 0.049754 Sep 23 03:57:32.775280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1923/3947] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:32 2022] DELETE /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:57:32.783423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.784464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 957b7f2f-31b4-4baa-8077-00a5beaeef47] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.791624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.792112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.792550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.793246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.793735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.794155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.815378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 HTTP/1.1 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '957b7f2f-31b4-4baa-8077-00a5beaeef47'} Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.820865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 957b7f2f-31b4-4baa-8077-00a5beaeef47 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81dbd0bd-0b49-4e2a-b733-2b1211f3e4c6 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47" status: 404 len: 111 microversion: 2.1 time: 0.045383 Sep 23 03:57:32.824869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1924/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/957b7f2f-31b4-4baa-8077-00a5beaeef47 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.835067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.835639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.846007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:32.861834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a66b5df-6e44-4617-80d1-b601b7c6cfb1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.318007 Sep 23 03:57:32.862990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.864383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.865490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.866162 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2025/3949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:32.878810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.879329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.879815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.904965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd HTTP/1.1 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'daee3c1f-38c6-49ea-a0c3-3a631f8132bd'} Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.906669 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.910126 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c95bf79-be8f-49e5-afae-ccd32a14ce16 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 404 len: 111 microversion: 2.1 time: 0.077478 Sep 23 03:57:32.911492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1925/3950] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:32 2022] DELETE /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.918835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.919688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: daee3c1f-38c6-49ea-a0c3-3a631f8132bd] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.929999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.931532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.932152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.933814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.934532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.935640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.954430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd HTTP/1.1 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'daee3c1f-38c6-49ea-a0c3-3a631f8132bd'} Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:32.956499 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. Sep 23 03:57:32.960556 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:32.961011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance daee3c1f-38c6-49ea-a0c3-3a631f8132bd could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:32.962496 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7504f1a2-9759-413f-9cd4-de40d3f7081b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd" status: 404 len: 111 microversion: 2.1 time: 0.049079 Sep 23 03:57:32.963319 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2026/3951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:32 2022] GET /compute/v2.1/servers/daee3c1f-38c6-49ea-a0c3-3a631f8132bd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:32.972353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:32.972850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:32.985550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.987020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.987961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:32.988694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:32.989159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:32.989643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.013684 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 HTTP/1.1 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '68b314f4-c223-4f76-aebb-d556dfccf369'} Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:33.021888 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d14dd4d-7e31-4838-8ada-0ec6515896a1 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 404 len: 111 microversion: 2.1 time: 0.055347 Sep 23 03:57:33.030740 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1926/3952] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:32 2022] DELETE /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:33.037904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.038616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 68b314f4-c223-4f76-aebb-d556dfccf369] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.050601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.051106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.051559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.052640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.052735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.053204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.073653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 HTTP/1.1 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '68b314f4-c223-4f76-aebb-d556dfccf369'} Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.075446 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 68b314f4-c223-4f76-aebb-d556dfccf369 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:33.080287 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9db13cb-662b-4c94-b30d-a1ced23b1ca3 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369" status: 404 len: 111 microversion: 2.1 time: 0.049893 Sep 23 03:57:33.081479 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2027/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:33 2022] GET /compute/v2.1/servers/68b314f4-c223-4f76-aebb-d556dfccf369 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:57:33.093424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.098657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.126034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.126529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.128746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.132468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.133171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.133853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.175850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d HTTP/1.1 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2dd3dacc-3679-4c59-9983-65ee0125e42d'} Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:33.177732 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.182201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:33.183834 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b3156d6-01ef-41a3-b137-795128fc634e tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 404 len: 111 microversion: 2.1 time: 0.097541 Sep 23 03:57:33.187457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1927/3954] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:33 2022] DELETE /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:33.206432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.207055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 2dd3dacc-3679-4c59-9983-65ee0125e42d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.221340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.221921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.224052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.229276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.230317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.231273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.234301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.234748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.245039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.245475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.245920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.246733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.247077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.247508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.290893 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d HTTP/1.1 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2dd3dacc-3679-4c59-9983-65ee0125e42d'} Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.293193 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. Sep 23 03:57:33.296930 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.298837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 2dd3dacc-3679-4c59-9983-65ee0125e42d could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:33.300000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c12242c-885b-4518-8af4-ecc8d0ce0923 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d" status: 404 len: 111 microversion: 2.1 time: 0.097703 Sep 23 03:57:33.301092 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2028/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:33 2022] GET /compute/v2.1/servers/2dd3dacc-3679-4c59-9983-65ee0125e42d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:33.307481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.308170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.317391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.318220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.319231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.320263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.321179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.322018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.646116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:33.656514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da9291a1-0560-4e01-a989-705667099b92 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.354313 Sep 23 03:57:33.657323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2029/3956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:33 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:33.679050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.680440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.689081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.689862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.690532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.691390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.691990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.692560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.708197 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 HTTP/1.1 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd53178cd-e691-4857-96c1-4b22ee4dcef4'} Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:33.710142 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:33.715649 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:33.719067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:33.720123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb66b0a3-0633-4d09-bc7a-928eedaa5a1a tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 404 len: 111 microversion: 2.1 time: 0.049251 Sep 23 03:57:33.720872 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2030/3957] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:33 2022] DELETE /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:33.726079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e210-0bef-4202-86f6-3f9156155c6f", "name": "network-vif-plugged", "status": "completed", "tag": "dcd7845b-4aa9-46d3-aa3e-4b00c221386b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:33.740107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.740826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.741510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.780255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] Creating event network-vif-plugged:dcd7845b-4aa9-46d3-aa3e-4b00c221386b for instance 9540e210-0bef-4202-86f6-3f9156155c6f on n-h2-858495-2 Sep 23 03:57:33.789119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b23e6eb7-2425-4ca6-bf60-b6852cca747e req-7caa9935-c3db-4f08-ac5f-452edf7b6d5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066499 Sep 23 03:57:33.790604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2031/3958] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:33.803744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:33.804705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:33.813735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.814328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.815213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:33.816019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:33.816792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:33.817404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.391716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:34.410570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-725c1028-80a5-40f9-93fd-2dff046c2ab6 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 1.194835 Sep 23 03:57:34.412641 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1928/3959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:33 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:34.441545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:34.442543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:34.445726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:34.459958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.463006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.463697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.465259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.467071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.467718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.533386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:34.542666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adab724c-e847-44f5-a536-af2cb3c43329 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.750211 Sep 23 03:57:34.543251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2032/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:33 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:34.558346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:34.559581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: d53178cd-e691-4857-96c1-4b22ee4dcef4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:34.576886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.577405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.577852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.578566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.579031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.579451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.599785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 HTTP/1.1 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd53178cd-e691-4857-96c1-4b22ee4dcef4'} Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:34.613626 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance d53178cd-e691-4857-96c1-4b22ee4dcef4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-08cb0340-cf35-43e9-9cd8-7acf2e1d05ee tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4" status: 404 len: 111 microversion: 2.1 time: 0.066632 Sep 23 03:57:34.621383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2033/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:34 2022] GET /compute/v2.1/servers/d53178cd-e691-4857-96c1-4b22ee4dcef4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:34.637758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:34.638483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:34.645698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.646269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.650109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.652039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.652921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.654850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.694245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:34.932653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:34.953627 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87d29eb4-06c2-41c1-98d4-0b451bda8546 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.538185 Sep 23 03:57:34.956150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1929/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:34 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:34.963139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:34.963923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:34.971267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.972047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.972761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:34.973956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:34.974769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:34.975359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.006012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 HTTP/1.1 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '9bdd0e9a-43bc-4a94-ad22-02eb491cd900'} Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:35.009960 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.014368 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.017627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:35.018764 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf0cc114-52fd-4644-bb44-5a4fbff68581 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900" status: 404 len: 111 microversion: 2.1 time: 0.060857 Sep 23 03:57:35.020040 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1930/3963] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:34 2022] DELETE /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:35.027589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.028422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.037097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.038652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.041020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.042477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.044407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.045214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.114270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:35.132073 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53528684-e804-4c89-96d5-ffb36c008058 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.506486 Sep 23 03:57:35.133326 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2034/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:34 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:35.140838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.148225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 9bdd0e9a-43bc-4a94-ad22-02eb491cd900] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.154905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:35.180708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.181555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.182004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.182757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.183197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.183630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.213910 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 HTTP/1.1 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9bdd0e9a-43bc-4a94-ad22-02eb491cd900'} Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:35.216207 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. Sep 23 03:57:35.219664 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:35.221922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 9bdd0e9a-43bc-4a94-ad22-02eb491cd900 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:35.222917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60b80e02-6e12-4f66-8898-743585b0a837 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900" status: 404 len: 111 microversion: 2.1 time: 0.087919 Sep 23 03:57:35.227196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2035/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/9bdd0e9a-43bc-4a94-ad22-02eb491cd900 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:35.232912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.233572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.240684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.241458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.242113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.243064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.244264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.244897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.281291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:35.436492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b70028f-a490-4ca2-93cc-b40bdddbf352 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 204 len: 0 microversion: 2.1 time: 0.206593 Sep 23 03:57:35.437296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2036/3966] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:35 2022] DELETE /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:57:35.447788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.448998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.455419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.473389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.473842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.474594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.475069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.475481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.506830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:35.517297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f371546f-990d-4bc1-8ade-2853047f8956 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.495976 Sep 23 03:57:35.518602 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1931/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:35.523963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.524815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.532689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.533612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.534286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.535458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.536631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.537384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.856253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:35.881284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60dafce5-bf38-4711-b7ed-36c6380aafa2 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.438948 Sep 23 03:57:35.888148 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2037/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:35.899258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.900447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.917154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.917752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.918210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.918965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.919428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.919861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.932747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:35.940608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e870d956-00cf-4505-b438-83190731f5ff tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1478 microversion: 2.1 time: 0.420323 Sep 23 03:57:35.944251 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1932/3969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1478 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:35.978730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:35.979274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:35.986445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.986825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.987271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:35.988427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:35.988898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:35.989335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.204239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:36.212533 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8bedcbf6-5e75-47ed-bc17-affb3d26642e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.323289 Sep 23 03:57:36.213151 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2038/3970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:36.229671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:36.230677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:36.245701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.246616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.250318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.251701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.253038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.253749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.267201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:36.279332 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd402688-fded-491e-8988-96529b0d7849 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.305036 Sep 23 03:57:36.289704 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1933/3971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:35 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:36.302541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f778b652-a107-41b7-b3b9-d193fc529f4e", "tag": "2cbc9039-9dd6-46f2-83df-677a04460e3c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:36.326001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.326625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.327221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.345312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] Creating event network-changed:2cbc9039-9dd6-46f2-83df-677a04460e3c for instance f778b652-a107-41b7-b3b9-d193fc529f4e on n-h2-858495-2 Sep 23 03:57:36.353726 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fb787d12-39a1-4a3d-a02e-f079af074c40 req-59c91829-a965-4019-abfd-f33f494459f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054122 Sep 23 03:57:36.354790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1934/3972] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:57:36.497299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:36.505889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f8a48b2-17ac-48e1-9a58-c65557b3c857 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.290262 Sep 23 03:57:36.506470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2039/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:36 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:36.544839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:36.546001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:36.553122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.553634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.554076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.554939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.555631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.556225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.707473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:36.717675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-12c203b4-a11b-4022-b129-a418a505833a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.176818 Sep 23 03:57:36.718292 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1935/3974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:36 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:36.913788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:36.915960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:36.922180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.922884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.923513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.924416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.925111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.925727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.969473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:36.970262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:36.978654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.979147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.979586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:36.987184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:36.987693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:36.988146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:37.194233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:37.205566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-59c9fdb1-c35e-4e72-8240-5c3563b3c1e5 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1323 microversion: 2.1 time: 0.296942 Sep 23 03:57:37.206385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2040/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:36 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:37.236278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:37.236894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:37.252345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:37.252856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:37.253291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:37.254325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:37.255038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:37.255850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:37.283396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:37.293417 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd9f404f-3e63-43d6-aed7-d2adc6aacd1b tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1478 microversion: 2.1 time: 0.328031 Sep 23 03:57:37.297595 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1936/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:36 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1478 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:37.312048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:37.313508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:37.329763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:37.333814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:37.334585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:37.336775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:37.338031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:37.338743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.090239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:38.100447 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3a22e57b-bffb-4ab0-8581-c9ecf536819d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.868645 Sep 23 03:57:38.101676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2041/3977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:37 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:38.107676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:38.108536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:38.115355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.115902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.116582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.117711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.118821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.119330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.284994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:38.298405 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-688507dd-63cf-494b-a28a-319d21fdc73e tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.990647 Sep 23 03:57:38.299591 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1937/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:37 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:38.304416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346b663-e628-4790-b102-70ead520bcef", "name": "network-vif-plugged", "status": "completed", "tag": "e2ed51b2-15d4-4606-a5ce-7f2652c6c96a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:38.315069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.315963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.316546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.332147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] Creating event network-vif-plugged:e2ed51b2-15d4-4606-a5ce-7f2652c6c96a for instance e346b663-e628-4790-b102-70ead520bcef on n-h1-858495-2 Sep 23 03:57:38.339242 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6395f96e-9c13-4937-aa58-c87bcfa09cb8 req-111700f6-bcc1-4d66-b628-41ad2f371e79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038198 Sep 23 03:57:38.340401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1938/3979] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:38.354478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:38.355563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:38.365002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.366324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.366968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.380651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.384924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.387485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.913695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:38.926142 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbfd127a-aa80-4d23-b7c9-57e4124ff1d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.822132 Sep 23 03:57:38.926962 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2042/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:38 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:38.931624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:38.932233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:38.950821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.951315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.951958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:38.952907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:38.953410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:38.961308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.029529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:39.039071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02159524-e390-4ffe-9c64-08f207968545 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1315 microversion: 2.1 time: 0.697160 Sep 23 03:57:39.039666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1939/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:38 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:39.045427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:39.046286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:39.052549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.053334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.054012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.056824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.058352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.059015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.458521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:39.469771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af39fc59-6192-457a-be86-9f0effd3d65f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1519 microversion: 2.1 time: 0.541608 Sep 23 03:57:39.471079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2043/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:38 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1519 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:39.486768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:39.487749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:39.503088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.503830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.505904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.506907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.509817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.510733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.630292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:39.644965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0c4dd4d-72c1-436c-b865-0d5d2b2545fa tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1478 microversion: 2.1 time: 0.603736 Sep 23 03:57:39.649862 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1940/3983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:39 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1478 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:39.668692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:39.669321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:39.693296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.699131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.701009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:39.704676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:39.705180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:39.705663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.061413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:40.111063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:40.320683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:40.333948 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a014f3b-11f6-4dcb-a865-a972c4dbf511 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.682564 Sep 23 03:57:40.334705 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1941/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:39 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:40.338926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:40.348255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6761533-42d4-455d-88df-f458feb326c0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.874429 Sep 23 03:57:40.350062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18c6aeb7-407b-4714-85d5-5d1cb9ac7cbe tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-757790532", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18c6aeb7-407b-4714-85d5-5d1cb9ac7cbe tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 242 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-757790532", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-757790532', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6a600d9b-3e70-4d6e-bc25-a8e544c972a5'}]}}} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:57:40.357620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:40.361118 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.362842 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2044/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:39 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:40.369526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18c6aeb7-407b-4714-85d5-5d1cb9ac7cbe tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:40.373087 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18c6aeb7-407b-4714-85d5-5d1cb9ac7cbe tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.033960 Sep 23 03:57:40.375049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:40.375696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:40.379685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1942/3986] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:40 2022] POST /compute/v2.1/servers => generated 175 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:57:40.383259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.384021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.384678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:40.384907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.385293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:40.386052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.386852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.387441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.407544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.408057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.408504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.409228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.409722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.410285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.680373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:40.697290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a52197c-9e82-4399-95bf-e22aeeced9dd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.333842 Sep 23 03:57:40.703260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2045/3987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:40 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:40.709901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:40.712940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 1e0227fa-a605-41f1-b96c-03021a74fee5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:40.727888 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] HTTP exception thrown: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/1e0227fa-a605-41f1-b96c-03021a74fee5/metadata HTTP/1.1 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '1e0227fa-a605-41f1-b96c-03021a74fee5'} Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:40.741885 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:40.746246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:40.746246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:40.746246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. Sep 23 03:57:40.746246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:40.746814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 404 to user: Instance 1e0227fa-a605-41f1-b96c-03021a74fee5 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:40.747794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20b1143d-07d8-4b35-bc12-2a5fc5fbdf54 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0227fa-a605-41f1-b96c-03021a74fee5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043429 Sep 23 03:57:40.748476 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2046/3988] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:57:40 2022] GET /compute/v2.1/servers/1e0227fa-a605-41f1-b96c-03021a74fee5/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:40.753650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5adbf9-921c-4983-ba38-fb92f91cbe41", "name": "network-vif-deleted", "tag": "b3e53cd3-370b-4b26-beef-e56e519f1034"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:40.778799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.780775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.783440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.788023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:40.792383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:40.800495 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-469ad3c6-517e-4363-a64d-702842923b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1502 microversion: 2.1 time: 0.419529 Sep 23 03:57:40.801716 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] Creating event network-vif-deleted:b3e53cd3-370b-4b26-beef-e56e519f1034 for instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 on n-h2-858495-2 Sep 23 03:57:40.803431 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1943/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:40 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1502 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:40.807831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a7d8632b-0383-42d8-96f3-7c9ff5461f63 req-92252d4d-d535-485f-8672-eb11f606229a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057948 Sep 23 03:57:40.812676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2047/3990] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:40.819741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:40.823476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:40.830152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:40.830152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:40.836370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.837553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.838056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.839058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.839526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.839967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.841486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.842895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.843767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.844715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:40.845264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:40.845803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:40.869080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'flavor' on Instance uuid e346b663-e628-4790-b102-70ead520bcef {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:40.990830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:40.999938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4eeb7a26-6cf4-498a-ae17-08b02434050d tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1436 microversion: 2.1 time: 0.195254 Sep 23 03:57:41.000652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1944/3991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:40 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1436 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:41.006770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-601872c7-0330-47af-a260-bf3198c49afb tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-313121067", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-601872c7-0330-47af-a260-bf3198c49afb tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 498 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-313121067", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-313121067', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6a600d9b-3e70-4d6e-bc25-a8e544c972a5'}]}}} Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:57:41.012165 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.014729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.022475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-601872c7-0330-47af-a260-bf3198c49afb tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:41.023638 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-601872c7-0330-47af-a260-bf3198c49afb tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021616 Sep 23 03:57:41.024996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1945/3992] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:41 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:57:41.096969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60b0b548-382d-4aec-8685-f0c25e80990a tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-650093777", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60b0b548-382d-4aec-8685-f0c25e80990a tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 499 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-650093777", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-650093777', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6a600d9b-3e70-4d6e-bc25-a8e544c972a5'}]}}} Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:57:41.101438 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60b0b548-382d-4aec-8685-f0c25e80990a tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60b0b548-382d-4aec-8685-f0c25e80990a tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010241 Sep 23 03:57:41.113209 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1946/3993] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:41 2022] POST /compute/v2.1/servers => generated 689 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:57:41.193690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61422927-86f1-44d1-bf96-1e556713952f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1618910271", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61422927-86f1-44d1-bf96-1e556713952f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 754 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1618910271", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1618910271', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6a600d9b-3e70-4d6e-bc25-a8e544c972a5'}]}}} Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:57:41.199750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:57:41.210974 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:57:41.215220 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.215220 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.215220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61422927-86f1-44d1-bf96-1e556713952f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:41.215220 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61422927-86f1-44d1-bf96-1e556713952f tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.013867 Sep 23 03:57:41.215220 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1947/3994] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:41 2022] POST /compute/v2.1/servers => generated 1197 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 23 03:57:41.251030 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-425fb94d-3799-4747-b183-78813c97034a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef/action" status: 202 len: 0 microversion: 2.1 time: 0.429605 Sep 23 03:57:41.255856 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2048/3995] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:40 2022] POST /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:41.266138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.268031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.270590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:41.282423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d742cb2-aa38-491b-9c96-69d1c9952e5b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2016719798", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d742cb2-aa38-491b-9c96-69d1c9952e5b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 1266 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2016719798", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6a600d9b-3e70-4d6e-bc25-a8e544c972a5"}]}} Sep 23 03:57:41.287600 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2016719798', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6a600d9b-3e70-4d6e-bc25-a8e544c972a5'}]}}} Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.289518 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:57:41.290654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:57:41.292326 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 03:57:41.292326 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.294112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d742cb2-aa38-491b-9c96-69d1c9952e5b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:41.294455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.295551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d742cb2-aa38-491b-9c96-69d1c9952e5b tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017986 Sep 23 03:57:41.296721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2049/3996] 10.222.0.25 () {60 vars in 1148 bytes} [Fri Sep 23 03:57:41 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 23 03:57:41.297092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.297752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.302404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.302404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.302404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.318638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.319493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 647f3b7d-c270-41d4-bbb8-5b4a11450645] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.330812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] HTTP exception thrown: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/647f3b7d-c270-41d4-bbb8-5b4a11450645/metadata/test2 HTTP/1.1 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '647f3b7d-c270-41d4-bbb8-5b4a11450645', 'id': 'test2'} Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:41.333968 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:41.338150 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:41.338150 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:41.338150 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. Sep 23 03:57:41.338150 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:41.339720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 404 to user: Instance 647f3b7d-c270-41d4-bbb8-5b4a11450645 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:41.340780 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-949e0b60-f230-499f-9a1e-2c3125139ff9 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/647f3b7d-c270-41d4-bbb8-5b4a11450645/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.033041 Sep 23 03:57:41.353070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2050/3997] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Sep 23 03:57:41 2022] GET /compute/v2.1/servers/647f3b7d-c270-41d4-bbb8-5b4a11450645/metadata/test2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:41.364921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.365572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.383355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.384408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.384849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.389910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.390462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.390904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.719811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:41.732307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca83cbc1-536f-4b23-b7ac-bab4189c77a7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.475256 Sep 23 03:57:41.753407 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1948/3998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:41 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:41.760037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.760532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.767662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.768158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.768597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.769308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.769792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.770226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.800229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:41.893288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:41.907127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:41.918942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e698af7-1584-4b22-9cb7-32f057bf5be0 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 204 len: 0 microversion: 2.1 time: 0.163935 Sep 23 03:57:41.921600 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1949/3999] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:41 2022] DELETE /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:57:41.935983 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d3864e5-ccc1-4fcd-96ff-44948b076dd8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.582530 Sep 23 03:57:41.936523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2051/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:41 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:41.941752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.942629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.958892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:41.960561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:41.962188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.965485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.966095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.966973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.967567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.969054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.969681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.970366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.971115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:41.972293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:41.973051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:41.973931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.245679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:42.262484 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f38024d-3987-492a-9c68-21c0798fd84d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.318352 Sep 23 03:57:42.263643 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2052/4001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:41 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:42.274988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:42.277769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:42.283989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:42.295061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9cab5782-6ac9-49ee-b266-a2b020050164 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.372037 Sep 23 03:57:42.301115 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1950/4002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:41 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:42.303061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.303823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.306511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.307522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.308207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.309005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.319317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:42.320260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:42.329567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.335053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.335730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.337296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.338100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.339041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.476342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:42.489674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b8ba2fb-0b52-451a-89ff-b8f7fbf7f35c tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1436 microversion: 2.1 time: 0.185526 Sep 23 03:57:42.490893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1951/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:42 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1436 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:42.510649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56dea92e-769f-48a1-b589-b018e28a8d73 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Action: 'create', calling method: .version_select at 0x7f0c8a30eaf0>, body: {"keypair": {"name": "tempest-keypair-837347441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTZnT02GeKvmpzMdjt8Zg3+EMFgirhVRpy5eb71LkYuvcd1yYT7mzdEgHZTlz8RaKZ8G5drgeWBgGlGQIbiYFJA3vp4GDTiq1wQvIR5nsnoKvachbLYzZbZVBQrvVXVhg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:42.538981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-56dea92e-769f-48a1-b589-b018e28a8d73 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Getting quotas for project e459d2f8ebf0450bb0ae024b06843645. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:42.546607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-56dea92e-769f-48a1-b589-b018e28a8d73 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Getting quotas for user 89afe168665e43159198b1225bbb8d76 and project e459d2f8ebf0450bb0ae024b06843645. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:42.593487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:42.602486 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-636c34ae-2e14-4d85-b82a-8f61e41c324e tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1525 microversion: 2.1 time: 0.337272 Sep 23 03:57:42.604375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2053/4004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:42 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:42.624620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56dea92e-769f-48a1-b589-b018e28a8d73 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.130226 Sep 23 03:57:42.645972 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1952/4005] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:57:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:57:42.757826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:42.759234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:42.772321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.772827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.773271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.774056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.774515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.774952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.959975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:42.960598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:42.976449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.976865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.977412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:42.978429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:42.978903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:42.979343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.042566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:43.061163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05d87669-115e-44e0-abb6-99e1d1679412 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.299441 Sep 23 03:57:43.062414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2054/4006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:42 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:43.255532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:43.268595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e9a2628-775c-4c47-a719-4160009da79f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.312743 Sep 23 03:57:43.269942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1953/4007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:42 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:43.293970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:43.294642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:43.302492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.302991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.303434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.304199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.304664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.307085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.328238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:43.329068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:43.339989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.342204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.342826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.343623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.346370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.347011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.687193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:43.705288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24b5dff0-e5e5-4689-9ff6-c0f569cbb85c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.416825 Sep 23 03:57:43.705983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2055/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:43 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:43.721921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:43.722546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:43.728762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.729211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.729731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.730875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.731356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.731797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.769329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.769895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.770344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.772433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lazy-loading 'fault' on Instance uuid 7d5adbf9-921c-4983-ba38-fb92f91cbe41 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:43.772572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:43.785073 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0b9c1de-fb9b-4455-b970-56bc525d20b8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.461271 Sep 23 03:57:43.787353 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1954/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:43 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:43.796522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:43.797328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:43.814376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.815074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.815749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.816860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:43.817896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:43.818518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:43.902334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9865d0aa5e4468a8da8460b8eb703a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7065f727ff24b929f9d4eef09e4a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:43.922687 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b53722f5-bbed-47cf-8628-42a3048d4054 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 200 len: 1283 microversion: 2.1 time: 0.215433 Sep 23 03:57:43.923255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2056/4010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:43 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 1283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:44.084492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:44.086045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:44.098652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.099364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.101433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.102387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.106087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.107153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.207327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:44.216617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d6aeb4a7-b219-4e95-9d1f-54b0603c86fc tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1525 microversion: 2.1 time: 0.428198 Sep 23 03:57:44.217193 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1955/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:43 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:44.294909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:44.296098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:44.302587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.303082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.303529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.304617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.305082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.306308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.342367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:44.353744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a26f7c04-1ac0-4cad-aea0-df2febdc59df tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.273188 Sep 23 03:57:44.369385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2057/4012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:44 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:44.557469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:44.572867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2d325ce-5f9d-4f47-8ef2-24af6acdf9e6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.282139 Sep 23 03:57:44.574148 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1956/4013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:44 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:44.729078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:44.730020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:44.737160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.737881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.738359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.739087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.739566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.739986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.808679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:44.809838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:44.816226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.816992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.817762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:44.818760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:44.819552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:44.820188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.240465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:45.254252 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4af04d20-98c0-4d45-aab7-3601af5c33e5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.529037 Sep 23 03:57:45.255119 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2058/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:44 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:45.260240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:45.261076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:45.261945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] [instance: 7d5adbf9-921c-4983-ba38-fb92f91cbe41] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:45.269051 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6c8472d-6f65-4f25-a5f4-c35c3329cffa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.464538 Sep 23 03:57:45.269666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1957/4015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:44 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:45.270851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.271730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.272389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.273171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.273746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.274739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.279695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:45.282169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:45.293375 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] HTTP exception thrown: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Request method failure captured: Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 HTTP/1.1 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2SxtlDyF8NxK3wnhqefENcQrrL_Up3u7m2bQpaGXXUR64jy-yRBTDoPYaeW3-LLllJMzSqPLBe2rYoe0q9qUwQEabO41mOrqOfT4CR9nD1ZK8YHAwbGEWLVbonkK0UQ7eCRPaMDc9_hVMrMFJ2arGZL3Qd9VGlOgVHoqmuhy5Lz1w Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7065f727ff24b929f9d4eef09e4a0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersTestJSON-1234210735 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d7065f727ff24b929f9d4eef09e4a0cb Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersTestJSON-1234210735 Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9d9865d0aa5e4468a8da8460b8eb703a Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersTestJSON-1234210735-project Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7d5adbf9-921c-4983-ba38-fb92f91cbe41'} Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:45.295458 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. Sep 23 03:57:45.299737 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:45.303052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] Returning 404 to user: Instance 7d5adbf9-921c-4983-ba38-fb92f91cbe41 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:45.306330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8e508d8-36e4-497d-a679-aa5937163da4 tempest-ServersTestJSON-1234210735 tempest-ServersTestJSON-1234210735-project] 10.222.0.25 "GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41" status: 404 len: 111 microversion: 2.1 time: 0.049973 Sep 23 03:57:45.312115 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2059/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:45 2022] GET /compute/v2.1/servers/7d5adbf9-921c-4983-ba38-fb92f91cbe41 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:45.315251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.315855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.316315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.317063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.319881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778b652-a107-41b7-b3b9-d193fc529f4e", "name": "network-vif-plugged", "status": "completed", "tag": "2cbc9039-9dd6-46f2-83df-677a04460e3c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:45.332201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.333269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.333984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.336172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.337244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.350159 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] Creating event network-vif-plugged:2cbc9039-9dd6-46f2-83df-677a04460e3c for instance f778b652-a107-41b7-b3b9-d193fc529f4e on n-h2-858495-2 Sep 23 03:57:45.358890 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-42290ae3-46c8-48e9-b805-41e4536d80d6 req-6219b3a2-c704-459a-8af4-0b04095eb30f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044918 Sep 23 03:57:45.368134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2060/4017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:45.384347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:45.385066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:45.400573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.401078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.401560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.402285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.402753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.403192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.830961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:45.846105 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-460d8e1e-f629-43b6-9c06-450ed0ec44bb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.465199 Sep 23 03:57:45.847624 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2061/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:45 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:57:45.863017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:45.864498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:45.878050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.887468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.892494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.894104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:45.895035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:45.897951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:45.903119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:45.915391 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-797c3d32-57e5-49eb-a840-fb669a2f5940 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1525 microversion: 2.1 time: 0.639390 Sep 23 03:57:45.918201 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1958/4019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:45 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1525 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:46.038995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1152837837", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a4ba27c4-0521-4f83-8e28-1cf5c552f8dd"}, {"port": "f756178c-a6c4-4562-95fb-837eb406ca99", "tag": "port-1"}, {"port": "48160dd4-7d3f-4627-9478-964935552a7e", "tag": "port-2"}, {"uuid": "56e806a5-6f78-4384-a7a3-62a3fdb3ab74", "tag": "net-1"}, {"uuid": "56e806a5-6f78-4384-a7a3-62a3fdb3ab74"}, {"uuid": "8f67fa7f-34c9-4a8b-b516-69d69d52052f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8f67fa7f-34c9-4a8b-b516-69d69d52052f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f84147cf-049c-49c6-8c3e-11afe66e24c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ed80c072-58c4-4cc6-949d-fad88bf4cd8c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fe3d607f-f8e7-46fd-9d87-89839080a1f1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1214600523"}], "key_name": "tempest-keypair-837347441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:46.252043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] validate_networks() for [('a4ba27c4-0521-4f83-8e28-1cf5c552f8dd', None, None, None, None, None), (None, None, 'f756178c-a6c4-4562-95fb-837eb406ca99', None, None, None), (None, None, '48160dd4-7d3f-4627-9478-964935552a7e', None, None, None), ('56e806a5-6f78-4384-a7a3-62a3fdb3ab74', None, None, None, None, None), ('56e806a5-6f78-4384-a7a3-62a3fdb3ab74', None, None, None, None, None), ('8f67fa7f-34c9-4a8b-b516-69d69d52052f', '10.2.2.100', None, None, None, None), ('8f67fa7f-34c9-4a8b-b516-69d69d52052f', '10.2.2.200', None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:57:46.755935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:46.766607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39b3eb9a-de03-4947-8598-1a9fc5be9233 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.908570 Sep 23 03:57:46.784237 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2062/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:45 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:46.793017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:46.795568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:46.805999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:46.806854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:46.807994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:46.809011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:46.809736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:46.810376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:47.163943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:47.175316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6a5c534-cd36-48f1-8049-0e5be81d1fdc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.389454 Sep 23 03:57:47.175932 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2063/4021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:46 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:47.188329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:47.189313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:47.209867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:47.210761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:47.212319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:47.214396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:47.215130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:47.216636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:47.521873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:47.534199 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ec80337-ca09-4852-9360-95162f1dbc2b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1365 microversion: 2.1 time: 0.351593 Sep 23 03:57:47.534629 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2064/4022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:47 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:47.564076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e210-0bef-4202-86f6-3f9156155c6f", "name": "network-vif-deleted", "tag": "dcd7845b-4aa9-46d3-aa3e-4b00c221386b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:47.588354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:47.588846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:47.589287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:47.615263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] Creating event network-vif-deleted:dcd7845b-4aa9-46d3-aa3e-4b00c221386b for instance 9540e210-0bef-4202-86f6-3f9156155c6f on n-h2-858495-2 Sep 23 03:57:47.627558 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5dea03da-e5f9-4124-8c9f-43bf1d04ca6a req-10da12e3-6a5f-41c9-9a72-eb1b7382b8ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075953 Sep 23 03:57:47.628612 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2065/4023] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:47.634188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:47.641273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:47.656040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:47.665863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:47.666387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:47.667177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:47.667642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:47.668081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.173395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:48.181834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51f87cb3-6ec9-4613-9f3c-997a09b00a4f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.551758 Sep 23 03:57:48.182606 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2066/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:47 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:48.201282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:48.201935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:48.217175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.218003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.218617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.219498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.220254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.220849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.281252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.282442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.284254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.284932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lazy-loading 'fault' on Instance uuid 9540e210-0bef-4202-86f6-3f9156155c6f {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:57:48.392043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7887710dc71a4df0b8c7d441a8aed964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b324b095344940aa0a247a9a81976c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:48.402264 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb197345-a8b3-4953-a2d3-b2d937db0e9c tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 200 len: 1313 microversion: 2.1 time: 0.218733 Sep 23 03:57:48.403238 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2067/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:48 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:48.407959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540e210-0bef-4202-86f6-3f9156155c6f", "name": "network-vif-unplugged", "status": "completed", "tag": "dcd7845b-4aa9-46d3-aa3e-4b00c221386b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:48.421959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.422785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.423443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.439210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] Creating event network-vif-unplugged:dcd7845b-4aa9-46d3-aa3e-4b00c221386b for instance 9540e210-0bef-4202-86f6-3f9156155c6f on n-h2-858495-2 Sep 23 03:57:48.444802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-035396cd-805e-4a6e-8941-032c094b5cca req-f5b286c1-5387-4b60-9f8f-98f4f024a298 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040171 Sep 23 03:57:48.445857 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2068/4026] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:48.452518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:48.453436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:48.464434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.469175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.471356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.473963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.474883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.475583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.840619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:48.854831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1abe086-3651-4df1-88d7-f2d06c45e831 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.406687 Sep 23 03:57:48.856438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2069/4027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:48 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:48.862573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:48.863444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:48.871850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.873064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.873676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.874656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:48.875235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:48.876298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:48.898558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:49.247384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:49.270302 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-763ce051-c298-4230-bf03-f04562aa51fc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.411530 Sep 23 03:57:49.271970 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2070/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:48 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:49.277980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:49.279108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:49.287867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:49.289064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:49.290263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:49.291254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:49.291917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:49.292559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:49.583445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:49.593394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8806943-400f-4145-99a1-bf2b5945ccca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1554 microversion: 2.1 time: 0.319784 Sep 23 03:57:49.598166 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2071/4029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:49 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1554 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:49.606859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:49.613667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:49.620731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:49.621561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:49.622171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:49.623047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:49.623853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:49.624448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.296135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:50.314168 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-48f1ee1f-17c5-4787-ac81-bde3ce30de62 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.714595 Sep 23 03:57:50.314768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2072/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:49 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:50.337231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:50.338651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] [instance: 9540e210-0bef-4202-86f6-3f9156155c6f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:50.346215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.347048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.348262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.349727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.350460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.351213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.369280 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] HTTP exception thrown: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Request method failure captured: Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f HTTP/1.1 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS6aZQhYBhr27sL_vTbTs5JnXIVrZYrLyfDT0uibIxQvTHgMGSI3srFT-44Ne2ylGeefHBrPKy8C7YiYOw31lLY2qIKDHAVYI42bqaXGg3f6Kq8JHi0PzlXGeQ17iAFmhDubvRN7aFa0w-0jKcc_dyZkdEIKDopiopxr2rEU63i5VmI Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67b324b095344940aa0a247a9a81976c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67b324b095344940aa0a247a9a81976c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67b324b095344940aa0a247a9a81976c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 67b324b095344940aa0a247a9a81976c Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-939899791 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7887710dc71a4df0b8c7d441a8aed964 Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-939899791-project Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9540e210-0bef-4202-86f6-3f9156155c6f'} Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:50.370990 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] Returning 404 to user: Instance 9540e210-0bef-4202-86f6-3f9156155c6f could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1824fce9-95bd-47a1-8d92-01827254d541 tempest-ServerMetadataNegativeTestJSON-939899791 tempest-ServerMetadataNegativeTestJSON-939899791-project] 10.222.0.25 "GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f" status: 404 len: 111 microversion: 2.1 time: 0.040703 Sep 23 03:57:50.375471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2073/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:50 2022] GET /compute/v2.1/servers/9540e210-0bef-4202-86f6-3f9156155c6f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:57:50.381111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:50.381731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:50.389623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.390518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.391163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.392036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.392667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.393221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.707623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8a1a87b-f5b5-4cb3-b77b-598b745c31ce tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.333573 Sep 23 03:57:50.719030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2074/4032] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 03:57:50 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:50.724417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:50.725120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:50.741901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.744126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.744641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:50.745669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:50.748571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:50.751511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:51.645914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:51.658840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-18dcaddb-86cb-494c-99f4-eac9bb6a77b8 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1485 microversion: 2.1 time: 0.938443 Sep 23 03:57:51.659457 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2075/4033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:50 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1485 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:51.664898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:51.665535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:51.687745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:51.688239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:51.688675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:51.689409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:51.689870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:51.690298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:52.132502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:52.140601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-592a1090-1ff2-46f5-b03a-74c1523b438f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.480101 Sep 23 03:57:52.141181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2076/4034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:51 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:52.151560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:52.152176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:52.158338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:52.159034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:52.159665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:52.160436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:52.160922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:52.161316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:52.590217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:52.968827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:52.982580 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf747b9a-fddc-46fb-a374-c57331894ed5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.839882 Sep 23 03:57:52.984193 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2077/4035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:52 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:52.997970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:52.998947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:53.010058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.018255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.020392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.022195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.022917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.023578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.112478 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adbd0aa7-8201-4188-848a-907a6746982f tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "POST /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088/action" status: 202 len: 0 microversion: 2.1 time: 0.126754 Sep 23 03:57:53.113307 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2078/4036] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:52 2022] POST /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:57:53.287734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-101195891", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:53.351596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:53.352804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:53.353539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:53.354185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:53.354816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:53.374112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.374973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.376102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.377373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.378052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.378729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.397440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:53.403609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Getting quotas for project 630f2124e5bc47008f009f415d1e03ad. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:53.412788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Getting quotas for user 1937dec712d14bf2bfc393474b877a4b and project 630f2124e5bc47008f009f415d1e03ad. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:53.428354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:53.431461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:53.473110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:57:53.473747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:57:53.474681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:57:53.475151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:57:53.475690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:57:53.493679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.494317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.494836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.495651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.496785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.499892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.516715 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bcf436c4-d5a9-42c4-a034-5f6127da7db6 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.401770 Sep 23 03:57:53.521256 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2079/4037] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 03:57:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:57:53.532721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:53.533338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:53.541146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.541899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.542527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.543794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:53.544434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:53.545020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:53.597183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Getting quotas for project e459d2f8ebf0450bb0ae024b06843645. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:57:53.610416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Getting quotas for user 89afe168665e43159198b1225bbb8d76 and project e459d2f8ebf0450bb0ae024b06843645. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:57:53.850581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:57:53.855086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f84147cf-049c-49c6-8c3e-11afe66e24c2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ed80c072-58c4-4cc6-949d-fad88bf4cd8c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe3d607f-f8e7-46fd-9d87-89839080a1f1',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:57:53.978449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:53.990713 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-157de008-9940-49eb-85ee-8275d8e367c6 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1493 microversion: 2.1 time: 0.461785 Sep 23 03:57:53.991772 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2080/4038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:53 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1493 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:54.010060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:54.010777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:54.023103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.024156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.024605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.025311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.025958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.026524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.432020 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a44f4aae-be87-4796-a291-dcf8c0682339 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.397781 Sep 23 03:57:54.432896 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1959/4039] 10.222.0.25 () {62 vars in 1189 bytes} [Fri Sep 23 03:57:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 8399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:57:54.444086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:54.444927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:54.460672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.461547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.462267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.463289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.464391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.465773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.506127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:54.517371 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e72e2cd-0c22-467b-bd14-22f641e12054 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1511 microversion: 2.1 time: 0.524192 Sep 23 03:57:54.525707 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2081/4040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:53 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:54.543079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:54.544010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:54.550878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.551800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.552439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.553449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.554124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.555299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.752781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:54.766068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:54.770786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:54.780423 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96b8163c-b48f-4d6f-bfd0-19a92e1e71b3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1281 microversion: 2.54 time: 0.345880 Sep 23 03:57:54.785151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1960/4041] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:54 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1281 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:54.811542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f778b652-a107-41b7-b3b9-d193fc529f4e", "tag": "2cbc9039-9dd6-46f2-83df-677a04460e3c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:54.832180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:54.836527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:54.837150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:54.887610 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] Creating event network-changed:2cbc9039-9dd6-46f2-83df-677a04460e3c for instance f778b652-a107-41b7-b3b9-d193fc529f4e on n-h2-858495-2 Sep 23 03:57:54.902342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e04ac7b5-73de-4c69-a3ec-8109b6d3080c req-81757b6e-8d23-417d-8e69-08b54808a660 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111513 Sep 23 03:57:54.906984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1961/4042] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:54.913521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:54.918935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:54.922185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:54.923048 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38d111f9-8c08-4d47-9df9-1fc081b1b006 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.395915 Sep 23 03:57:54.923657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2082/4043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:54 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:55.021214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:55.021884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:55.035145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.038094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.038587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.039417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.039913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.040357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.137637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:55.151221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:55.152707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:55.153917 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a24c4d50-bcdb-49a7-bf08-f52e8b7612fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1285 microversion: 2.42 time: 0.245469 Sep 23 03:57:55.155021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1962/4044] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:54 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:55.351137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:55.361118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-199074f2-8118-413d-9916-9a858ecba99c tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1493 microversion: 2.1 time: 0.345233 Sep 23 03:57:55.380560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2083/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:55 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1493 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:55.550668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:55.552527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:55.563910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.564502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.565004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.565962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.566505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.566968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.788662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:55.798776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-160da2ab-a59e-4f61-a1b3-00e24a87fe78 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1488 microversion: 2.1 time: 0.252397 Sep 23 03:57:55.799399 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1963/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:55 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1488 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:55.813075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:55.813719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:55.826709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:55.829699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:55.838205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.838712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.839156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.839874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.840336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.842073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.842570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.843007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.843718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.844183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.844616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.849774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.924941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2dae71ea-1e6f-4194-82a1-66afe8bdb4cf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 200 len: 139 microversion: 2.1 time: 0.102134 Sep 23 03:57:55.927279 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1964/4047] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:57:55 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:57:55.937115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:55.943582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:55.980287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.980890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.981903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:55.982690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:55.987549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:55.989450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.011196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.019858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:56.040477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.046339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.055855 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fb8dccdf-2eee-4788-ba2f-97ee10e01a03 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1329 microversion: 2.54 time: 0.246139 Sep 23 03:57:56.059324 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2084/4048] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:55 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1329 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:56.067344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:56.068274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:56.076519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.077324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.078149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.079042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.079678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.080358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.391699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.406744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7ddb7d8-246d-42aa-8508-b3b89ba45361 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.341764 Sep 23 03:57:56.408591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2085/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:56 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:56.420357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:56.424514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:56.435129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.435953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.436769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.437570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.438532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.439700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.487590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.497342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-497b70fd-e093-4950-963f-1a36e473c4d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.564682 Sep 23 03:57:56.498296 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1965/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:55 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:56.504243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:56.505573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:56.512301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:56.514430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.516700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.517337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.518244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.518868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.519704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.569341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.582653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.586672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:56.588447 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-91447e02-3b98-40fb-b64c-4cfae569a327 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1575 microversion: 2.42 time: 0.178589 Sep 23 03:57:56.589399 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2086/4051] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:56 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:56.594814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:56.595821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:56.603084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.603926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.604565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:56.605532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:56.606223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:56.606869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.278279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:57.288605 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32c671fd-a32d-4a40-bee8-3cc1c41f93be tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1493 microversion: 2.1 time: 0.789022 Sep 23 03:57:57.309561 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1966/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:56 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1493 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:57.342276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:57.348508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:57.382089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.382686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.383150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.383905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.384900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.384900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.534904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:57.537798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:57.541397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:57:57.550330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a038a48-e701-4725-bc11-8755bde775ea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.959470 Sep 23 03:57:57.550922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2087/4053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:56 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:57.561551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:57.567358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:57.568895 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ee0f91ef-de94-4498-b716-9f9728f27731 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1347 microversion: 2.54 time: 0.259421 Sep 23 03:57:57.571268 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1967/4054] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:57 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1347 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:57.585336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:57.586615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:57.587431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:57.591233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:57.603372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.604130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.610008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.610748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.611176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.611309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.611693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.612085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.612419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:57.612821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:57.612928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:57.613760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.120106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.136731 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a56d5a7a-97d2-4227-b7ed-3d7bb0f82499 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.556741 Sep 23 03:57:58.137473 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1968/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:58.146859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:58.147486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:58.161835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.167039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.167881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.168494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.171931 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-447fed71-b571-4793-a48c-4fb3aa3573d0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.598286 Sep 23 03:57:58.172778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2088/4056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:57 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:58.174217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.174690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.175143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.179926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:58.180784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:58.198519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.199372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.199485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.200179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.200672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.201055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.326855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.337477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.339227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.340614 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-250cdee2-6b7b-43c2-a16d-295ad07e8ec4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1593 microversion: 2.42 time: 0.202158 Sep 23 03:57:58.341457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1969/4057] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:58 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1593 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:58.366423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:58.367394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:58.375307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.376130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.377072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.378077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.378746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.379424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.627872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.644190 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-398236de-7ae8-4fb2-9cd8-f8f46b1a1ab8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.469973 Sep 23 03:57:58.649979 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2089/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:58 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:58.662168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:58.662871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:58.682681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.682901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.683309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.685911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.687092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.687550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.735097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:58.748872 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c5a37e1-c0fc-4079-a79f-ecc1b8f0e2a3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1499 microversion: 2.1 time: 0.393275 Sep 23 03:57:58.750320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1970/4059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:58 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:58.786964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:58.788013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:58.796543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.796739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.797165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.798370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:58.798848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:58.799291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:58.838775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:57:58.985912 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99248df1-0c01-4264-b198-88b3e527870d tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 204 len: 0 microversion: 2.1 time: 0.203510 Sep 23 03:57:58.986995 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1971/4060] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:57:58 2022] DELETE /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:57:58.999547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-361587816", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "035b98c4-22a0-4a66-81a1-f3cedd6f6f67"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:57:59.169539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:59.182874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:59.184815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:59.190904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2622e11c-f6b5-471f-9044-c7288538193b tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1335 microversion: 2.54 time: 0.539609 Sep 23 03:57:59.201548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2090/4061] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:57:58 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1335 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:57:59.207790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:59.208449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:59.223902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:59.224806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:59.227037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:59.229802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:59.251073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:59.252635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:59.310125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] validate_networks() for [('035b98c4-22a0-4a66-81a1-f3cedd6f6f67', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:57:59.694404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:57:59.709234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2236db02-cc72-4448-b573-6ac2df5dfcdd tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.509281 Sep 23 03:57:59.709914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2091/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:59 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:57:59.733162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:57:59.733820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:57:59.761426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:59.763704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:59.764421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:57:59.767085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:57:59.768430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:57:59.770205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.144972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.161744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75547849-8085-4b30-88b6-758ed558f397 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.438490 Sep 23 03:58:00.163167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2092/4063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:57:59 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:00.169688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:00.172949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:00.204086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.204613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.205070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.206240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.206739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.207191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.306156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:00.307549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:00.308229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:00.308931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:00.309661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:00.338583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.338864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.339301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.342190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.344429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.345999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.378267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:00.387008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:00.408134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:58:00.411369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:58:00.473442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.484955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.486449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.488457 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b36a3737-e006-4290-b24e-89f39fea0b11 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499459 Sep 23 03:58:00.492732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1972/4064] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:58:00.499644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ada8bdda-c18b-4b36-96f5-04fbd0914afb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1661 microversion: 2.42 time: 0.334221 Sep 23 03:58:00.500440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2093/4065] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:00 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1661 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:00.507292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:00.510086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:00.522141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.525204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.525997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.527360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.528033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.528871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.534271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc62832a-d94f-4543-a35b-0fb4c38fb994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:00.534887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc62832a-d94f-4543-a35b-0fb4c38fb994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:00.637715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.651798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.655891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.660055 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c477ede-04b2-42ad-a66b-836fd35ff738 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1335 microversion: 2.54 time: 0.166053 Sep 23 03:58:00.660796 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1973/4066] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:00 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1335 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:00.699814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc62832a-d94f-4543-a35b-0fb4c38fb994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:00.715557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc62832a-d94f-4543-a35b-0fb4c38fb994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1214 microversion: 2.1 time: 0.185013 Sep 23 03:58:00.729382 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2094/4067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:00 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:00.736413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:00.737027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:00.755948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.756714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.757249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:00.758647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:00.759174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:00.759828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.188455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:01.190647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:01.208338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.211222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.212333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.215683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.217466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.217940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.233586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.242638 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62aa6b8f-693b-4a98-8286-0f2efbb569ad tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.509704 Sep 23 03:58:01.243252 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1974/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:00 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:01.519944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.531314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:01.532553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:01.544506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.548367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.548831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-322477e1-75b2-4f13-b984-bb0126055d3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.365140 Sep 23 03:58:01.548971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.550964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2095/4069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:01 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:01.551692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.552197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.552643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.691982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:01.693157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:01.702449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.705077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.705881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.706982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.707781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.709784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.806827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.822565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.824095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.825293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c532e46-fb09-47db-84c4-86bf7cab66ea tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1335 microversion: 2.54 time: 0.138645 Sep 23 03:58:01.825854 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2096/4070] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:01 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:01.830473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:01.842316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:01.848692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.849177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.849643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.850363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:01.850824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:01.851823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:01.962837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:01.978854 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-959b8fce-27af-47da-89ab-391198270af8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1218 microversion: 2.1 time: 0.151634 Sep 23 03:58:01.979335 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2097/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:01 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:02.000488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:02.024685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:02.030370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:02.033714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f12efded-0068-49f0-b57c-60c3690eab5f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1708 microversion: 2.42 time: 0.506847 Sep 23 03:58:02.035117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1975/4072] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:01 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1708 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:02.267255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:02.268574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:02.282213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.284092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.286974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:02.289180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.291388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.292582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:02.579906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:02.581342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:02.615065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.615892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.616522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:02.618191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.618884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.619502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:02.706515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:02.719824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-80d76de5-6814-4116-852b-e76d7ebda955 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.456825 Sep 23 03:58:02.720598 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2098/4073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:02 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:02.873034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:02.877149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:02.921455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.922085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.925035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:02.926030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:02.926598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:02.927043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.393139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:03.400831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:03.415442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9710ae5d-7590-4260-a683-a78e327014d2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.842273 Sep 23 03:58:03.416301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1976/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:02 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:03.433234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:03.442000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:03.442971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:03.453468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.453675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:03.454502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.455337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.456351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.457067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.457913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.469734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:03.474905 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fca1a442-ba80-4d38-80c9-5f321bfbeada tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1335 microversion: 2.54 time: 0.624807 Sep 23 03:58:03.491453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2099/4075] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:02 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1335 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:03.523847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:03.532069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:03.557861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.558491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.560573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.561923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.562513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.563375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.705485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:03.714559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e3c16bc-5906-4915-a4c7-3b24ce0930de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1210 microversion: 2.1 time: 0.297419 Sep 23 03:58:03.715752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1977/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:03 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1210 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:03.748558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:03.749600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:03.767424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.767933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.768378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:03.769294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:03.770034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:03.770641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.370192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.389660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.395567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.403399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ba9ce17-7641-450d-8208-16dd2e50f445 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1755 microversion: 2.42 time: 0.903627 Sep 23 03:58:04.404256 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2100/4077] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:03 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1755 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:04.441485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:04.442405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:04.452700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.461980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.462708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.467453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.471908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.472815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.665450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.678198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9d41af1-20a2-4299-9d76-69b4f6fb6f8b tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.933371 Sep 23 03:58:04.681706 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1978/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:03 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:04.693627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:04.696418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:04.712569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.713811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.715364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.720586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.721309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.722250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.891709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.905067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.910894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:04.917315 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cfe7559c-4d89-4628-b3f3-b54faf8da3cb tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1335 microversion: 2.54 time: 0.230700 Sep 23 03:58:04.918722 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1979/4079] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:04 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:04.933818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:04.937650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:04.954139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.955007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.955930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:04.959476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:04.960186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:04.962173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:05.301298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:05.307284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:05.322381 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eedc9660-14d9-47f0-9977-8b9f5b7234bb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1274 microversion: 2.1 time: 0.402231 Sep 23 03:58:05.326554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-036891c2-f192-4e4d-9e8c-bbf55ddd9ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 0.889463 Sep 23 03:58:05.327977 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1980/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:04 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:05.329338 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2101/4081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:04 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:05.433498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:05.434765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:05.445900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:05.450166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:05.450868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:05.452482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:05.468746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:05.470238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:05.522587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:05.709986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:05.711105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:05.722164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:05.723682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:05.724114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:05.727029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:05.727744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:05.728190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.030268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.055507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.061656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.064603 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38c0a21c-7869-496d-98de-c9faadc21e89 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1755 microversion: 2.42 time: 0.636220 Sep 23 03:58:06.069545 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1981/4082] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:05 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1755 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:06.088053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:06.088965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:06.103221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.110589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.111811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.112741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.115489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.116119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.357792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.362266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.385693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-25e22906-8f45-43ab-839f-06aea82ee2e2 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 200 len: 1505 microversion: 2.1 time: 0.680354 Sep 23 03:58:06.388353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.396338 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2102/4083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:05 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:06.400271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:06.401785 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b747787-6570-4085-9159-31af05df277a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1356 microversion: 2.54 time: 0.330096 Sep 23 03:58:06.402582 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1982/4084] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:06 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1356 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:06.414113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:06.415980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:06.430169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:06.436791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:06.441385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.441984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.448491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.450742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.451238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.451682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.467980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.468893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.470329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:06.471438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:06.472493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:06.473162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:07.141108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:07.158945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8699f671-0aed-4438-8caf-3cdb0a9f15fb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1272 microversion: 2.1 time: 0.755133 Sep 23 03:58:07.164073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1983/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:06 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1272 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:07.187775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0351f441-8542-43f9-8528-cc67d59a5627 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Action: 'create', calling method: .version_select at 0x7f0c8aa2eee0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1119564786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhJlbrFzepTHP/C7gYfJPKt1/vB3f0e7mVSLn/cRYNGBh4vYknCjK4f5ZY1BBPEjB+R7z0vsardMSdhEMpheAANvbVMb7sKqBEE8cbjhXO49PkPnMTkV9XqgvHOX44QMA=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:07.248841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0351f441-8542-43f9-8528-cc67d59a5627 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Getting quotas for project 630f2124e5bc47008f009f415d1e03ad. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:07.260658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0351f441-8542-43f9-8528-cc67d59a5627 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Getting quotas for user 1937dec712d14bf2bfc393474b877a4b and project 630f2124e5bc47008f009f415d1e03ad. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:07.328708 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0351f441-8542-43f9-8528-cc67d59a5627 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.163457 Sep 23 03:58:07.330594 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1984/4086] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 03:58:07 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 03:58:07.349864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:07.354293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:07.371316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:07.379011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:07.379754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:07.381841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:07.384415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:07.385601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:07.486850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:07.516210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-15c2f6a3-cf27-4f1e-9649-c9258e3e71af tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1508 microversion: 2.1 time: 1.114407 Sep 23 03:58:07.516862 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2103/4087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:06 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1508 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:07.533895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb053fb-07f5-4654-a002-fbd0e92a4088", "name": "network-vif-deleted", "tag": "f0a4eb10-3eaf-4037-8591-3d200650b5ea"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:07.559452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:07.559948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:07.560387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:07.589948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] Creating event network-vif-deleted:f0a4eb10-3eaf-4037-8591-3d200650b5ea for instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 on n-h2-858495-2 Sep 23 03:58:07.599768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ebf13b87-5d50-4f7c-bceb-3865248a6475 req-27607e30-9d08-4da8-a02e-e2fc82f2f977 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080759 Sep 23 03:58:07.602453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2104/4088] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:07.838632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:07.849122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:07.863195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:07.871779 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9da971e-a42b-4887-af11-d4e8182506eb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1802 microversion: 2.42 time: 0.525854 Sep 23 03:58:07.872425 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1985/4089] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:07 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1802 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:07.883719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1119564786", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:07.897146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:07.920320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:07.920844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:07.921300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:07.926591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:07.927160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:07.927621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.018151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65338480", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:08.164541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:08.165041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:08.165582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] validate_networks() for [('9586326b-a441-4e4d-8a95-584444e131a4', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:58:08.170660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:08.173390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:08.204638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:08.416532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:08.442664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.443176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.447503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.452651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.453439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.454147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.541967 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bb463a6f-0abc-43a8-a22a-159876fc0570 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "POST /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f/action" status: 202 len: 1139 microversion: 2.54 time: 0.666361 Sep 23 03:58:08.545108 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1986/4090] 10.222.0.25 () {62 vars in 1320 bytes} [Fri Sep 23 03:58:07 2022] POST /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f/action => generated 1139 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 03:58:08.558198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:08.560736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 7eb053fb-07f5-4654-a002-fbd0e92a4088] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:08.585995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.587547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.589189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.592257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.593784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.594633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.640860 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] HTTP exception thrown: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Request method failure captured: Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 HTTP/1.1 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4_ZC7uJ-zZXpDGGzYGEeVppvZX-ldfaueLR7f3McVpeHNTI73204v4pxo9HCM8_ganWHN2XVlJqXPOXcXbH2vSCfoYrusvD5-11bgMxJ818g85ZDQWxa6QhHQzc1367Vqgrw6ngClL9VARciy53akXdwdjEpc0iGdJvX1pzYyTFN8 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6f20556a60e946f5bffafdbac4b76964 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6f20556a60e946f5bffafdbac4b76964 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueTestJSON-1385302925-project Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 8f85b0d0ad0044fbb1189575d448dd47 Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueTestJSON-1385302925-project Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7eb053fb-07f5-4654-a002-fbd0e92a4088'} Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:08.653907 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. Sep 23 03:58:08.657484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:08.669802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Returning 404 to user: Instance 7eb053fb-07f5-4654-a002-fbd0e92a4088 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:58:08.671752 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-211f7a4a-3df6-40f3-93d7-f42404175ad4 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088" status: 404 len: 111 microversion: 2.1 time: 0.125467 Sep 23 03:58:08.676043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1987/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:08 2022] GET /compute/v2.1/servers/7eb053fb-07f5-4654-a002-fbd0e92a4088 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:58:08.687612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:08.691830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:08.706640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.711239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.712240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:08.713564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:08.716394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:08.717129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:10.219126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:10.230963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58166953-4472-47dd-8917-7ef136cb2b28 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 1.553470 Sep 23 03:58:10.233037 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1988/4092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:08 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:10.244522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:10.247406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:10.258394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:10.258899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:10.259346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:10.260056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:10.261165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:10.261821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:10.363908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:10.705190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:10.920876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:10.931970 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ca9eb85a-7fa4-4ef5-b56d-ca41aefdce84 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.696958 Sep 23 03:58:10.940331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1989/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:10 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:10.966705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:10.973964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:10.996932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:10.997467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:10.997919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:10.998644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:10.999107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:10.999548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.033110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:11.033110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:11.033110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:11.033110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:11.033110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:11.042924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.043603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.048626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.049727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.050606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.051210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.097036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Getting quotas for project 1dd28846bbd84139a95f8d509db77cea. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:11.109180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Getting quotas for user 6539dc2b60a14449b5a970a8f558a691 and project 1dd28846bbd84139a95f8d509db77cea. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:11.142042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:58:11.146231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:58:11.254923 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65d74f1d-0650-468d-a1ad-012d44ecb24c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.650830 Sep 23 03:58:11.259371 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2105/4094] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:58:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:58:11.264489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:11.273910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:11.292579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.293251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.293871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.294749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.295539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.296124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.306727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:11.336295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:11.338433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:11.346216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d76e11e-061a-4d23-b0e7-3a86a519b72f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.383349 Sep 23 03:58:11.354175 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1990/4095] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:10 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:11.359465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:11.369398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:11.391725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.392460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.393173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.394399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.397109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.398354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.402750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:58:11.415181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:11.636163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9760cd24-c482-429f-97a0-74c08086e737 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 204 len: 0 microversion: 2.1 time: 0.374192 Sep 23 03:58:11.644772 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2106/4096] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:58:11 2022] DELETE /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:58:11.658769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346b663-e628-4790-b102-70ead520bcef", "name": "network-vif-plugged", "status": "completed", "tag": "e2ed51b2-15d4-4606-a5ce-7f2652c6c96a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:11.714360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.715749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.716336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.733536 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] Creating event network-vif-plugged:e2ed51b2-15d4-4606-a5ce-7f2652c6c96a for instance e346b663-e628-4790-b102-70ead520bcef on n-h1-858495-2 Sep 23 03:58:11.739262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e75fe5dc-95bb-436a-80d8-4c052595a588 req-d266528b-905c-4e23-9c29-1b6ae49924ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095137 Sep 23 03:58:11.740422 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2107/4097] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:11.746302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:11.747397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:11.754727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.755448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.756037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:11.757502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:11.758112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:11.758719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:12.195970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:12.290477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:12.292807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:12.294478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a1b825c-dd8d-44fb-8108-9e3537cf1567 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1849 microversion: 2.42 time: 0.938939 Sep 23 03:58:12.322947 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1991/4098] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:11 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1849 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:12.328199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2614e2dd-8158-48a4-8419-a27bda93a8e7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:12.329878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2614e2dd-8158-48a4-8419-a27bda93a8e7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:12.705709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:12.722947 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-819f8c7e-040a-4a2a-83d6-37d88a945766 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 0.979524 Sep 23 03:58:12.725482 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2108/4099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:11 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:12.737188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:12.746960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:12.771108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:12.773857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:12.774866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:12.775908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:12.776552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:12.777238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:12.845957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2614e2dd-8158-48a4-8419-a27bda93a8e7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:12.873004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2614e2dd-8158-48a4-8419-a27bda93a8e7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1215 microversion: 2.1 time: 0.550400 Sep 23 03:58:12.887756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1992/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:12 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1215 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:12.898686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:12.899688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:12.921096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:12.922776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:12.923472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:12.924458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:12.925139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:12.925827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:13.333789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:13.355225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-43af03a7-80b2-48b4-a904-971de7674996 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1493 microversion: 2.1 time: 0.627129 Sep 23 03:58:13.357496 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2109/4101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:12 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1493 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:13.364285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:13.369587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:13.393333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:13.394108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:13.396213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:13.398304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:13.398948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:13.399561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:13.820956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:13.839062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:13.841294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:13.845816 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ffe2a03-f6a0-4678-a5e0-838ee8146764 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.487101 Sep 23 03:58:13.849604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2110/4102] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:13 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:13.861086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:13.862407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:13.863426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:13.884159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84d913b1-1055-44a1-b274-4195853a97d8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.986980 Sep 23 03:58:13.884850 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1993/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:12 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:13.898818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:13.901912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:13.902628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:13.906611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:13.909585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:13.910282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:13.913777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:13.915489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:14.004931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:14.011060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:14.019705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:14.020501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:14.020995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:14.021472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.079856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.093767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.105117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.115374 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b40f0e79-9081-499e-9280-ec6beb08af58 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 1.229300 Sep 23 03:58:15.130327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1994/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:13 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:15.130418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.130418 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9a463e0-d02a-4941-b191-3a113b226833 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1849 microversion: 2.42 time: 1.278818 Sep 23 03:58:15.130418 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2111/4105] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:13 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1849 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:15.149173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:15.149840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:15.154679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:15.174567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:15.213258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.213798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.214247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.215450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.215970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.216436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.217176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.217664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.218105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.228473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.228976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.229462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.433245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.442631 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7052c60-dccb-4576-b868-b651f69aa7b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1285 microversion: 2.1 time: 0.320844 Sep 23 03:58:15.448450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1995/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:15 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:15.463417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e4f391-ef43-451c-b182-638e426cefd2", "tag": "53eea247-67fd-414f-abcd-9cd60af80488"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:15.484937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.490218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.490845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.541538 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] Creating event network-changed:53eea247-67fd-414f-abcd-9cd60af80488 for instance 21e4f391-ef43-451c-b182-638e426cefd2 on n-h2-858495-2 Sep 23 03:58:15.556713 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e6cf9414-fb17-42de-b980-f017c7b28190 req-456bd6e9-27d6-4e7b-ac96-224d95de6589 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105733 Sep 23 03:58:15.561471 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1996/4107] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:15.585623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:15.591999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85b0d0ad0044fbb1189575d448dd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f20556a60e946f5bffafdbac4b76964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:15.595938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:15.603375 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c7f7735-d5f0-4746-9ffe-e466bb71cfc3 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 200 len: 1451 microversion: 2.1 time: 0.471841 Sep 23 03:58:15.607725 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2112/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:15 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 1451 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:15.640583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:15.646417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:15.658845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:15.661319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.661863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.662313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.671960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.672572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.673656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.676326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:15.685155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.685714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.690563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:15.691551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:15.692040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:15.692514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.155079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:16.167030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:16.177748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:16.179487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f13452e-5700-4c84-83d0-1c7e82ab94b8 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.616746 Sep 23 03:58:16.185701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1997/4109] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:15 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:16.203923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5", "name": "network-vif-deleted", "tag": "b0860e42-7cae-4e3e-b5e3-06d6e87acbd4"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:16.238354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:16.240230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:16.241045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.254039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:16.271309 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fc195b9d-5c21-4a18-a2d2-277afc41c960 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.631711 Sep 23 03:58:16.271744 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] Creating event network-vif-deleted:b0860e42-7cae-4e3e-b5e3-06d6e87acbd4 for instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 on n-h1-858495-2 Sep 23 03:58:16.277444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f133b275-d40f-4079-b093-e9c53a28a94d req-3d9841f6-289a-406e-9f75-fc568ddd92c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090303 Sep 23 03:58:16.278285 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2113/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:15 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:16.282128 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1998/4111] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:16.288849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:16.289218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:16.289901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:16.290154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:16.298865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:16.302144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:16.302932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.303930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:16.304567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:16.305153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.308505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:16.309203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:16.309646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.310422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:16.311139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:16.311777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:16.332523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:17.683610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:17.692258 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd3bb8b7-599b-4448-a7a7-a8bb5e855c93 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 1.412826 Sep 23 03:58:17.696678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2114/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:16 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:17.701744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:17.710227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:17.722576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.724300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.724915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:17.731796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.732530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.733142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:17.763439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:17.809718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:17.811787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:17.829668 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84c6153b-e441-4f9b-9dda-ee1d7d103353 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1849 microversion: 2.42 time: 1.543232 Sep 23 03:58:17.831898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 1999/4113] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:16 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1849 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:17.838960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:17.844644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] [instance: 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:17.861750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.864226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.866708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:17.872697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.873486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.874242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:17.908081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] HTTP exception thrown: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Request method failure captured: Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 HTTP/1.1 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4_ZC7uJ-zZXpDGGzYGEeVppvZX-ldfaueLR7f3McVpeHNTI73204v4pxo9HCM8_ganWHN2XVlJqXPOXcXbH2vSCfoYrusvD5-11bgMxJ818g85ZDQWxa6QhHQzc1367Vqgrw6ngClL9VARciy53akXdwdjEpc0iGdJvX1pzYyTFN8 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 6f20556a60e946f5bffafdbac4b76964 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f20556a60e946f5bffafdbac4b76964"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 6f20556a60e946f5bffafdbac4b76964 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueTestJSON-1385302925 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueTestJSON-1385302925-project Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 8f85b0d0ad0044fbb1189575d448dd47 Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueTestJSON-1385302925-project Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5'} Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:17.915484 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. Sep 23 03:58:17.919023 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:17.921543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] Returning 404 to user: Instance 4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:58:17.924951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7410f71-0755-46d6-a5ff-a8bf81400a57 tempest-ServerRescueTestJSON-1385302925 tempest-ServerRescueTestJSON-1385302925-project] 10.222.0.25 "GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5" status: 404 len: 111 microversion: 2.1 time: 0.091650 Sep 23 03:58:17.931792 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2000/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:17 2022] GET /compute/v2.1/servers/4dcedd78-9d83-4d4d-b9ce-e0b8ba59aae5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:58:17.946362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:17.947304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:17.968076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.974670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.981625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:17.982736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:17.983418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:17.988017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.246129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:18.261547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:18.263629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:18.268043 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-168cbb19-68d4-410d-b7bc-86d28e2af791 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.333729 Sep 23 03:58:18.276335 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2001/4115] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:17 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:18.289550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:18.290410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:18.307241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:18.307994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:18.308631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.313693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:18.314372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:18.314831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.571247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:18.585014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a59e7d9f-b833-4988-9dd1-2a15d5b69d63 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 0.882224 Sep 23 03:58:18.586439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2115/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:17 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:18.677761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "b9a165f5-5498-48d5-a507-4312040da971"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:18.689642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:18.692671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:18.693440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.710161 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] Creating event network-changed:b9a165f5-5498-48d5-a507-4312040da971 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:18.718941 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a70bff98-b673-440e-b9ac-282d76419cf4 req-06facae1-d29b-4b3d-9b46-0c2e4bd6682a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046421 Sep 23 03:58:18.722104 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2116/4117] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:58:18.741194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:18.743309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:18.752819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:18.757894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:18.758612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.759565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:18.761047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:18.763322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:18.963155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:18.997159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd46c6e7-8a51-446b-8dba-1ed839c84cc3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.718099 Sep 23 03:58:19.001655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2002/4118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:18 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:19.007198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:19.009191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:19.024847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.027727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.028348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.030087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.037833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.039774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.291640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.301976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.310863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.313064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e13ec538-53b9-45d8-94a2-a36bda90404d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1849 microversion: 2.42 time: 0.309675 Sep 23 03:58:19.317599 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2003/4119] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:19 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1849 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:19.328495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:19.329609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:19.333148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.347145 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3672c83a-3bc7-44de-af80-4047df5db3db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 0.621565 Sep 23 03:58:19.351270 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2117/4120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:18 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:19.359049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.364046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.364833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.365868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.366522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.367121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.561900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.578418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.583404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.588268 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c09009f-3910-4e6a-b52d-9ad814808f04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.266907 Sep 23 03:58:19.589670 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2004/4121] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:19 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:19.612229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:19.612859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:19.624775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.630612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.631101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.632435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:19.632912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:19.633370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:19.966685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:19.980764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99a805d5-6a79-428e-bd6e-2991fc1e68c8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 0.371526 Sep 23 03:58:19.989015 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2118/4122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:19 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:20.021144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:20.021909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:20.031395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.046175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.046970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:20.047926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.048580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.049227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:20.347054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:20.347990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:20.362735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.363201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.370930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:20.373359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.373742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.374376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:20.914695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:20.934025 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-038c960a-fd14-437e-bfc7-c2d39d596860 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.916436 Sep 23 03:58:20.953453 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2005/4123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:20 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:20.968029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:20.970224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:20.984917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.987345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.992256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:20.997175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:20.997858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:20.998484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:21.074670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:21.136899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:21.422294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:21.434349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:21.446443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:21.457656 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-025c6659-3047-4fee-a53f-acd09d28c89b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1870 microversion: 2.42 time: 1.113383 Sep 23 03:58:21.481377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2119/4124] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:20 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1870 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:21.488418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:21.500186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:21.500907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:21.501837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:21.538795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] Creating event network-changed:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h1-858495-2 Sep 23 03:58:21.551273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8ad02009-53a3-4a0d-ac2e-011f96de60f1 req-1dba2b42-b41e-446b-9c62-fd82ae41ad86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065337 Sep 23 03:58:21.552178 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2120/4125] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:21.565760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:21.570415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:21.593615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:21.594486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:21.596621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:21.598996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:21.601041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:21.605056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.027426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.057129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.058852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.060858 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1426ced-792d-4237-b385-3bccdb62fd47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.507323 Sep 23 03:58:22.061987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2121/4126] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:21 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:22.066993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:22.067758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:22.075911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.077081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.077721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.078606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.079233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.080126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.109457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.120901 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34c91b59-f5db-4c3e-9423-6c6079b93201 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 1.166021 Sep 23 03:58:22.142194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2006/4127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:20 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:22.153952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:22.154850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:22.174313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.175109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.175703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.176587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.177199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.177811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.719312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.731678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1bddbb3e-d056-4e6c-942a-1ca9643e8bf4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.587663 Sep 23 03:58:22.738211 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2007/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:22 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:22.748951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:22.762345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:22.783222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.788781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.789468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.795072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:22.796451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:22.799414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:22.867265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:22.965016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:22.976152 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13e30494-e3eb-41ac-b2bd-22eff26b80f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 0.911243 Sep 23 03:58:23.014149 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2122/4129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:23.027769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "f756178c-a6c4-4562-95fb-837eb406ca99"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:23.095561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:23.097943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:23.099817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:23.134148 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] Creating event network-changed:f756178c-a6c4-4562-95fb-837eb406ca99 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:23.139901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4d6c31ec-93f3-422d-a4e5-5b147d09eb79 req-3d1c1e40-7580-4d26-a4bb-58c8bcc4ef3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124213 Sep 23 03:58:23.142233 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2123/4130] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:23.149338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:23.151726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:23.159809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:23.163312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:23.164072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:23.165034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:23.167106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:23.172991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:23.194736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:23.781884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:23.796168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:23.800716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:23.804479 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cac7c492-9c25-4a70-889e-2fe135c0a512 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.658347 Sep 23 03:58:23.807682 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2124/4131] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:23 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:23.827237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:23.827908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:23.842101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:23.843580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:23.844037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:23.846559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:23.847045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:23.853400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:24.715126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:24.722952 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5abd60f3-1e59-4b93-9d68-cc86fc589bef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 0.912781 Sep 23 03:58:24.723545 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2125/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:23 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:24.760466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:24.761321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:24.785405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:24.786151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:24.786765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:24.787683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:24.788438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:24.789020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:24.905240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:24.924385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:24.926650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:24.933611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4224d24-bd45-4c38-a250-62550db08e0f tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1870 microversion: 2.42 time: 2.187966 Sep 23 03:58:24.934742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2008/4133] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:22 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1870 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:24.954056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e4f391-ef43-451c-b182-638e426cefd2", "name": "network-vif-plugged", "status": "completed", "tag": "53eea247-67fd-414f-abcd-9cd60af80488"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:24.996000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:24.997916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:25.000074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:25.036777 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] Creating event network-vif-plugged:53eea247-67fd-414f-abcd-9cd60af80488 for instance 21e4f391-ef43-451c-b182-638e426cefd2 on n-h2-858495-2 Sep 23 03:58:25.067014 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-beae28c9-6a0b-4d3b-bc0a-f86f6a96c6e2 req-27c15702-da07-4d8d-9c6c-aadc43de27c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128829 Sep 23 03:58:25.070178 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2009/4134] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:25.091383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:25.093134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:25.143777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:25.156370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:25.158443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30bf9e5e-bbea-4b73-9ac1-627b7327e671 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.405382 Sep 23 03:58:25.159248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:25.161239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:25.162282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:25.165484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:25.165935 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2126/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:24 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:25.168168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:25.170809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:25.171425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:25.182433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:25.185975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:25.190071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:25.191320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:25.191955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:25.192543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:25.991935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.007056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.008549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.009814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e46e0170-b121-4639-a872-201cd2549c0f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.842789 Sep 23 03:58:26.020118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2127/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:25 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:26.034490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:26.047615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:26.060413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.060929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.061417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:26.062156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.062705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.063162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:26.186975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.202215 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7bbef198-09b2-4d6c-8f12-713d374e01a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 1.121672 Sep 23 03:58:26.218062 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2010/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:26.225330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:26.232348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:26.244198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.248667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.258931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:26.260162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.260798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.261451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:26.862660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.875644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.878160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:26.879704 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6169d8c0-4946-4729-a526-d6a249c2a0e7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1891 microversion: 2.42 time: 0.660268 Sep 23 03:58:26.903857 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2011/4138] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:26 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1891 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:26.910104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:26.910942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:26.918147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.918939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.919612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:26.920580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:26.921263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:26.922424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.153687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.164173 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93b03956-47cc-460f-bf2d-816acfeef9be tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 1.142852 Sep 23 03:58:27.164776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2128/4139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:26 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:27.181596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:27.182244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:27.215309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.215879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.216407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.217640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.217732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.219787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.338587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.352863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.354407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.355632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-733b5b79-751c-440b-a9ee-8ecfa0b0126f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.189919 Sep 23 03:58:27.356209 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2129/4140] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:27 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:27.379341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "name": "network-vif-plugged", "status": "completed", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:27.482174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.482174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.482174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.482450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.482912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] Creating event network-vif-plugged:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h1-858495-2 Sep 23 03:58:27.489612 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e891cee-d93e-4f8d-ab69-e316ba3e9f85 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.583343 Sep 23 03:58:27.501382 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2012/4141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:26 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:27.501382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:27.501382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:27.518212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.526321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.526951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.527854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.528447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.529004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.573659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ee0e84a2-ae60-42ed-b2f8-58d44e04b46e req-e4b8fda7-b66b-4b86-947b-2e10c6fb66f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216116 Sep 23 03:58:27.579602 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2130/4142] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:27.641639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "48160dd4-7d3f-4627-9478-964935552a7e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:27.664598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.665088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.665556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.687674 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] Creating event network-changed:48160dd4-7d3f-4627-9478-964935552a7e for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:27.694239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2b43334c-b3b4-4898-9427-3a23a09d2141 req-59496599-ed99-4c16-a243-4b7f9134b2e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057513 Sep 23 03:58:27.695077 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2131/4143] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:58:27.911102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:27.911826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:27.932821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.933334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.950026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.952118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:27.952706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:27.953404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:27.963275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:27.986411 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e81dfda-ff69-4044-bfba-9ba4b6e87271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 0.487649 Sep 23 03:58:27.990171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2013/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:27 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:28.198753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:28.199463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:28.209441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.219888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.220758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:28.222607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.223166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.223687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:28.815778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:28.836668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:28.838179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:28.839745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33aa75dd-58ff-4593-8b70-6ffa834e1337 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1891 microversion: 2.42 time: 0.933290 Sep 23 03:58:28.841333 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2132/4145] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:27 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1891 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:28.850630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:28.851463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:28.851573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:28.861503 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ad25bcb-c8b9-416f-9329-00d35b1abb15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1314 microversion: 2.1 time: 0.670043 Sep 23 03:58:28.862118 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2014/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:28 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:28.866856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.867560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.869984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:28.870926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.874106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.874822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:28.902934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:28.905218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:28.913022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.914172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.914843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:28.916579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:28.917386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:28.918138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.016033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:29.033019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:29.039283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:29.042389 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c61e16a6-f882-47ce-9abf-ebefbb004f00 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.198356 Sep 23 03:58:29.044517 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2133/4147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:28 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:29.054102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:29.057718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:29.065319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.066496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.067161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.068062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.069238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.069887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.180542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:29.189294 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b5b1757a-725f-43e1-94b0-52cf6865808c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.316696 Sep 23 03:58:29.197629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2015/4148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:28 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:29.701841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:29.713306 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bd3eb8f-6f75-496e-8264-26ce42d9d119 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1315 microversion: 2.1 time: 0.664274 Sep 23 03:58:29.719817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2134/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:29 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:29.874259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:29.875253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:29.891054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:29.892460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.895029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.895952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.896857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.896981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:29.903015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.904272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.914566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.916325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.926426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:29.928815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:29.930446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:29.931353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:30.536090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.553316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.559505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.563686 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d0ff14f-72b1-4521-b544-b124b422553e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1891 microversion: 2.42 time: 0.691388 Sep 23 03:58:30.582319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.586935 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2016/4150] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:29 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1891 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:30.595668 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-61d312b2-ece9-4114-998f-0cb9bf8c689b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1500 microversion: 2.1 time: 0.710040 Sep 23 03:58:30.602079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2135/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:29 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1500 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:30.604583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:30.606533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:30.620632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:30.621990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:30.636490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:30.637713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:30.638333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:30.639688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:30.640310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:30.641922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:30.644086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:30.648866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:30.649512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:30.653690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:30.659432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:30.661031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:30.734680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:30.896676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.906623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.913272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:30.914567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05c34c5e-f98e-448b-9bd2-7e68b5fd28f1 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.321516 Sep 23 03:58:30.937716 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2017/4152] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:30 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:30.948901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "78988203-0141-4fe7-840c-b2a2258f2e39"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:30.971393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:30.971874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:30.980638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.013984 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] Creating event network-changed:78988203-0141-4fe7-840c-b2a2258f2e39 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:31.020953 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a75364ad-a1ce-41f3-bf7a-b8a4da7f6da4 req-a5cd6c8f-3da6-4dc9-9191-3507952067c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081754 Sep 23 03:58:31.026945 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2018/4153] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:31.039516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:31.046592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:31.060844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.061338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.064445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.065318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.065820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.066258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.177943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74d44c94-f545-4fe7-aeb6-bfa55fc8b5b1 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 14 microversion: 2.1 time: 0.149455 Sep 23 03:58:31.182833 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2019/4154] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:31 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:31.189178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:31.190515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:31.198960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.199899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.200510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.201423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.202032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.202611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.261021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:31.285622 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-552d7eb6-f9e5-424a-a791-61e7bab2832f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.681015 Sep 23 03:58:31.292808 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2136/4155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:30 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:31.601853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:31.602740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:31.613819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.619714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.620356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:31.621376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:31.624154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:31.624790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.321519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.349446 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50da556a-e52d-4c47-b40c-443a4bd9d314 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 1.155701 Sep 23 03:58:32.355375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2020/4156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:31 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:32.383315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:32.384057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:32.409807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.415145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.415654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.417231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.420440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.422764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.756548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.758792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.774570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.776696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.780153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f58dec9a-3b8b-4819-8d5f-c5cc6fffaa1f tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.420346 Sep 23 03:58:32.801317 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2021/4157] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:32 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:32.801576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.801576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:32.801793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:32.801891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2dd906ea-b709-4161-abd0-f8c61e6f94d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1891 microversion: 2.42 time: 1.203694 Sep 23 03:58:32.801891 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2137/4158] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:31 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1891 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:32.803081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:32.816565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.817194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.819868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.820670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.821154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.821992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.827365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:32.828488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:32.834971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.835531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.835914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.836638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:32.837221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:32.837701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:32.937958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3cb6e93-8380-4048-bd7d-c53cd5096e40 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 14 microversion: 2.1 time: 0.152475 Sep 23 03:58:32.939630 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2022/4159] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:32 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:32.947531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-368220916", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:33.071150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] validate_networks() for [('9586326b-a441-4e4d-8a95-584444e131a4', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:58:33.456858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:33.465322 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10c62334-8231-4c36-a941-fdd5c2403a17 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.641930 Sep 23 03:58:33.476356 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2138/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:32 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:33.680234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "23565f04-5690-4520-ad41-b96190b6c520"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:33.715586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:33.732600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:33.735538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:33.763887 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] Creating event network-changed:23565f04-5690-4520-ad41-b96190b6c520 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:33.772483 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-67f4ee72-e672-4dfb-844b-57c2fc7257c1 req-b44f18a2-2ede-4551-b276-dcf90e7f0b40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093209 Sep 23 03:58:33.785202 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2139/4161] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:33.812516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:33.814414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:33.825283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:33.829030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:33.829881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:33.830783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:33.832630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:33.833241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.033061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.043923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.055351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.056889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b53ac3ef-c6a3-4123-9f71-1a30df05e5af tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.252614 Sep 23 03:58:34.058078 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2140/4162] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:33 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:34.064208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:34.071164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:34.085116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.097896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.098542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.100136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.101323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.104683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.850767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:34.851886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:34.852826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:34.853428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:34.854313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:34.870564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.873457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.874591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.877131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.878138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.878795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.879388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.893688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.895215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:34.897011 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-354b4fbb-3fe0-40c4-a1a0-a4d8f304fab6 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1891 microversion: 2.42 time: 0.837221 Sep 23 03:58:34.901935 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2141/4163] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:34 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1891 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:34.917251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:34.928989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:34.936547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Getting quotas for project 1dd28846bbd84139a95f8d509db77cea. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:34.953431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Getting quotas for user 6539dc2b60a14449b5a970a8f558a691 and project 1dd28846bbd84139a95f8d509db77cea. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:34.961089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.961633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.965244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.967143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:34.973374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:34.974169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:34.989638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:58:34.997391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:58:35.118042 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23fb4f1b-dde5-474c-8286-17638cc94c64 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177122 Sep 23 03:58:35.120808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2023/4164] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:58:35.132350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:35.134173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:35.174592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:35.178798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:35.179534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:35.180494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:35.182606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:35.183939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:35.919599 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-14e1d50c-aa21-4a1f-9f28-fba22ab597e2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 14 microversion: 2.1 time: 1.014253 Sep 23 03:58:35.924140 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2142/4165] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:34 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 14 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:35.938690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:35.941543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:35.964886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:35.978919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:35.979387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:35.980149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:35.981099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:35.981741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.030146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:36.212457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.228832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.238467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.239912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.246596 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af4d9414-796a-4b1d-9d20-087bb6015b47 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1408 microversion: 2.54 time: 0.315663 Sep 23 03:58:36.248377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2143/4166] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:35 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:36.251714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9d89936-42a9-45fa-a226-1068543cb50c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 1.129660 Sep 23 03:58:36.268524 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2024/4167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:35 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:36.282868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:36.283447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:36.284274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:36.284403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:36.306371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.307621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.309637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.310548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.312316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.313103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.326681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.328610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.329700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.335724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.337003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.341872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.597223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.612362 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e4270b0-da8c-4bac-94ee-a70cd2fd081e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1212 microversion: 2.1 time: 0.362116 Sep 23 03:58:36.613066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2144/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:36 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1212 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:36.839726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.850479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.858314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:36.859628 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1b627fb-3137-4139-8c7e-6010221d5e1a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.589601 Sep 23 03:58:36.873732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2025/4169] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:36 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:36.927937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "154b1f8d-297e-42ac-93ef-44d89c53c04b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:36.935188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:36.944589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:36.961642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.966130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.966937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.967558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.968458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:36.969254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.969934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:36.970546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:36.972827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.025988 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] Creating event network-changed:154b1f8d-297e-42ac-93ef-44d89c53c04b for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:37.031612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6bc5e965-bc68-4080-bede-8f301a3b5faa req-e1134345-04b2-432d-90af-90dd0341ff64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108638 Sep 23 03:58:37.036158 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2145/4170] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:37.279969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:37.281034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:37.296489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.296998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.297332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.298115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.298591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.298986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.432684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:37.441152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:37.442640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:37.443871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa1cbee0-f557-4b06-b91e-e4f9db5dace0 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1414 microversion: 2.54 time: 0.168903 Sep 23 03:58:37.444444 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2146/4171] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:37 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:37.459648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:37.459648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:37.479560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.480204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.481158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.482119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.482653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.483087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.738919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:37.756280 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc0171d8-4f6f-4521-8814-0cd2471e420d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1524 microversion: 2.1 time: 0.305130 Sep 23 03:58:37.760830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2147/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:37 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:37.773440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:37.774458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:37.786564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.787383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.788047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.790263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:37.790884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:37.795526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:37.959539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:37.989436 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-100fab84-118b-4ee8-beae-cabdb51610a0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1268 microversion: 2.1 time: 0.215794 Sep 23 03:58:37.989436 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2148/4173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:37 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1268 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:37.993563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:37.993563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:38.007024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.007651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.008123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:38.008753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.009262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.009862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:38.291221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.353326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.374044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.376381 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a6caa78-a25d-4b26-8288-4b7dc03717ae tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.393857 Sep 23 03:58:38.380936 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2149/4174] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:37 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:38.485268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:38.491090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:38.502903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.503799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.504801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:38.505839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.506515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.507107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:38.676170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.687965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.689934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:38.692064 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-672ae653-7ce7-481e-9dfc-43085e15ef69 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1414 microversion: 2.54 time: 0.218613 Sep 23 03:58:38.693696 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2150/4175] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:38 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1414 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:38.785706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:38.786460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:38.796132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.797147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.797623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:38.798812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:38.799375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:38.799809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.026841 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9776d176-ab5e-44a9-a72c-8007c58b88e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 14 microversion: 2.1 time: 2.088979 Sep 23 03:58:39.032226 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2026/4176] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:36 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 14 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:39.038757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:39.042255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:39.069054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.069674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.070217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.070974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.071466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.078579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.179379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.188081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a576e4f-5b90-4019-a9b4-174344853def tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1506 microversion: 2.1 time: 0.408259 Sep 23 03:58:39.194347 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2151/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:38 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:39.205508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "14f2489d-67f5-4a49-adb7-6b5d73463f20"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:39.220335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.221072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.221689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.239116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] Creating event network-changed:14f2489d-67f5-4a49-adb7-6b5d73463f20 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:58:39.247704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-55a4c6d2-a5af-47cf-bf83-c5eda5240193 req-b3103d3c-4d87-4fcb-b670-fe3cfe7d5d0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051016 Sep 23 03:58:39.248930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2152/4178] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:39.269949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.284682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9a28f6f-f424-401e-87bc-5d38d878913e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1268 microversion: 2.1 time: 0.250139 Sep 23 03:58:39.285300 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2027/4179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:39 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:39.416935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:39.418486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:39.428037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.429078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.430336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.431218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.434446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.436282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.722741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:39.723519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:39.731527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.732321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.732930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.733874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:39.734495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:39.735238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:39.856874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.868866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.870797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.872251 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aba7ec1a-9ed0-4ed8-95bd-9ad242dcb895 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1414 microversion: 2.54 time: 0.157275 Sep 23 03:58:39.876044 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2028/4180] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:39 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1414 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:39.930448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.960884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.967440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:39.968707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb7bd0dc-8ca4-42f7-b78d-4fab81af81aa tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.565511 Sep 23 03:58:39.969963 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2153/4181] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:39 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:40.040383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:40.048254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:40.062144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.062908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.063526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.064415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.065113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.065727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.159125 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88c254b7-356f-4cb7-9c65-6d9cbb53f994 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 14 microversion: 2.1 time: 0.123439 Sep 23 03:58:40.159847 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2029/4182] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:40 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:40.220139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:40.223597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:40.239062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.239715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.240242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.243082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.243653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.249059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.364602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-715394817", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:40.434037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] validate_networks() for [('585724df-e90c-4846-b16b-92fa62b61834', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:58:40.613060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:40.627791 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a592af47-65cf-4ae2-9ff7-efcc8bcdf48f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1506 microversion: 2.1 time: 0.412077 Sep 23 03:58:40.629189 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2030/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:40 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:40.637306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:40.638265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:40.649039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.649922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.652202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.653171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.656054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.657001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.772634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:40.782203 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9af2f530-3c23-4117-be0a-bff7b17bb247 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1274 microversion: 2.1 time: 0.151606 Sep 23 03:58:40.790707 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2031/4184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:40 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:40.903523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:40.904479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:40.911187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.912507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.913144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:40.914129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:40.914805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:40.915447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.029543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.045620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.047772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.049335 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9bbf490d-9e0a-4e16-9965-1326496b36f3 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1414 microversion: 2.54 time: 0.149862 Sep 23 03:58:41.050546 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2032/4185] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:40 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:41.057418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:41.058510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:41.069079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.069855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.070872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.072499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.073179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.073840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.647505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.690581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.703017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:41.703881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:41.704586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:41.705247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:41.705861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:41.713707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:41.715940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6fe13f6d-c48a-444f-a7a9-877616e5cc50 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.664026 Sep 23 03:58:41.726064 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2033/4186] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:41 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:41.726429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.727127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.734531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.740774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:41.741964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.742544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.743067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.751363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:41.765456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.766962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.770277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.771450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.772099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.775737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.778201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Getting quotas for project aae1fb33ff714654a0787eb6685b64f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:41.820346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Getting quotas for user 99d15160939d40f0a177b9ba1698ae07 and project aae1fb33ff714654a0787eb6685b64f3. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:41.871254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:58:41.874074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:58:41.885103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4cc3211e-e36f-487e-9bc4-974835194d4c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action" status: 200 len: 8205 microversion: 2.1 time: 0.157283 Sep 23 03:58:41.886305 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2034/4187] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:41 2022] POST /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2/action => generated 8205 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:41.892742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:41.893499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:41.914587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.915100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.915553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.916283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:41.930845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:41.931337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:41.993861 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ce5e6d50-fa2f-4a04-b953-1a1bb8f7c15f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.792982 Sep 23 03:58:42.003033 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2154/4188] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:58:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:58:42.014364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:42.018982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:42.031315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:42.038229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:42.039048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:42.040018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:42.040699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:42.041399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:42.918511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:42.942610 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79c325cf-4cae-4306-b672-2dd41e40ca07 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.937085 Sep 23 03:58:42.953713 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2155/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:42 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:43.030807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.041135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346b663-e628-4790-b102-70ead520bcef", "name": "network-vif-unplugged", "status": "completed", "tag": "e2ed51b2-15d4-4606-a5ce-7f2652c6c96a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:43.052761 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f2412f2-aa47-46a4-8968-7e181b2f36b6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 200 len: 1449 microversion: 2.1 time: 1.164504 Sep 23 03:58:43.057431 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2035/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:41 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 1449 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:43.072145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:43.078704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.081183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:43.082587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.083217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.087031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:43.106850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.108340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.109079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.113433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.114165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.114924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.116042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.server_external_events [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] Unable to find a host for instance e346b663-e628-4790-b102-70ead520bcef. Dropping event network-vif-unplugged {{(pid=128724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 03:58:43.119189 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5b991b8c-cc9d-455e-a97d-082e430f8606 req-19a4f5fb-734a-4b64-8263-ee13abbb35da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.163700 Sep 23 03:58:43.122763 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2156/4191] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 168 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 03:58:43.141538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:43.143955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:43.165118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.165639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.166080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.166807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.167278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.167760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.351594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.369747 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fdea795-2444-438e-acdb-3d161ae7a8b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1274 microversion: 2.1 time: 0.245560 Sep 23 03:58:43.381670 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2157/4192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:43 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:43.392619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:43.393460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:43.420124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.420631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.426121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.428304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.429057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.429714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.611334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.641522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.650505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.658793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:43.661098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e12c2fa2-ae01-496f-8c37-4330956c5e5c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.589161 Sep 23 03:58:43.662659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d30f3bd-d78c-4076-bdae-1f672a6a3aee tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1399 microversion: 2.54 time: 0.279764 Sep 23 03:58:43.663616 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2036/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:43 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:43.665293 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2158/4194] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:43 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1399 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:43.672109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:43.672975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:43.677844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:43.678963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:43.696979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.698190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.698866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.700350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.701039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.701699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.710855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.711652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.712114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.714304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:43.714791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:43.715241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:43.721691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:43.760605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:58:43.794550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Working on deleting snapshot 65114d66-9e18-412b-976f-a093a654fd4f from shelved instance... Sep 23 03:58:44.607874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:44.627366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:44.629839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:44.630708 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8936491c-869b-4833-959a-5927f0e1bd63 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.965396 Sep 23 03:58:44.631345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2037/4195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:43 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:44.669959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:44.670591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:44.706216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:44.707309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:44.708084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:44.710547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:44.711826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:44.712503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:44.908596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:44.975165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:45.049041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Doing local delete in cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128724) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 23 03:58:45.049826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:45.050683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:45.050797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:45.051176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 23 03:58:45.059534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] deallocate_for_instance() {{(pid=128724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 23 03:58:45.244951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:45.257995 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7a9aee2-20a6-4bba-a5f5-ad431d44c764 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.597728 Sep 23 03:58:45.259364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2038/4196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:44 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:45.288197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3166b3a8-77a5-457b-a6ea-3ab235c1699e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '.version_select at 0x7f0c93398d30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:45.309252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:45.342380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3166b3a8-77a5-457b-a6ea-3ab235c1699e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1119564786" status: 204 len: 0 microversion: 2.54 time: 0.081716 Sep 23 03:58:45.348719 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2039/4197] 10.222.0.25 () {60 vars in 1319 bytes} [Fri Sep 23 03:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1119564786 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:58:45.369408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:45.370369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:45.391834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:45.392750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:45.393771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:45.397903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:45.398816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:45.401102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:46.089679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:46.105608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-472c714b-bcd0-40b2-8f10-4e1fd34ce96b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.753262 Sep 23 03:58:46.107758 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2040/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:45 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:46.121472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:46.124511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:46.138736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:46.139245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:46.140858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:46.141716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:46.142195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:46.145998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:46.597623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:46.611678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b4d852f-ff35-4fee-8545-c97e96aa6fe6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1322 microversion: 2.1 time: 0.502589 Sep 23 03:58:46.617238 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2041/4199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:46 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:46.622280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:46.623230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:46.639512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:46.640638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:46.641230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:46.642562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:46.643116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:46.643689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:46.995578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Updating instance_info_cache with network_info: [] {{(pid=128724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:58:47.091571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.100421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b2dca4f-969a-4357-8a67-f5e0ba447a9d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.481948 Sep 23 03:58:47.103381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2042/4200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:46 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:47.134144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.134881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.141421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.142369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.142965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.143852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.144502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.144944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.187012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:58:47.276161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:47.279869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88b5efe5-7de7-4696-9824-1afc506554a4 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 204 len: 0 microversion: 2.54 time: 0.159578 Sep 23 03:58:47.281429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2043/4201] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 03:58:47 2022] DELETE /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:58:47.289410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2", "tag": "a04886fe-0988-4c61-b654-c76f35b13995"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:47.309751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.310586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.311235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.326081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] Creating event network-changed:a04886fe-0988-4c61-b654-c76f35b13995 for instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 on n-h2-858495-2 Sep 23 03:58:47.331786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5069164f-1669-42e1-b748-e31bfc2d90c8 req-cd6db1fe-a26b-41e7-b6f3-2a430131f6be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048703 Sep 23 03:58:47.332828 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2044/4202] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:47.338166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.338870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.345062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.345799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.346250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.346953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.347416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.347850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.403776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbcbf823-c096-4dc6-abe3-b5c330d8c7db tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 204 len: 0 microversion: 2.1 time: 3.736621 Sep 23 03:58:47.404535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2159/4203] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:58:43 2022] DELETE /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 0 bytes in 3738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:58:47.409417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:47.419435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.419926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.420436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.431957 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] Creating event network-changed:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:58:47.438143 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b39288ba-5400-4906-9f07-02c2577ce843 req-e757c77f-051d-42a0-b3a6-282569f4f1ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032257 Sep 23 03:58:47.439400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2160/4204] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:47.446185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.447051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.453567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.454054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.454491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.455273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.455727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.457778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.613182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.623373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.625062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.626626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7330df6-2fc7-4ecb-a772-9a2e363a3dad tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.292575 Sep 23 03:58:47.627685 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2045/4205] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:47.632470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.633316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.639484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.640079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.640630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.641595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.642134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.642645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.667711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.678585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a07ff85e-75f1-489c-b47b-e1ef96b3542f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.237686 Sep 23 03:58:47.679193 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2161/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:47.691837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.692621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.699126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.699857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.700907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.701779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.702427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.703002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.778491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.789949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.791451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.792627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b5a8881-32dc-407c-88d8-0657e0ac49e7 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1405 microversion: 2.54 time: 0.105171 Sep 23 03:58:47.793343 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2162/4207] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1405 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:47.798173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.798867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.805845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.806578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.807169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.808012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.814840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:47.820315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.820779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.823753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f5c18c2-1695-4180-97bd-7de83e6160a8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.194725 Sep 23 03:58:47.824503 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2046/4208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:47.828797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:47.829435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.835879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.836376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.836820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.837558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.838026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.838602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.855648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef HTTP/1.1 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e346b663-e628-4790-b102-70ead520bcef'} Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:47.857343 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf38f101-459c-448b-8a31-20a554df0fc8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 404 len: 111 microversion: 2.1 time: 0.064262 Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2163/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:47.867355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:47.873730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.873730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.873730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.874093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:47.874491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:47.874924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:47.933721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Locking {{(pid=128724) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 23 03:58:47.999145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:48.001950 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be0d5cb3-b1fe-4629-a875-aa02d104b10b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.141401 Sep 23 03:58:48.003501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2164/4210] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:47 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:58:48.008065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1290548974", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:48.008284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3832e2c2-9748-478e-95c2-87f3bd20e5b6 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1322 microversion: 2.1 time: 0.182710 Sep 23 03:58:48.008699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2047/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:47 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:48.013342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:48.014130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:48.021907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:48.022599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:48.023275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:48.024170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:48.024598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:48.025203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:48.078550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:58:48.736804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:48.747789 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bde2d80d-70ef-423e-a53f-c943f2758967 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.737766 Sep 23 03:58:48.748664 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2048/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:48 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:48.754576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:48.756177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:48.762930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:48.763646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:48.764246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:48.765134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:48.765796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:48.766602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.140924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.150622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.153662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.155175 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d12ead85-1d78-404e-9d46-7d7f16f401cc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.405297 Sep 23 03:58:49.156385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2049/4213] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:48 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:49.162533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:49.168550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.169035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.169509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.216585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action HTTP/1.1 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 15 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: {"os-stop": {}} Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6c107016-cad8-4572-adcb-fd804409f4aa', 'body': {'os-stop': {}}} Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked Sep 23 03:58:49.219157 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:58:49.224487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 409 to user: Instance 6c107016-cad8-4572-adcb-fd804409f4aa is locked {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:58:49.224487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bdf5b9f4-0dac-420d-a700-702be1e96046 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 409 len: 107 microversion: 2.1 time: 0.066199 Sep 23 03:58:49.224999 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2050/4214] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:49 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 107 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:58:49.230074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:49.230689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:49.247971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.248821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.249275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.250025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.250912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.251356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.385363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.394918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.396388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.399583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:58:49.400794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:58:49.401274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:58:49.401811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:58:49.402404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:58:49.409147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6d92e65-0637-476d-ab2b-914939e5db8e tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1405 microversion: 2.54 time: 0.183010 Sep 23 03:58:49.410821 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2051/4215] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:49 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:49.413898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.414567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.415298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.416198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.416827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.417256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.418021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:49.418825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:49.427644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.432055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.433215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.435561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.436270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.437077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.439170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:58:49.447298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:58:49.467804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:58:49.477823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:58:49.549928 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b066192e-d47b-4c0c-b8d9-87593a06f339 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545935 Sep 23 03:58:49.556754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2165/4216] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:58:49.556754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:49.556953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:49.577883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.584818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.589945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.591655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.592357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.593048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.941401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:49.961287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6de3141-f7e9-4e3c-bc13-f78c24dd819a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.548634 Sep 23 03:58:49.964872 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2052/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:49 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:49.974847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:49.979564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:49.989041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.989795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.990312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:49.991121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:49.991651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:49.992152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.009526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.036600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d657d569-a699-4a9a-8489-41d23b1e013a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1322 microversion: 2.1 time: 0.484138 Sep 23 03:58:50.038041 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2166/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:49 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:50.047749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346b663-e628-4790-b102-70ead520bcef", "name": "network-vif-deleted", "tag": "e2ed51b2-15d4-4606-a5ce-7f2652c6c96a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:50.068740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:50.069208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.070655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.072389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.087428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Unlocking {{(pid=128723) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 23 03:58:50.110803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.server_external_events [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] Unable to find a host for instance e346b663-e628-4790-b102-70ead520bcef. Dropping event network-vif-deleted {{(pid=128724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 03:58:50.113704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-113dc564-3d38-4d44-90c0-7bc85c75339a req-b2f6a9f8-d2fc-410d-9dbb-108cb4c0d58a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.072552 Sep 23 03:58:50.114544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2167/4219] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 03:58:50.129116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-024d4af2-570e-4fbb-992c-17ecd2477343 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:50.136934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-024d4af2-570e-4fbb-992c-17ecd2477343 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:50.190219 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e758076e-5c1e-48b9-a3f9-18c25a4ff06f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.222570 Sep 23 03:58:50.195894 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2053/4220] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:49 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:58:50.210446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:50.212615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:50.231946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.233172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.233772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.234548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.235017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.235448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.297271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-024d4af2-570e-4fbb-992c-17ecd2477343 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.305891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-024d4af2-570e-4fbb-992c-17ecd2477343 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1215 microversion: 2.1 time: 0.187121 Sep 23 03:58:50.322807 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2168/4221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:50 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:50.329076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:50.337376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.338190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.339685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.420483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Going to try to stop instance {{(pid=128724) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 03:58:50.480509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56683b5d-52c9-4f47-afef-c7715b72191c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.154552 Sep 23 03:58:50.481330 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2169/4222] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:50 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:58:50.487199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:50.488138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:50.495188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.495905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.496482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.497336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.497983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.498617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.580782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.590722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.592192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.592824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.593412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72eaa933-f9ef-45d3-8594-888c891a0e8a tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1405 microversion: 2.54 time: 0.110797 Sep 23 03:58:50.594070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2170/4223] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:50 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:50.601882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:50.602669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:50.602979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.604603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.606002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00f4a4cc-a232-4239-829b-27184d7a99cf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.410789 Sep 23 03:58:50.606713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2054/4224] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:50 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:50.609065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.609656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.610172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.610938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:50.611406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:50.611842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:50.776788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:50.785141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82a10cc4-d3d9-49db-882d-23d7409b1b08 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.188891 Sep 23 03:58:50.785777 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2171/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:50 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:50.991857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:50.992567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.003330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.006004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.006802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.007531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.008072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.008423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.062747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:51.063535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.074775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.076576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.077022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.084557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.085285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.085754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.320574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.331913 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0443df43-6824-4533-adb6-b5342cf59c34 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.345440 Sep 23 03:58:51.332502 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2055/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:50 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:51.337148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:51.340691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.352648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.353405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.354017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.354901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.355756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.356208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.357997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.366695 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef6f7c12-6711-4239-81f9-2bca7ad26185 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1322 microversion: 2.1 time: 0.307958 Sep 23 03:58:51.367496 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2172/4227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:51 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:51.437747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.447542 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-218ca3bb-b051-4ebf-a380-7dcf34b7fe54 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1267 microversion: 2.1 time: 0.113365 Sep 23 03:58:51.448761 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2056/4228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:51 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:51.635007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:51.635645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.645438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.645982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:51.646692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.647098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.647766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.648704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.649236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.650552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.665841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.666493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.667017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.667895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.668484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.669065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.673537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:51.775343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.789205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.791093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.793773 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86626b8c-3a01-4968-b6cd-9b06d17edbff tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1405 microversion: 2.54 time: 0.168019 Sep 23 03:58:51.799457 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2173/4229] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:51 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:51.808323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:51.809342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:51.817830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.818246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.819019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.819887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:51.820534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:51.826284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:51.950330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.970658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.972431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:51.974663 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d80133f8-7cdd-4539-b244-0cc0f09c136d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.343594 Sep 23 03:58:51.985513 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2057/4230] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:51 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:51.997751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "name": "network-vif-plugged", "status": "completed", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:52.009609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.010384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.010972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.024303 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] Creating event network-vif-plugged:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:58:52.030088 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-254bf421-5425-444b-bb95-8d5a5400fb8c req-caa8f122-4678-4e0b-b1d5-bf3cfeb5a14d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043049 Sep 23 03:58:52.031488 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2058/4231] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:52.067898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.078649 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-416a68ac-ec28-4675-b557-3cb2d11806b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.274478 Sep 23 03:58:52.081167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2174/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:51 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:52.355722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:52.356660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:52.363067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.363633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.364147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.364917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.365478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.365987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.391687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:52.392456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:52.399245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.399955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.400393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.401088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.401587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.402013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.640726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.649830 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fad014c7-a441-43ab-b370-a92e2a5ec86f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.298857 Sep 23 03:58:52.650430 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2059/4233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:52 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:52.655202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:52.656061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:52.661973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.662645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.663296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.664023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.664498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.664940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.689546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.697960 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc65bf2f-96fa-472c-8f0c-5b8ed25d1e66 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1322 microversion: 2.1 time: 0.310459 Sep 23 03:58:52.699163 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2175/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:52 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:52.776324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.786839 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd8769c3-473c-4eee-bf22-25dbc2e485f9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1273 microversion: 2.1 time: 0.135122 Sep 23 03:58:52.787962 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2060/4235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:52 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:52.822668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:52.823954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:52.831743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.832477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.837585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.838436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.839120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.839730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.889017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:52.889795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:52.890386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:52.890986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lazy-loading 'fault' on Instance uuid 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:58:52.952953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.962308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.965254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1937dec712d14bf2bfc393474b877a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630f2124e5bc47008f009f415d1e03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:52.966691 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6fe5bc0-094a-4cf7-ac93-d245cf562252 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 200 len: 1410 microversion: 2.54 time: 0.149433 Sep 23 03:58:52.969921 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2176/4236] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:52 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:53.008171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:53.008788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:53.022302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.023625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.024316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.025244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.025950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.026594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.226082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:53.226842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:53.233039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.233909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.234663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.235685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.236368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.237167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.345057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:53.363203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:53.390791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:53.393608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b503f731-1c93-4805-baae-d8e67918b323 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.391928 Sep 23 03:58:53.395167 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2061/4237] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:52 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:58:53.535748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:53.550217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a9145f9-65c2-4199-a6ac-79144f33d86a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.449281 Sep 23 03:58:53.550682 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2177/4238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:53 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:53.675030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:53.675662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:53.683019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.683408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.683853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.684602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.685016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.685513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.721635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:53.722307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:53.730447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.730941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.731387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:53.732311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:53.732776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:53.733212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.028954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:54.037781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61f264d1-fa8f-4d9d-a959-198377da1a02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.366546 Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2062/4239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:53 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.053389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.054209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.116858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:54.128212 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1576cdb7-65cf-42dc-9266-b5d3aafa5649 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1516 microversion: 2.1 time: 0.410255 Sep 23 03:58:54.128789 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2178/4240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:53 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:54.142110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:54.143031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] [instance: 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:54.152187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.152680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.153113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.154110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.154621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.155245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.169755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] HTTP exception thrown: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Request method failure captured: Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f HTTP/1.1 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7A4hj2IAiWuV0EVhbmZ9uosinl24xAwmzGWxDuQMrdPHeelcvvEArDycbwIHSIA7mx-xRC0NdAqrwo2veYOop3djuL7mLk_gOdDZw-oyY92W4E1q-rUj1s2nr2BY1yTk3PURbSnx3Im4J-GqFBAgX6fYyPuWMSWpBDZfoD8nkHWxw Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.54 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 630f2124e5bc47008f009f415d1e03ad Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerShowV254Test-811332666 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/630f2124e5bc47008f009f415d1e03ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/630f2124e5bc47008f009f415d1e03ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/630f2124e5bc47008f009f415d1e03ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_630f2124e5bc47008f009f415d1e03ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerShowV254Test-811332666 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 630f2124e5bc47008f009f415d1e03ad Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerShowV254Test-811332666 Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerShowV254Test-811332666-project Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1937dec712d14bf2bfc393474b877a4b Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerShowV254Test-811332666-project Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f'} Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:58:54.171654 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] Returning 404 to user: Instance 8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:58:54.175391 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-825ed78f-51e5-4d8d-8e52-c5e86ef24d04 tempest-ServerShowV254Test-811332666 tempest-ServerShowV254Test-811332666-project] 10.222.0.25 "GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f" status: 404 len: 111 microversion: 2.54 time: 0.042584 Sep 23 03:58:54.178863 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2179/4241] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:54 2022] GET /compute/v2.1/servers/8c52c3f4-5b4b-438c-8aef-f4dc1439bf8f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:58:54.184729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2", "name": "network-vif-plugged", "status": "completed", "tag": "a04886fe-0988-4c61-b654-c76f35b13995"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:54.195683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.196451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.197154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.212984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] Creating event network-vif-plugged:a04886fe-0988-4c61-b654-c76f35b13995 for instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 on n-h2-858495-2 Sep 23 03:58:54.219633 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-91548a2a-1246-4036-9612-2142f507b1d2 req-6f938d51-81b7-44e5-9d4a-6c6dd5d6259c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038262 Sep 23 03:58:54.221333 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2180/4242] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:54.228743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:54.233241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:54.241293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.241818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.242261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.242981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.243441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.243868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.309831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lazy-loading 'flavor' on Instance uuid e3c5c233-8aa2-4394-8a8d-1b873d88cd00 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:58:54.452027 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-317dafbd-4f4c-4712-b202-054f52a48687 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action" status: 200 len: 32 microversion: 2.1 time: 0.228798 Sep 23 03:58:54.457040 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2181/4243] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:58:54 2022] POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:58:54.460848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:54.461759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:54.471653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.472317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.475568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.476408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.477133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.477802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.876627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:54.887021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c185059-9fba-41b9-be9b-fa3b492fd08e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.847574 Sep 23 03:58:54.889095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2063/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:54 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:54.894323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:54.895295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:54.904694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.905455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.906235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:54.907224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:54.908111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:54.908925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.038372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.057568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.059302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.060514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d581a48-d9ac-4125-93d8-f5a850aaabcb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.606219 Sep 23 03:58:55.061084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2182/4245] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:54 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:55.076708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:55.077314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:55.086026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.086762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.087658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.088642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.089313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.089956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.329777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.346219 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6f6c3a0-0a9c-47a6-a1c0-29809cb71c2a tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.455677 Sep 23 03:58:55.347160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2064/4246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:54 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:55.351900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:55.352513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:55.368039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.368617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.369334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.370082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.370552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.371049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.539065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.550428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ee58136-14b2-40f5-b0b1-7bdc42b49a71 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.477240 Sep 23 03:58:55.563591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2183/4247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:55 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:55.722705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:55.736162 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e662654b-f71a-4ecb-b30b-b00a5b86506b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1316 microversion: 2.1 time: 0.387774 Sep 23 03:58:55.750783 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2065/4248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:55 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:55.794956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776a2a5b-5bd6-4c57-ac7b-627d9091bab6", "tag": "5ec5c257-f407-4c47-97c9-d7c9dd269f1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:58:55.856569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.859078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.861334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.881595 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] Creating event network-changed:5ec5c257-f407-4c47-97c9-d7c9dd269f1d for instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 on n-h2-858495-2 Sep 23 03:58:55.890967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-03995eb7-4691-40c6-8c8f-3b752cd02537 req-393ad0e2-92f3-4012-b15d-13a0c07e4988 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101891 Sep 23 03:58:55.891874 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2184/4249] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:58:55.914560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:55.917662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:55.925860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.927628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.928288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:55.929217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:55.929967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:55.930559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.094863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:56.097310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:56.106104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.126066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.128683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.129938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.130537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.131152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.260377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.271172 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fc314e9-4921-4077-b5d6-b9cbf0881c52 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.360508 Sep 23 03:58:56.272420 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2066/4250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:55 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:56.373964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:56.374925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:56.388208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.388953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.389625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.390539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.391195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.391822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.519530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.531715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.533529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.537612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f42dffc4-6c26-471e-8914-815dfba0b412 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.450427 Sep 23 03:58:56.538497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2185/4251] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:56 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:56.591585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:56.592422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:56.601811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.602484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.603415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.604138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.604601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.605032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.678239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.687907 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0f4ca7b-412f-443c-994c-4f01f939c06f tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.318633 Sep 23 03:58:56.700197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2067/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:56 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:56.762624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:56.763371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:56.769778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.773409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.773409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.773409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:56.773409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:56.773409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:56.848794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.856691 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89a05687-233b-4c1a-857e-c12589917502 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.274812 Sep 23 03:58:56.857272 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2186/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:56 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:56.974048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:56.983617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8372b472-192e-4269-a436-6f2698cb44c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1505 microversion: 2.1 time: 0.225533 Sep 23 03:58:56.984507 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2068/4254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:56 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:57.007190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.007849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.014149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.014850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.015303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.016013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.016479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.016919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.043077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:58:57.104689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:57.139351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33f6b12c-e950-4ba2-bd46-e7867f07e930 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 204 len: 0 microversion: 2.1 time: 0.136139 Sep 23 03:58:57.143276 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2187/4255] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:58:57 2022] DELETE /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:58:57.148625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.149250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.155686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.156175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.156611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.157308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.157879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.158312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.163269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:57.296908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.298470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.308554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.309455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.310108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.311065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.314193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.314937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.321327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.333045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-774bc57d-4d4f-444f-bff6-7b6169aee031 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1511 microversion: 2.1 time: 0.188230 Sep 23 03:58:57.334751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2069/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:57 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:57.487996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.497413 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-581b38ca-459e-4c2c-93ed-049f1002745a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.206747 Sep 23 03:58:57.513100 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2188/4257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:57 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:57.567597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.568358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.574713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.575335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.575900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.576714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.577259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.577963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.712377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.713221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.720331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.721286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.721965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.722923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.723847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.724492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.839775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.867865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.870272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.872030 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d182709-efb1-42c8-a34f-e6d332297486 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.309129 Sep 23 03:58:57.873160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2070/4258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:57 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:57.885444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:57.886338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:57.894429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.895828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.896441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.897504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:57.898149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:57.899138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:57.912305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:57.923677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9edc42d8-3f6a-4af0-ba2d-6306a8bf8eb1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.216294 Sep 23 03:58:57.925120 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2189/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:57 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:58.050145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:58.062323 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b88aa23f-28eb-43a7-b29a-e85abb5a84ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.184708 Sep 23 03:58:58.065394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2071/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:58.356422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:58.357129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:58.360039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:58.369491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.369676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.370359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.371086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.371554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.372009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.511489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:58.520115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:58.521241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:58.528188 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2971e606-f090-4c89-9792-b4b3f5f0c302 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1511 microversion: 2.1 time: 0.175473 Sep 23 03:58:58.530800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.531350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2190/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:58 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:58.531803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.532381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.533167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.533664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.534104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.691770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:58.701496 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24dbc202-cc9d-4b7f-a2df-b92833cae12d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.185183 Sep 23 03:58:58.702430 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2072/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:58 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:58.900280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:58.900923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:58.909296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.909823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.910307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.913816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.913816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.913816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.950519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:58.951145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:58.958095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.958802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.959658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:58.960529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:58.961143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:58.961757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.286249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.296727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.303903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.309943 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03ae45ef-df99-4d6a-bbfa-e04cc953ed84 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.411102 Sep 23 03:58:59.310852 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2191/4263] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:58:58 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:58:59.313188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.322015 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21bc7963-3f13-4e9c-af38-a64af9b8b040 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.377738 Sep 23 03:58:59.333598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:59.333598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:59.334430 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2073/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:58 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:58:59.336968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.337920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.338376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.339092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.339555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.339986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.430604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:58:59.492807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.501699 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92b76e6d-af75-4b12-8ead-95b697906fd7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.189188 Sep 23 03:58:59.502304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2192/4265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:59 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:59.552817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:59.559930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:59.570176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.570778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.571246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.572179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.572853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.573296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.716020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.724658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:58:59.725405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:58:59.727679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-347bf567-746c-427e-9a3a-dac3ef25c7a3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1511 microversion: 2.1 time: 0.179271 Sep 23 03:58:59.728419 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2074/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:59 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:58:59.731695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.732182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.732615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.733307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:58:59.733788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:58:59.734211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:58:59.884147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:58:59.892290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4cca0219-5bb7-4206-94b7-329342271fe9 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.171418 Sep 23 03:58:59.893562 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2193/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:58:59 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:00.347745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:00.349234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:00.351068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:00.352085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:00.365125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.367191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:00.369797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.370547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.371208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.371939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.373050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.374774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.375606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.376537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.377883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.378277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.380374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.761871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:00.793074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd22afdc-b92e-4376-8e14-0c245e232172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.449489 Sep 23 03:59:00.796205 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2194/4268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:00 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:00.809469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:00.810762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:00.826997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.827899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.828489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.829345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.829967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.831827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.858941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:00.880743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:00.888825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:00.891771 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a153cf48-906c-4059-9d59-359df5058d1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.553347 Sep 23 03:59:00.906502 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2075/4269] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:00 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:00.913972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:00.915118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:00.923661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.924330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.925178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:00.926165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:00.927401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:00.928441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.330343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:01.356458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:01.370246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-624d06a0-5291-483e-bec4-e29d79e11180 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1655 microversion: 2.1 time: 0.571349 Sep 23 03:59:01.372363 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2195/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:00 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1655 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:01.377489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:01.378293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:01.387457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.388162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.388905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.389780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89d6cfc1-db16-4426-941d-4f91338570c4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1511 microversion: 2.1 time: 0.481900 Sep 23 03:59:01.389958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.390553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.391179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.406035 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2076/4271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:00 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:01.413483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:01.420403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.421150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.421821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.450738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Going to try to start instance {{(pid=128723) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 03:59:01.529691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e17e85f0-e922-4803-9883-989d2a2beb90 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.121864 Sep 23 03:59:01.532567 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2077/4272] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:01 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:01.548915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:01.549676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:01.557278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.557982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.558989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.559935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.560613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.561277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.788681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:01.797307 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c76cf1d-b978-4352-9e72-3a80b801dc87 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.423737 Sep 23 03:59:01.802118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2196/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:01 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:01.826680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:01.827311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:01.873838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.877695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.878460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.883688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.884879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.886222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.920898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:01.928926 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c2ed21c-a012-4db4-bd54-acca6dee74d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1664 microversion: 2.1 time: 0.394070 Sep 23 03:59:01.929585 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2078/4274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:01 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1664 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:01.946042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:01.958865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:01.975550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.976061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.976507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:01.977222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:01.977719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:01.978161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:02.885291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:02.900684 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3581ebc-643e-4900-a380-eb4085b72172 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 1.081486 Sep 23 03:59:02.901809 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2197/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:01 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:02.924068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:02.924687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:02.936476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:02.936956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:02.937680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:02.949517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:02.950016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:02.950462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:02.985546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.024837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.029459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.035600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-731a5ae3-8d82-48c5-9631-43c39082d633 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 1.095277 Sep 23 03:59:03.036575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2079/4276] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:01 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:03.055252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.055754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.056199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.057130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lazy-loading 'fault' on Instance uuid 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:59:03.179441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.190478 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33184786-2504-4f92-8846-450fa77dc5b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 200 len: 1306 microversion: 2.1 time: 0.287049 Sep 23 03:59:03.191467 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2198/4277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:02 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:03.211269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:03.215062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:03.226795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.227345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.228122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.229004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.229415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.234745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.360996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2", "name": "network-vif-deleted", "tag": "a04886fe-0988-4c61-b654-c76f35b13995"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:03.396831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.397468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.398061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.425266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] Creating event network-vif-deleted:a04886fe-0988-4c61-b654-c76f35b13995 for instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 on n-h2-858495-2 Sep 23 03:59:03.436819 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ca975001-2fc0-47fe-b4d7-2d2bbd8081db req-5199faa5-01b9-4c37-ae29-d43ebe7f9ee1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371000 Sep 23 03:59:03.438091 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2080/4278] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:03.448688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:03.449426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:03.476617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.477129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.479747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.482419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.484037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.486535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.669930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.682942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5e60809-6e74-4eee-8b07-3b61b5d31494 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.490304 Sep 23 03:59:03.701536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2199/4279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:03 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:03.836346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:03.846311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f131847d-d516-44c3-b897-8d2f267561ac tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1664 microversion: 2.1 time: 0.406338 Sep 23 03:59:03.846934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2081/4280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:03 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1664 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:03.932790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:03.934365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:03.948743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.949606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.950044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:03.951149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:03.951804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:03.952390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.071297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:04.072598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:04.081294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.082076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.082840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.083799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.084631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.085375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.195896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:04.229739 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ccfc440-fa38-406e-9afe-a54e5518acd3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.303185 Sep 23 03:59:04.232637 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2200/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:03 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:04.250698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:04.251713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:04.263429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.268629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.269145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.271890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.272381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.272816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.325504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 HTTP/1.1 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2'} Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:04.327228 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:04.331966 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:04.359801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:04.365865 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06d2c298-ba33-4360-b796-415201de292a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 404 len: 111 microversion: 2.1 time: 0.127666 Sep 23 03:59:04.366442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2201/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:04 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:04.394559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:04.396349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:04.409057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.409707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.411270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.412091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.412737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.413244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.590324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:04.606866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:04.608320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:04.609534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-80b6ec3b-12d1-45f3-bbb8-fce71cf39fe5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.543621 Sep 23 03:59:04.626047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2082/4283] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:04 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:59:04.631430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776a2a5b-5bd6-4c57-ac7b-627d9091bab6", "name": "network-vif-plugged", "status": "completed", "tag": "5ec5c257-f407-4c47-97c9-d7c9dd269f1d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:04.649872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.650366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.650855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.675552 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] Creating event network-vif-plugged:5ec5c257-f407-4c47-97c9-d7c9dd269f1d for instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 on n-h2-858495-2 Sep 23 03:59:04.681582 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6fd47464-fdfc-40d6-b5e0-1b37e7f8728f req-78a34b71-6acc-461f-89a4-36efabfbfce4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053845 Sep 23 03:59:04.682314 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2083/4284] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:04.704241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:04.712953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-537fede4-d0df-430d-81c6-ce2508a04271 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.341477 Sep 23 03:59:04.717153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:04.718071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:04.725606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.726031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.726488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.727415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.727890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.728323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.730795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2202/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:04 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:04.872008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:04.872624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:04.884813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.885714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.886301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:04.887153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:04.887756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:04.888360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.024858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.035304 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-984b8279-13e4-4390-886f-89ce97dde1ac tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.323722 Sep 23 03:59:05.036202 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2084/4286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:04 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.060076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25d9c1cc-2287-467c-8e3b-b5d7a97f11d5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25d9c1cc-2287-467c-8e3b-b5d7a97f11d5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 163 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": 12345, "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 12345 Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:05.064461 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25d9c1cc-2287-467c-8e3b-b5d7a97f11d5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-25d9c1cc-2287-467c-8e3b-b5d7a97f11d5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011230 Sep 23 03:59:05.069510 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2085/4287] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:05 2022] POST /compute/v2.1/servers => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:05.076567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.077296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.087239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.087848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.088368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.089498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.090289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.091648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.124780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.134854 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09ecf673-337a-4b89-a78c-a1e4bbeda4dc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.267231 Sep 23 03:59:05.147834 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2203/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:04 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.158375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.159057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.166208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.167340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.167797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.168516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.168980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.169459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.318650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.340404 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf989016-354b-40de-86aa-6207c7341e5d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.268033 Sep 23 03:59:05.341010 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2086/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.349616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.350237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.352625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:05.368647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.369154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.369632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.370360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.370901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.371859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.377618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:05.382933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.386721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:05.392220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1fdbe64c-7b82-4dca-b6d4-c8cfa8aa2ca4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.237675 Sep 23 03:59:05.405377 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2204/4290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.417645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.419744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.431494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.432122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.432804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.433551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.434015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.434446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.607588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.620925 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-617719ba-63ff-4839-b746-9a458fb3fec4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.278836 Sep 23 03:59:05.636245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.638306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2087/4291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.643701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:05.644287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.648984 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da35bf4f-91b6-467c-9e65-81d27746ced8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.242154 Sep 23 03:59:05.651198 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2205/4292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:05.651359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.651848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.652353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.653059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.653569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.654002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.655940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.656550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.674006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.674495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.674934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.675637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.677439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.677896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.711720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Unlocking {{(pid=128723) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 23 03:59:05.788679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e02e43d0-b2ae-4795-b71d-2c46e14c0ffb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.148833 Sep 23 03:59:05.789690 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2088/4293] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:05 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:05.802355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:05.803887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:05.813632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.814640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.815286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.816244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:05.816939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:05.817616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:05.962977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.978458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.982975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:05.986424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d0c5d6f-787b-4b48-88cb-b038e9ac79c1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.334234 Sep 23 03:59:06.001000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2206/4294] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:06.061862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:06.062581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.070753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:06.071237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.071739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.072173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.072876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.073457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.078003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.090766 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d9e955c-51bb-4709-9e7f-871cd2c26e82 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.294219 Sep 23 03:59:06.093277 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2089/4295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:05 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:06.120249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:06.121141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.150202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.150202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.150202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.150202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.150601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.152388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.292456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:06.305412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5898da46-8505-43d2-b34d-f2664dbc48ea tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1315 microversion: 2.1 time: 0.247205 Sep 23 03:59:06.306536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2207/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:06 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:06.362412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:06.371312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-292807ae-af95-4b49-b1a8-d55cb0e8566f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.255788 Sep 23 03:59:06.371902 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2090/4297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:06 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:06.395691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:06.404133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.422662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.423534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.423983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.424706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.425167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.425630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.602446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:06.612800 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2d3720a-86fc-4caf-a32c-bdce5d2f71ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.221306 Sep 23 03:59:06.615247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2208/4298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:06 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:06.639598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:06.640383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.648964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.649815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.650426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.651302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.651924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.652217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:06.652698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.653630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.679529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.681319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.683280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.688070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.689403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.690094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.834790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd29b8ce-5f16-49c1-89a6-296d30db5ef8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.199003 Sep 23 03:59:06.836259 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2091/4299] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:06 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:06.842748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "48160dd4-7d3f-4627-9478-964935552a7e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:06.856803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.858315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.859031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.897857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] Creating event network-vif-plugged:48160dd4-7d3f-4627-9478-964935552a7e for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:06.927186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b5e4ede5-1119-4b42-9705-4f64376c4bf8 req-d444ee23-f01b-49a1-96f8-401b0de6663a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088509 Sep 23 03:59:06.929773 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2092/4300] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:06.939211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:06.940278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:06.949600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.950701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.951595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.952479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:06.953255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:06.953935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:06.960816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:06.971531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76239ba3-e193-401b-ba51-2f09b2bde0ee tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.328474 Sep 23 03:59:06.972114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2209/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:06 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:07.016146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:07.017263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:07.029727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.030235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.030677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.031388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.031873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.032361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.359276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:07.373755 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-970a3986-68b0-40fc-9c4d-a71b716e62ab tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1673 microversion: 2.1 time: 0.439572 Sep 23 03:59:07.374634 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2093/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:06 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1673 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:07.596615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:07.612618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:07.616367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:07.620574 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb7828ec-bf69-4252-b232-5d23d3f17121 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.607776 Sep 23 03:59:07.621913 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2210/4303] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:07 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:07.628142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:07.629236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:07.639789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.640505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.641366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.642276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.642928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.643718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.806375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:07.814820 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-634a0ae7-3c55-49a4-a3c2-117414c50188 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1501 microversion: 2.1 time: 0.191409 Sep 23 03:59:07.829376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:07.829376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:07.830863 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2211/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:07 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:07.841682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.843000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.843619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.844508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.845133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.845778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.848894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:07.868551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:07.869262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:07.869948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:07.903958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff69e156-60eb-41ec-8158-44e870dc1717 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/ips" status: 200 len: 149 microversion: 2.1 time: 0.518839 Sep 23 03:59:07.908021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2094/4305] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 03:59:07 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/ips => generated 149 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:07.921326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Going to try to stop instance {{(pid=128724) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 03:59:07.995927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:07.996849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:08.008469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.009215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.012844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.013839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.016953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.017779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.021202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ced7fcd1-88d5-4d70-bb43-c205ebdec117 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6/action" status: 202 len: 0 microversion: 2.1 time: 0.170536 Sep 23 03:59:08.022961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2212/4306] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:07 2022] POST /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:08.037702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:08.038449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:08.054371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.055037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.055495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.056218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.060093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.060759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.594110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:08.614572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:08.616581 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db1064d4-1311-46da-9a8b-4f22fbaf89ef tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.624580 Sep 23 03:59:08.617203 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2095/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:07 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:08.627043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:08.627696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:08.638840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.641998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.643791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.646000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.651276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.651908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.657666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb9342ad-b8db-4362-89af-f4b69191a61d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.627462 Sep 23 03:59:08.659168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2213/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:08 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:08.670262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:08.671323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:08.678507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.679327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.680433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:08.681464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:08.682154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:08.682805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.217011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.231712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.236924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.240822 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5d29876d-b19b-4a23-849a-a7bdd7b03c10 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.576800 Sep 23 03:59:09.258053 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2214/4309] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:08 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:09.267389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "b9a165f5-5498-48d5-a507-4312040da971"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "f756178c-a6c4-4562-95fb-837eb406ca99"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:09.282470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.283170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.283734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.298859 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Creating event network-vif-plugged:b9a165f5-5498-48d5-a507-4312040da971 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:09.299374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] Creating event network-vif-plugged:f756178c-a6c4-4562-95fb-837eb406ca99 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:09.305658 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c27de0e1-98de-44af-8944-8738f51da5cf req-de5825bf-e6a1-4f88-a58a-3dec4038c95b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046129 Sep 23 03:59:09.306589 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2215/4310] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:09.312063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c89b6167-66d0-4956-b997-018f3b6ca163 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507651146", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e14d7605-af73-4bb6-a684-b8605281fbb5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:09.413067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.422800 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d4c3a9b-4aaa-416e-ba45-110a06f974c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1653 microversion: 2.1 time: 0.802621 Sep 23 03:59:09.423401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2096/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:08 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1653 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:09.440780 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c89b6167-66d0-4956-b997-018f3b6ca163 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c89b6167-66d0-4956-b997-018f3b6ca163 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 357 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507651146", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e14d7605-af73-4bb6-a684-b8605281fbb5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: exception: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-507651146', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e14d7605-af73-4bb6-a684-b8605281fbb5'}], 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:09.444504 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c89b6167-66d0-4956-b997-018f3b6ca163 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Block Device e14d7605-af73-4bb6-a684-b8605281fbb5 is not bootable. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c89b6167-66d0-4956-b997-018f3b6ca163 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.138612 Sep 23 03:59:09.449557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2216/4312] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:09.462543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:09.464474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:09.465400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:09.468882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:09.477925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.478419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.478863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.483388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.483896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.484335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.485075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.485624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.486069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.490461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.490951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.491513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.612184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61b52062-9bcc-459c-abe3-11c99bf75368 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.156955 Sep 23 03:59:09.612848 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2097/4313] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:09 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:09.626889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:09.631572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:09.643248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.645860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.648472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.649395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.649879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.653294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.795636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.819629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa439f10-bc62-4354-a9bb-da073355c77a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.362583 Sep 23 03:59:09.820445 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2217/4314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:09 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:09.875876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:09.881790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:09.886090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:09.896492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0e0cb67-1b66-4fad-9de3-7623e17a59bc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1660 microversion: 2.1 time: 0.276783 Sep 23 03:59:09.897663 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2098/4315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:09 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1660 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:09.903122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:09.903730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:09.911503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.912200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.912777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.913668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.914286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.914895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.929695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.935167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.937622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:09.938632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:09.939105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:09.939538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.296086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.306953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6a3b6bc-17e0-4f8d-8f3e-a3441622c779 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.481807 Sep 23 03:59:10.311027 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2218/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:09 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:10.314943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.323128 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-988a7df5-1aaa-42ef-90da-838d25aaa883 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.424262 Sep 23 03:59:10.327339 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2099/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:09 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:10.334454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:10.336381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:10.344861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:10.360341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.361046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:10.364601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.365272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.368376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.373993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.374574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.379159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.380109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.382173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.383009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.383494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.387510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.430539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:10.744025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.752448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c18a550-110d-483e-a365-cba935120bf0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.440358 Sep 23 03:59:10.753240 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2219/4318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:10 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:10.758727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecbefbd-d18d-4ba1-989f-4f85a44db1d4"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:10.761525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:10.773800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.774466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.775230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.776833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.777301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.777776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.815380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.830433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.833725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:10.835022 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67b18662-0fc1-4e5e-96f8-ae0533059cff tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.505669 Sep 23 03:59:10.835956 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2100/4319] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:10 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:10.952080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:10.955284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:10.981729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.982402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.982662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:10.983388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:10.983842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:10.984276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.244517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:11.264240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:11.275888 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0ab4b32-7583-446e-b474-7cc8d858f9c6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.350744 Sep 23 03:59:11.276756 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2c70ec6d-57fe-47ac-8f60-50832a8abb43 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521617 Sep 23 03:59:11.277857 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2220/4320] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:59:10 2022] POST /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:11.278596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2101/4321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:10 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:11.307912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:11.308660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:11.331480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.332299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.332895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.333784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.334390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.334971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.335092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:11.335742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:11.354463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.355393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.356457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.357437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.358103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.358899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.684509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:11.703811 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a4ad8de-16a0-4f00-b711-6f91169dd7de tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.373560 Sep 23 03:59:11.706759 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2102/4322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:11 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:11.721158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:11.722117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:11.736511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:11.751926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f885a89-5d94-49c0-8187-2b0d0ed04c9a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.450653 Sep 23 03:59:11.752583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.755777 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2221/4323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:11 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:11.759420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.761107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.762347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.765329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.767069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.783580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:11.784592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:11.791869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.792590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.793456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:11.794388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:11.795006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:11.795666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.103442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.111459 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc294224-0ce0-42ec-9d7e-0e4ed127af55 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.335994 Sep 23 03:59:12.126438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2222/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:11 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:12.143244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.152681 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06a3cc06-85ef-46c7-9e21-954facb6fd99 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.441534 Sep 23 03:59:12.166662 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2103/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:11 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:12.171263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:12.171905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:12.179322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.180107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.180763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.182975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.183656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.184743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.185754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:12.187076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:12.202161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.204808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.205282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.206437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.209155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.210043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.664726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.674325 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b33f4c50-1abf-4c26-8bf9-d0b0a2e256fd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.506414 Sep 23 03:59:12.675265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2104/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:12 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:12.702348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:12.703159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:12.715029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.719967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.720511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.720947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.727843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.728970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.729439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.730550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:12.730970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.732915 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d53b8abe-c33f-403d-9a03-13ffdd64b18c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.604656 Sep 23 03:59:12.744337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2223/4327] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:12 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:12.761398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:12.769847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:12.791186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.792512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.794813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:12.795881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:12.800361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:12.802008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.068627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:13.077209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49c7c4d3-5920-4ee0-a961-89731e351af2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.381415 Sep 23 03:59:13.083128 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2105/4328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:12 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:13.107032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:13.107906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:13.116935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.117746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.118274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.119169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.119766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.120274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.121541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:13.133258 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28ad88d9-7be3-4555-b9ba-a9a21d1b8412 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.387087 Sep 23 03:59:13.134401 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2224/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:12 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:13.179566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:13.181005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:13.194623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.195098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.195536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.196253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.196706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.197135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.493144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:13.504394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54c64642-09db-4f63-85ad-d9a44e7e4bbc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.401386 Sep 23 03:59:13.505622 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2106/4330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:13 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:13.565580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:13.578392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f61094bb-c73b-402a-823e-5e38b00f3ab0 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.404824 Sep 23 03:59:13.579109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2225/4331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:13 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:13.648700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3cc7cde-5ee7-469b-9056-a151b3a11c6f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-456161600", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e4f75334-b417-4681-8bb0-50f45fb07fda", "destination_type": "local"}, {"source_type": "volume", "uuid": "acd7beee-4cef-4c02-9012-a8793fb58901", "destination_type": "invalid"}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3cc7cde-5ee7-469b-9056-a151b3a11c6f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 494 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-456161600", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e4f75334-b417-4681-8bb0-50f45fb07fda", "destination_type": "local"}, {"source_type": "volume", "uuid": "acd7beee-4cef-4c02-9012-a8793fb58901", "destination_type": "invalid"}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-456161600', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'acd7beee-4cef-4c02-9012-a8793fb58901', 'destination_type': 'invalid'}], 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:13.665467 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:13.668937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3cc7cde-5ee7-469b-9056-a151b3a11c6f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:13.670209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3cc7cde-5ee7-469b-9056-a151b3a11c6f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.026137 Sep 23 03:59:13.675893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2107/4332] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:13.678674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:13.679293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:13.688658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.689474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.690068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.690956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.692384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.692974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.771905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:13.772497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:13.803267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.804124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.804742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:13.805690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:13.806317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:13.806929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.112437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.122062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-552eb709-570e-45c6-8a18-41c2c110ff8d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.447029 Sep 23 03:59:14.122537 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2226/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:13 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:14.151179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:14.154995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:14.183798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.186088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.187444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.188061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.189146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.189632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.190061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.194988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.196585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.197811 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f3f8bf4-676b-4fc4-a360-fd93c7218de1 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.440379 Sep 23 03:59:14.199074 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2108/4334] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:13 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:14.203750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:14.204362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:14.210674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.211166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.211604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.212448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.212910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.213339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.466491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.481385 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f5980ef0-349b-40d0-a79f-d5181146059c tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.281202 Sep 23 03:59:14.483682 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2109/4335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:14 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:14.495277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "154b1f8d-297e-42ac-93ef-44d89c53c04b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:14.497282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.505531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1d23664-4990-4458-afd8-e2d929360984 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.358263 Sep 23 03:59:14.509871 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2227/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:14 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:14.510185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.510907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.511446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.524565 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] Creating event network-vif-plugged:154b1f8d-297e-42ac-93ef-44d89c53c04b for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:14.530469 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-153bdb9b-e85f-4f98-b672-f3e6deda6837 req-01090e36-37d7-4f9e-8997-0945a433965e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044773 Sep 23 03:59:14.531613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2110/4337] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:14.606246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:14.607815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:14.615833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.616758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.617406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.618855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.619556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.620141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.755314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a56de92-c820-4358-9797-cf9e90a59de7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1386205107", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a56de92-c820-4358-9797-cf9e90a59de7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 492 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1386205107", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1386205107', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.761370 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 03:59:14.764221 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:14.770549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a56de92-c820-4358-9797-cf9e90a59de7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:14.772067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6a56de92-c820-4358-9797-cf9e90a59de7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021958 Sep 23 03:59:14.775816 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2111/4338] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:14 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:14.784351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:14.786547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:14.805132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.806461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.812559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.815585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:14.816592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:14.818715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:14.844631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:14.854054 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-511f2388-4c47-4a53-8d40-64ae17f23f2c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.252841 Sep 23 03:59:14.855203 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2228/4339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:14 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:15.066696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.081630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4bd92379-63fb-43b1-9dd7-daee1b4e98aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.303102 Sep 23 03:59:15.082801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2112/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:14 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:15.108643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:15.109262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:15.132202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.132863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.133136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.136784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.137264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.141950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.228303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:15.229097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:15.249740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.250402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.250853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.251607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.252029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.252464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.506852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.518174 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76ac5f4a-1f63-49e1-bde9-97797906539d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.413296 Sep 23 03:59:15.522188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2229/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:15 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:15.531255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:15.533787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:15.537109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.542115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.542950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.543550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.544409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.545154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.545862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.550002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.551498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.552903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0151f591-2aa0-4f8b-9dd0-b049ec2c3bb2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.328482 Sep 23 03:59:15.555042 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2113/4342] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:15 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:59:15.703021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8efae5e3-a9e8-4597-a1c3-f21e4653cd5c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8efae5e3-a9e8-4597-a1c3-f21e4653cd5c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 416 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.707551 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8efae5e3-a9e8-4597-a1c3-f21e4653cd5c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:15.711003 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8efae5e3-a9e8-4597-a1c3-f21e4653cd5c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009902 Sep 23 03:59:15.721722 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2114/4343] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:15 2022] POST /compute/v2.1/servers => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:59:15.727193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:15.727809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:15.745056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.746150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.748384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.750683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.752687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.755283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.765697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:15.779055 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-987a3630-67f2-4e61-8e25-f20883521e78 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.253645 Sep 23 03:59:15.782665 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2230/4344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:15 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:15.882306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:15.883059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:15.897719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.898600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.899366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:15.900413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:15.901266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:15.901938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.048808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:16.060954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74dbace1-72a7-4120-a7bc-78b1bb14c70f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.337503 Sep 23 03:59:16.062404 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2115/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:15 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:16.093231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:16.094689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:16.107660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.108397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.110186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.114963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.115464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.115893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.222089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:16.233690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-609baac0-b5e0-4e48-aa44-d1fe40259644 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.356766 Sep 23 03:59:16.235230 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2231/4346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:15 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:16.313414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:16.322499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c94936b-ad3f-400a-8166-e3a07015075f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.234078 Sep 23 03:59:16.323849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2116/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:16 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:16.514689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eab3656-8062-4ed8-8230-3045079f453b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2043258515", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": -1, "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:16.529913 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7eab3656-8062-4ed8-8230-3045079f453b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Flavor -1 could not be found. Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eab3656-8062-4ed8-8230-3045079f453b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 206 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2043258515", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": -1, "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: exception: Flavor -1 could not be found. Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2043258515', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': -1, 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:16.531863 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eab3656-8062-4ed8-8230-3045079f453b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:16.537896 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7eab3656-8062-4ed8-8230-3045079f453b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.025520 Sep 23 03:59:16.548690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "23565f04-5690-4520-ad41-b96190b6c520"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "78988203-0141-4fe7-840c-b2a2258f2e39"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "14f2489d-67f5-4a49-adb7-6b5d73463f20"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:16.553999 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2232/4348] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:16 2022] POST /compute/v2.1/servers => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 23 03:59:16.564808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.571603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.574222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.578283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:16.579090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:16.596798 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Creating event network-vif-plugged:23565f04-5690-4520-ad41-b96190b6c520 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:16.597386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Creating event network-vif-plugged:78988203-0141-4fe7-840c-b2a2258f2e39 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:16.597891 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] Creating event network-vif-plugged:14f2489d-67f5-4a49-adb7-6b5d73463f20 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:16.600606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.601266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.601907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.602772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.603381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.603965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.614770 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-813f0dc5-7b8a-405b-a4ee-f645e5c8ce3b req-adc68f6f-b587-4b4c-a53b-fa794d30ebf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069877 Sep 23 03:59:16.615683 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2117/4349] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:16.622539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:16.623626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:16.630927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.631686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.632327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:16.633240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:16.634021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:16.634643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.324056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.331949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c6f8ff9-32f3-4bf1-a634-53e6641aa257 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.772362 Sep 23 03:59:17.333086 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2233/4350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:16 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:17.337922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:17.338777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:17.346467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.347759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.348394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.349317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.349978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.350600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.368203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.387979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.390935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.395955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b074a50-2a67-41fc-a165-8da20a61f9d5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.778849 Sep 23 03:59:17.396578 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2118/4351] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:16 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:17.401259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:17.411289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:17.421617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.423579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.426716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.427484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.438446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.439579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.608448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.641829 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5233d389-b3df-4956-a005-422673db3c38 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.306003 Sep 23 03:59:17.644778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2234/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:17 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:17.652077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:17.654179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:17.666278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.670838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.676594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.677656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:17.678145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:17.678587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:17.718755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.732193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-485ca4c4-49b2-4001-ad24-f620e23cdff7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.334393 Sep 23 03:59:17.733064 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2119/4353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:17 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:17.891574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:17.907635 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc3bd43c-63ee-4970-b89c-0421e372b1b7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.259415 Sep 23 03:59:17.910072 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2235/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:17 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:18.059691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0f7b84-a63f-4e90-ac45-528a9e13138d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-968123479", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0f7b84-a63f-4e90-ac45-528a9e13138d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 172 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-968123479", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-968123479', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi -1 Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:18.065025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 03:59:18.069621 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.074260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0f7b84-a63f-4e90-ac45-528a9e13138d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:18.075650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba0f7b84-a63f-4e90-ac45-528a9e13138d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021216 Sep 23 03:59:18.077061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2120/4355] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:18 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:18.087839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.089699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:18.104404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.105837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.107086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.108678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.110852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.112058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.318328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.328350 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-985e4cd0-dcab-4a32-88ab-eb8840ea539e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.245582 Sep 23 03:59:18.335790 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2236/4356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:18.353003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.353963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:18.361943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.362741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.363944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.364899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.365607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.366544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.423641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.424628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:18.439288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.439921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.440468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.441327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.441911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.442462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.658874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.679665 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e850594-cac6-4b88-8039-071f86de0bd9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.328742 Sep 23 03:59:18.686320 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2121/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:18.697113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.700285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:18.714928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.715501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.716733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.720083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.723055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.727283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.727758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.728567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.731503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.733191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:18.735700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21e46160-7b87-4e3e-a3ca-fbfeda46bae7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1879 microversion: 2.42 time: 0.315082 Sep 23 03:59:18.737280 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2237/4358] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1879 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:18.763692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.765117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:18.779727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.780468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.781416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.783596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:18.784447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:18.785737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:18.821899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:18.932416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:18.950859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d623012-751d-4a37-a931-5043f1ff93c3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.260306 Sep 23 03:59:18.952028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2122/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:18.960583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-852af4c2-d459-4d64-b6d7-1a780f79bf03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1445653721", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:18.967040 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-852af4c2-d459-4d64-b6d7-1a780f79bf03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-852af4c2-d459-4d64-b6d7-1a780f79bf03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 216 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1445653721", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1445653721', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.968807 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-852af4c2-d459-4d64-b6d7-1a780f79bf03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-852af4c2-d459-4d64-b6d7-1a780f79bf03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.018220 Sep 23 03:59:18.973316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2123/4360] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:18 2022] POST /compute/v2.1/servers => generated 123 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:18.983144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:18.985616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:19.013637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.014352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.015385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.015642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.016112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.016590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.017735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:19.032975 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e5e96b5-a06d-4d66-bb84-3b532e030e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.278481 Sep 23 03:59:19.035327 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2238/4361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:19.202041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:19.211495 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f814047a-c6eb-49a8-beed-cb6eb6dc320f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.232455 Sep 23 03:59:19.212409 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2124/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:18 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:19.235188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:19.235889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:19.245315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:19.247218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.247627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.248076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.250399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.250399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.250399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.408243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:19.416669 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8b1c3f9-e798-4810-afc7-ee68f7d6dd7c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.185289 Sep 23 03:59:19.417797 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2239/4363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:19 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:19.561753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-427932670", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-key-477104669", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:19.620020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] validate_networks() for [('9586326b-a441-4e4d-8a95-584444e131a4', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:59:19.765795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:19.766410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:19.776221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.776974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.777898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.778998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.779642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.780544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.877086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Invalid key_name provided. Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 245 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-427932670", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-key-477104669", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid key_name provided. Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-427932670', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'key_name': 'tempest-key-477104669', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-477104669 not found for user 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:19.879832 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid key_name provided. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e32c25fb-93fe-4124-8b77-6059a4d7470d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.323746 Sep 23 03:59:19.884269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2125/4364] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:59:19.891659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:19.892699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:19.900426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.900930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.901392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:19.902131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:19.902604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:19.903050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.099196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.111299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.113448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.115333 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60cb4fcc-4a80-4ba9-88e8-a4bb4c934464 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2834 microversion: 2.42 time: 0.353433 Sep 23 03:59:20.129851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.132910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1661cec3-a4fc-440a-975b-3582557d42e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.245787 Sep 23 03:59:20.133750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2126/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:19 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:20.138548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:20.139155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:20.145269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.145873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.146289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.147205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.147710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.148107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.156064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2240/4366] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 03:59:19 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2834 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:59:20.161614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:20.167607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:20.183496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.184172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.187768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.188545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.189034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.189517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.419611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.428288 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e40d242-cb56-4452-a890-e25df287faa7 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.293332 Sep 23 03:59:20.429123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2127/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:20 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:20.463207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:20.465967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:20.477958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.479069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.482363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.483597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.484293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.484964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.485986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.505534 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4b3bc40-d4d9-46b2-9cdf-80f54ede404d tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.338478 Sep 23 03:59:20.505534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2241/4368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:20 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:20.505534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:20.505534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:20.511922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.512418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.512865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.513599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:20.514060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:20.514493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:20.670623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4b41e00-5396-40c5-9180-b06e3c5ee69b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.239873 Sep 23 03:59:20.671524 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2128/4369] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 03:59:20 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a/os-interface => generated 1830 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:59:20.754266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:20.771175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4320f150-728e-40e9-98de-79cebe2b319f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.272659 Sep 23 03:59:20.772388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2242/4370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:20 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:20.903207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1315685135", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:21.017116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.security_group_api [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Neutron security group does_not_exist not found {{(pid=128723) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 23 03:59:21.019152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 258 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1315685135", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1315685135', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 23 03:59:21.030017 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.035111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:21.039220 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba0a9b5b-92f7-4ea6-bb79-721f8a18d2b0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.133424 Sep 23 03:59:21.039220 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2129/4371] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:21.044412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.045245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.054497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.054989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.055428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.056133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.057149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.057609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.244328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:21.256244 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-654bcab3-4d39-4d42-b035-115be421b187 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.215590 Sep 23 03:59:21.257537 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2243/4372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:21 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:21.280205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.280831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.287837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.288600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.289264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.290273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.290923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.291552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.452494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.453655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.462808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.465367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.469641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.471838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.473559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.479421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.506222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:21.522404 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c07add1-c069-469d-a64a-18dd82fa9712 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.244690 Sep 23 03:59:21.523009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2130/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:21 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:21.538563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.549608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.568224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.568722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.569192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.569928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.570383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.570819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.753097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:21.766615 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ec3d043-5ed9-4b7a-9ba0-ca9497d31339 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.318661 Sep 23 03:59:21.767225 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2244/4374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:21 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:21.788726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.789230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: ae39e62a-abcf-40b4-b7e4-55a691780570] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.795735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/ae39e62a-abcf-40b4-b7e4-55a691780570 HTTP/1.1 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'ae39e62a-abcf-40b4-b7e4-55a691780570'} Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.797659 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance ae39e62a-abcf-40b4-b7e4-55a691780570 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a64d669-5f4d-4907-9090-906f40d4aa38 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae39e62a-abcf-40b4-b7e4-55a691780570" status: 404 len: 111 microversion: 2.1 time: 0.016414 Sep 23 03:59:21.804173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2245/4375] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:59:21 2022] DELETE /compute/v2.1/servers/ae39e62a-abcf-40b4-b7e4-55a691780570 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:21.811199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:21.811747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:21.829445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.830087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.830888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.831902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:21.832618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:21.833549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:21.839303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:21.848624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aff3b517-f371-4e67-878a-2f9bd7ee90f2 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.316573 Sep 23 03:59:21.860129 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2131/4376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:21 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:22.070663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:22.079026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01436f52-4da8-4f75-8bca-253d4efcf60f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.273931 Sep 23 03:59:22.079606 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2246/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:21 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:22.102478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:22.103567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:22.111403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.112095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.113272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.114167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.114779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.115499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.331935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:22.332286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "tag": "b9a165f5-5498-48d5-a507-4312040da971"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:22.342424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f5cdc02-d28f-4db7-983b-b9d1fff6ed35 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.243716 Sep 23 03:59:22.353383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2247/4378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:22.353616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.353616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.353799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.368084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] Creating event network-changed:b9a165f5-5498-48d5-a507-4312040da971 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 03:59:22.368604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:22.369080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:59:22.370055 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9223372036854775808 could not be found. Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9223372036854775808'} Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:22.372640 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:22.379773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:22.380604 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-30e87d24-5043-478e-a553-36f9d938bb4b req-05565255-dbe5-491a-9d75-49b8a8b0cb69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325908 Sep 23 03:59:22.380700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72a061db-9d56-48e7-85b4-efcdd2e22d9e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009879 Sep 23 03:59:22.380791 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2132/4379] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:22.380879 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2248/4380] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Sep 23 03:59:22 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:59:22.387523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:22.388332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:22.395170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.395772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.396293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.397074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.402470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.403120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.712251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:22.721771 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5682de96-c218-404b-a9af-a6464c508ae8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.338892 Sep 23 03:59:22.723224 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2133/4381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:22.748827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:22.750075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:22.757981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.759240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.759935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.760866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.761899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.762550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.794508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:22.795583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:22.808333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.810245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.810917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:22.814750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:22.815474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:22.824753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.172858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:23.183191 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae624383-23e1-4285-972c-ab5d46a429da tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.393099 Sep 23 03:59:23.183804 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2134/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:22 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:23.196527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:23.197534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:23.207218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:23.208375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.208880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.209325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.210073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.210534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.217816 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c527fe88-820c-4d84-ae13-c23312ebbfa9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.472560 Sep 23 03:59:23.218633 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2249/4383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:23.229752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.251054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:23.251539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Failed to fetch instance by id -1 {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 03:59:23.252072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance -1 could not be found. Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance -1 could not be found. Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '-1'} Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:23.254104 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:23.258795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-feeef9de-c71f-49f8-b4fc-775a2fa84fe9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008929 Sep 23 03:59:23.262181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2250/4384] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 03:59:23 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:59:23.274548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:23.275176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:23.283220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.284885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.285579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.286490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.287141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.287770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.583728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:23.597824 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5eeeec77-3cbc-47f4-a20e-1a3e339af179 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.405875 Sep 23 03:59:23.598703 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2135/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:23 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:23.631584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:23.644273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-132a3bdc-968a-4986-8087-ad9099cb8249 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.380733 Sep 23 03:59:23.658428 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2251/4386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:23 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:23.671879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:23.672634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:23.680931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.681702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.682513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.683456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.684128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.684570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.871559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:23.881459 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fca0317b-4fb9-4d4a-9edb-1703db87977b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.215671 Sep 23 03:59:23.882061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2136/4387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:23 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:23.903958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:23.904514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0acc812e-2bc4-4e62-9b00-745072e6dc04] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:23.910809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/0acc812e-2bc4-4e62-9b00-745072e6dc04/action HTTP/1.1 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 19 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: {"forceDelete": {}} Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0acc812e-2bc4-4e62-9b00-745072e6dc04', 'body': {'forceDelete': {}}} Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:23.926669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0acc812e-2bc4-4e62-9b00-745072e6dc04 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-672e5e3a-c526-4741-aa33-52010e1754f2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/0acc812e-2bc4-4e62-9b00-745072e6dc04/action" status: 404 len: 111 microversion: 2.1 time: 0.028616 Sep 23 03:59:23.931327 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2252/4388] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:23 2022] POST /compute/v2.1/servers/0acc812e-2bc4-4e62-9b00-745072e6dc04/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:23.938422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:23.939490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:23.947683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.948474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.948920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:23.949677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:23.950142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:23.950990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.107696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.116541 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7bc4a871-4018-4bcb-b2c6-655744baa1a2 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.182887 Sep 23 03:59:24.117506 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2137/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:23 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:24.141267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.142203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.151207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.151804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.152320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.153218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.153722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.154154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.206409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.207028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.213974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.214707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.215411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.216357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.216922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.218111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.365099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.379944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9fa68887-a249-4272-a448-2238b33759ca tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.242244 Sep 23 03:59:24.385526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2253/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:24.407341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.414495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:24.420148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: c4344710-1d9b-47bc-9899-b1fec7e7425d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.422494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-672b8491-4b14-4d5a-bc74-01f60d6f4fa3 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.219713 Sep 23 03:59:24.431240 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. Sep 23 03:59:24.435535 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2138/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/c4344710-1d9b-47bc-9899-b1fec7e7425d/action HTTP/1.1 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 39 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: {"os-getConsoleOutput": {"length": 10}} Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'c4344710-1d9b-47bc-9899-b1fec7e7425d', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:24.439344 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance c4344710-1d9b-47bc-9899-b1fec7e7425d could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba067767-daf3-44e9-a26f-7373855d17d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/c4344710-1d9b-47bc-9899-b1fec7e7425d/action" status: 404 len: 111 microversion: 2.1 time: 0.030305 Sep 23 03:59:24.443187 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2254/4392] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:24 2022] POST /compute/v2.1/servers/c4344710-1d9b-47bc-9899-b1fec7e7425d/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:24.449977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.450816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.460111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.460952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.461592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.462711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.463338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.463935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.628878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.629704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.631816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.638630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.639353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.639957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.640836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.641485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.642034 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16019e19-6a07-4466-9251-bf3909441605 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.195739 Sep 23 03:59:24.642268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.657375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2139/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:24.668042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.669031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.675478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.676261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.676709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.677461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.677926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.678547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.905846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.916744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2935c14d-6011-4927-acdf-2ae32bfd2b5a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.288624 Sep 23 03:59:24.917413 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2255/4394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:24.942340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecbefbd-d18d-4ba1-989f-4f85a44db1d4"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:24.946067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:24.953269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.954663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.959224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.960891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:24.961590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:24.962552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:24.966193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:24.975159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-70a72898-6490-4917-9566-f2e786f5f707 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.311110 Sep 23 03:59:24.976281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2140/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:24.997262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:24.998038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0ff03ea2-ecc2-415e-867a-27aa582784db] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.003744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:25.005423 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/0ff03ea2-ecc2-415e-867a-27aa582784db HTTP/1.1 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '0ff03ea2-ecc2-415e-867a-27aa582784db'} Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.007011 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.012336 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.012336 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:25.012336 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:25.012336 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. Sep 23 03:59:25.012336 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.014337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0ff03ea2-ecc2-415e-867a-27aa582784db could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:25.015553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff8179ce-bd5f-4d2f-978a-6e3f05eeb62d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0ff03ea2-ecc2-415e-867a-27aa582784db" status: 404 len: 111 microversion: 2.1 time: 0.022187 Sep 23 03:59:25.016626 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2141/4396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:24 2022] GET /compute/v2.1/servers/0ff03ea2-ecc2-415e-867a-27aa582784db => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:59:25.025832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.029598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.038051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.038814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.039880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.041126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.041621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.042210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.076062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments HTTP/1.1 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 74 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: {"volumeAttachment": {"volumeId": "cecbefbd-d18d-4ba1-989f-4f85a44db1d4"}} Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': 'f778b652-a107-41b7-b3b9-d193fc529f4e', 'body': {'volumeAttachment': {'volumeId': 'cecbefbd-d18d-4ba1-989f-4f85a44db1d4'}}} Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:25.078089 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.082791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 400 to user: Invalid volume: volume cecbefbd-d18d-4ba1-989f-4f85a44db1d4 is already attached to instances: f778b652-a107-41b7-b3b9-d193fc529f4e {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:25.084029 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a0eeb9b-92ef-47f4-8cb3-2f496e6ea8e2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151922 Sep 23 03:59:25.087809 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2256/4397] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 03:59:24 2022] POST /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 174 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:25.171435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.172374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.179671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.180147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.181655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.182563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.183363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.184566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.216087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:25.225700 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96d2f2be-24b2-4eed-8305-008a305c8b32 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.204531 Sep 23 03:59:25.229372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2142/4398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:25.253413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.254044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.262401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.262900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.263348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.264128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.264596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.265033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.283589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lazy-loading 'services' on Instance uuid f778b652-a107-41b7-b3b9-d193fc529f4e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:59:25.381402 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f4055b3-17fb-42d5-80b0-bf2d93971238 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments/cecbefbd-d18d-4ba1-989f-4f85a44db1d4" status: 202 len: 0 microversion: 2.1 time: 0.213506 Sep 23 03:59:25.382685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2257/4399] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 03:59:25 2022] DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments/cecbefbd-d18d-4ba1-989f-4f85a44db1d4 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:59:25.394566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.398162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.410466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.411389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.412342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.413280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.413969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.414885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.436572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:25.440279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:25.447832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf90baaa-fef1-4ce9-9092-dad19733e961 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.198386 Sep 23 03:59:25.451366 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2143/4400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:25.467044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f79dd2f0-01cb-424a-8f69-d6885647cb39 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079831 Sep 23 03:59:25.467517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.468153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.468981 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2258/4401] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:59:25.475133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.475884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.476546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.480048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.480409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.480929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.628598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6351d8e-8439-41e9-8884-569bf8262941 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-57916487", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6351d8e-8439-41e9-8884-569bf8262941 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 236 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-57916487", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-57916487', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.642282 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6351d8e-8439-41e9-8884-569bf8262941 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6351d8e-8439-41e9-8884-569bf8262941 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020863 Sep 23 03:59:25.650641 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2259/4402] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:59:25.652270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:25.653643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.653643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.659893 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1415054a-427c-476a-8a68-b3adabe48408 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.207411 Sep 23 03:59:25.660526 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2144/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.675937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.686667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:25.807860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:25.816137 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f264349a-bd65-436c-9bb2-444e567e16ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.166137 Sep 23 03:59:25.816713 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2260/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:25.842744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.843958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.853862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.854376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.854823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.855808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.857013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.857907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.942909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:25.943508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:25.950552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.951046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.951490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:25.952208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:25.952669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:25.953107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.074273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:26.089536 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-226f33ff-5066-49a1-aced-f374b596f310 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.252548 Sep 23 03:59:26.090678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2145/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:26.140561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:26.150739 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9246e4f1-fed8-459c-adc0-fddc617ec7f5 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.212168 Sep 23 03:59:26.151344 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2261/4406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:25 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:26.234746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c1f8eab-59a8-4852-b75d-5e2f9291113b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-613526680", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c1f8eab-59a8-4852-b75d-5e2f9291113b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 234 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-613526680", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-613526680', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.241313 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 03:59:26.245344 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.248255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c1f8eab-59a8-4852-b75d-5e2f9291113b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:26.249271 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c1f8eab-59a8-4852-b75d-5e2f9291113b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.020821 Sep 23 03:59:26.250619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2146/4407] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:26 2022] POST /compute/v2.1/servers => generated 133 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:26.259310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:26.259930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.267008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.267727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.268671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.269584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.270201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.270790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.460895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:26.480887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:26.484218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.488664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fcfb1d2-1317-46d1-8226-8c208546ef7b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.218477 Sep 23 03:59:26.489895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2262/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:26.496086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.496596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.497042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.498053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.498744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.499360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.516814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:26.518091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.525401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.526198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.526873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.528135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.528807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.529512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.558195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5def9fb8-8897-4e36-8463-0cbd81032847 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081430 Sep 23 03:59:26.569885 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2147/4409] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:26 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:59:26.683032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:26.685047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.695403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.697938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.699305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.700867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.702982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.704233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:26.704430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.717981 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e78448c-0e50-447d-87d7-9603c6c08cb9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.206182 Sep 23 03:59:26.729480 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2263/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:26.747205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:26.748620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: ee465f0b-140c-4264-85ee-8912cf790700] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.756150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/ee465f0b-140c-4264-85ee-8912cf790700/action HTTP/1.1 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 13 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: {"pause": {}} Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'ee465f0b-140c-4264-85ee-8912cf790700', 'body': {'pause': {}}} Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:26.764132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:26.768096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:26.768096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:26.768096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. Sep 23 03:59:26.768096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:26.770218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance ee465f0b-140c-4264-85ee-8912cf790700 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:26.771255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c21f1a7c-fd18-4f92-941a-cbc2fda92363 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/ee465f0b-140c-4264-85ee-8912cf790700/action" status: 404 len: 111 microversion: 2.1 time: 0.033889 Sep 23 03:59:26.772049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2264/4411] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:26 2022] POST /compute/v2.1/servers/ee465f0b-140c-4264-85ee-8912cf790700/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:26.781412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:26.782441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:26.796887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.797629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.798409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.799210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:26.800580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:26.801096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:26.993391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:27.006330 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36fbbb46-997e-495d-9f76-01c7336ec9a9 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.326383 Sep 23 03:59:27.010912 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2148/4412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:26 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:27.053156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:27.063406 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a4e6b18-4705-499b-83e3-ece810ae2e2e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.287182 Sep 23 03:59:27.064299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2265/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:27.090198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:27.091074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:27.100297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.100985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.101756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.102867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.103586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.104599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.181121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:27.182769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:27.199209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.200010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.200761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.201909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.202597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.204386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.377378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:27.393341 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f1cdde4-0c00-4665-b2fe-9a76b5664cba tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.308468 Sep 23 03:59:27.394331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2149/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:27 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:27.416588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:27.417242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:27.430217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.433549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.434341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.435598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.436323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.437185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.477532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:27.487736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ec4804c-2d63-45bb-8107-c308824e32c1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.311877 Sep 23 03:59:27.489086 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2266/4415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:27 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:27.572528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:27.586311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:27.596893 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbd888a6-8e75-423e-b582-20a504b8a051 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.183839 Sep 23 03:59:27.600990 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2150/4416] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:27 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:27.605311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.606448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.608043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.613007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.614111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.615160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.627286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:27.633652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:27.655659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.656215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.656686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.657777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:27.658763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:27.659258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:27.685146 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6da944fd-1ca5-4903-a9d1-04be9f60231f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117378 Sep 23 03:59:27.686075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2267/4417] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:27 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:27.868033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:27.880729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e29e5e2c-be1d-4476-8697-1da922d7c7b3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1509 microversion: 2.1 time: 0.275344 Sep 23 03:59:27.881328 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2151/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:27 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:28.037134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:28.038349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:28.047146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.047922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.048561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.050754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.051418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.052313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.253129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:28.262351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-60392f44-5fb3-4c36-9031-b7bf8a81a632 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1522 microversion: 2.1 time: 0.230747 Sep 23 03:59:28.262937 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2268/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:28 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:28.512423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:28.513555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:28.523735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.525321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.526349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.527518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.528359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.529050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.699727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:28.703147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:28.717594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.718087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.720638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.721392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.722377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.722807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.731531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:28.742565 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84ce060e-ebf5-4f1d-9595-c297e64f7e23 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.232890 Sep 23 03:59:28.756600 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2152/4420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:28 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:28.758591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e84a9577-0989-414c-81fd-aee5743cdac5 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064462 Sep 23 03:59:28.759924 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2269/4421] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:28 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:28.904769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:28.906379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:28.914308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.915031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.915634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:28.916497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:28.917406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:28.918274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.254650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:29.263881 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab37c624-9f64-456a-afc9-59c9315a58ec tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1489 microversion: 2.1 time: 0.363474 Sep 23 03:59:29.264493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2153/4422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:28 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1489 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:29.288349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:29.288975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.289424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:29.290052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.295549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.296052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.296631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.297219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.297782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.298255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.301018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.301986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.302725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.305722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.306325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.308402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.364266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'pause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state paused Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 13 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: {"pause": {}} Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'pause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state paused Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'pause': {}}} Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state paused. Cannot pause while the instance is in this state. Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state paused Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:29.367835 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state paused Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'pause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state paused {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:29.371936 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89fecad7-4f73-4217-b5d4-44490017281d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 143 microversion: 2.1 time: 0.086904 Sep 23 03:59:29.374142 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2154/4423] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:29 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 143 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 03:59:29.386432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:29.388714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.397779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.398292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.398726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.399734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.399923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.400342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.485782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:29.495452 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-26953432-c919-458d-85ff-a22ea6e43dea tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1502 microversion: 2.1 time: 0.213936 Sep 23 03:59:29.496049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2270/4424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:29 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:29.512275 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7fb4bedf-488c-4ad3-acfd-266d092cf2b1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.134240 Sep 23 03:59:29.513151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2155/4425] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:29 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:29.524759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-59b5235e-acce-435f-8750-d2f28e90946b tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'create', calling method: .version_select at 0x7f0c8b1b8790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1853963869", "description": "tempest-description-1045848988"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:29.525118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:29.526225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.539821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.542275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.542999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.544103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.544795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.545476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.770399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:29.784757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9496299-0a23-445b-9ce7-cba94e0ca0b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1496 microversion: 2.1 time: 0.264995 Sep 23 03:59:29.787425 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2156/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:29 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1496 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:29.797123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:29.798861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.813795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.815725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.817459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.821480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.822528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.824153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.864210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-59b5235e-acce-435f-8750-d2f28e90946b tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.346059 Sep 23 03:59:29.873286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2271/4427] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Sep 23 03:59:29 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:29.879094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:29.883455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.908314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.914231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.914666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.915398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.916110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.916728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.962720 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-959acf7e-9d12-4197-a170-b3d4d448c09e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087707 Sep 23 03:59:29.963311 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2272/4428] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:29 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:29.968658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1853963869"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:29.969517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:29.976796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.977511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.978174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:29.979087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:29.979734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:29.980550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:30.121186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:30.132249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-747288e9-4688-4575-9e55-0b1d1db35c3f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.343721 Sep 23 03:59:30.133510 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2157/4429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:29 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:30.231611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Adding security group afd13999-7a4d-4c89-9a10-5799989eea71 to port 1a771a42-df17-47e7-8039-36730d6af075 Sep 23 03:59:30.668216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3f4a208-58e4-49eb-a61e-fdf015cc5da1 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action" status: 202 len: 0 microversion: 2.1 time: 0.703177 Sep 23 03:59:30.669011 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2273/4430] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:29 2022] POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:30.678164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1853963869"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:30.678796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:30.689621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:30.690122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:30.690856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:30.691152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:30.691871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:30.692331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:30.692765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:30.702394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:30.706566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:30.707306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:30.730486 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] Creating event network-changed:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:59:30.744431 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7342dc13-7b3e-49b6-b1b5-359a61d9b226 req-a4ddac75-b44a-4592-818d-9b708a735468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063066 Sep 23 03:59:30.747849 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2274/4431] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 03:59:30.813380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:30.814478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:30.825633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:30.829731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:30.830496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:30.834111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:30.835086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:30.835766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:31.093875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.security_group_api [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Removing security group afd13999-7a4d-4c89-9a10-5799989eea71 from port 1a771a42-df17-47e7-8039-36730d6af075 Sep 23 03:59:31.642169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:31.654704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31fdb4f2-8e6c-4592-ba7c-8d66e4801ba6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.845711 Sep 23 03:59:31.655820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2275/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:30 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:31.663298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:31.666534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:31.674610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:31.679189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:31.679762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:31.680624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:31.681191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:31.681659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:31.732817 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b570d1d6-51d1-483a-8055-04798dc2d95e tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074830 Sep 23 03:59:31.741431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2276/4433] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 03:59:31 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:59:31.748458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:31.750019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:31.759913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:31.761038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:31.762084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:31.763249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:31.764354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:31.765156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.136832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:32.155134 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51db34bd-3a49-4ccd-a174-e8c1e0438473 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.408599 Sep 23 03:59:32.158465 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2277/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:31 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:32.177027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:32.181524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:32.188287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.189206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.190108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.191246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.191928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.192662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.243541 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a50e9a5d-8d13-45b6-b567-b7d8c1a45bb0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action" status: 202 len: 0 microversion: 2.1 time: 1.569209 Sep 23 03:59:32.247918 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2158/4435] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:30 2022] POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action => generated 0 bytes in 1575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:32.273607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:32.276352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:32.301041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.302308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.303660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.306115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.307560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.309449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.362929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:59:32.417524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:32.463641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:32.477802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d413929-d380-4ed6-9472-fd08339bb527 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.315734 Sep 23 03:59:32.478518 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2278/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:32 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:32.483204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2f578e9-9060-4ff4-bb9e-b541afd2bce0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'create', calling method: .version_select at 0x7f0c8a8cb5e0>, body: {"pool": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:32.624423 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff1e07d6-e09b-4dfe-a760-ee7b848e0df0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 204 len: 0 microversion: 2.1 time: 0.368909 Sep 23 03:59:32.629017 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2159/4437] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:59:32 2022] DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:59:32.638679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:32.644607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:32.661712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.662276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.663565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.665772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.666432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.668437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.688360 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action HTTP/1.1 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 28 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: {"reboot": {"type": "SOFT"}} Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2', 'body': {'reboot': {'type': 'SOFT'}}} Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:32.689931 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-796387ea-d3d7-4f09-af82-a6040ab993e3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action" status: 404 len: 111 microversion: 2.1 time: 0.071200 Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2160/4438] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:32 2022] POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:32.710816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:32.715985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.717080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.717080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:32.718716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:32.719188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:32.719858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.007168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:33.016445 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-677c757c-dee9-4d8f-9ec8-a9c72592c9f9 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1679 microversion: 2.1 time: 0.315428 Sep 23 03:59:33.017434 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2161/4439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:32 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:33.022283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:33.023131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:33.041835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.042636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.043434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.044350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.045095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.046033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.298011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:33.339153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76fa4ba9-8198-42c8-a54d-5b25f10f73ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.320356 Sep 23 03:59:33.341990 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2162/4440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:33 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:33.355600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:33.367938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.368722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.369326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.384073 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] Creating event network-changed:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:59:33.390309 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c1da4d02-418e-4e14-aef2-07eb135de7d2 req-cd00aea4-ffd7-4883-b9fe-76c16ba175e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041567 Sep 23 03:59:33.391433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2163/4441] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:33.398314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:33.399025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:33.406713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.407399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.407852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.408560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.409052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.409592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.734829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:33.752216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e826851-98aa-4a3c-94b8-de1102b5ab39 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1511 microversion: 2.1 time: 0.359085 Sep 23 03:59:33.765373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2164/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:33 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:33.765373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:33.765373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:33.777538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.778757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.779394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:33.785046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:33.786088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:33.786748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:34.120843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:34.133037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d913f806-ec2b-4f95-8bc8-b3b74efc6b48 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.377813 Sep 23 03:59:34.133931 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2165/4443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:33 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:34.139004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:34.139821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:34.148866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:34.150010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:34.150836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:34.152273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:34.152946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:34.154053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:34.732571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:34.744413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e95b010a-e43c-46a7-ba55-500743076c7d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1679 microversion: 2.1 time: 0.608973 Sep 23 03:59:34.745908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2166/4444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:34 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1679 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:34.754972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:34.758594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: b743a2f1-02f4-4088-af93-1f72d1613a6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:34.766867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/b743a2f1-02f4-4088-af93-1f72d1613a6e/action HTTP/1.1 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 28 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: {"reboot": {"type": "SOFT"}} Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'b743a2f1-02f4-4088-af93-1f72d1613a6e', 'body': {'reboot': {'type': 'SOFT'}}} Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. Sep 23 03:59:34.769914 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. Sep 23 03:59:34.778491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:34.781611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance b743a2f1-02f4-4088-af93-1f72d1613a6e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:34.783283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e263224-d11e-4be1-b2b7-f253ae97c602 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/b743a2f1-02f4-4088-af93-1f72d1613a6e/action" status: 404 len: 111 microversion: 2.1 time: 0.036037 Sep 23 03:59:34.784717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2167/4445] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:34 2022] POST /compute/v2.1/servers/b743a2f1-02f4-4088-af93-1f72d1613a6e/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:34.795334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:34.796231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:34.809457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:34.810140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:34.811049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:34.812999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:34.814007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:34.814606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.106623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2f578e9-9060-4ff4-bb9e-b541afd2bce0 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.626922 Sep 23 03:59:35.107939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2279/4446] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Sep 23 03:59:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:35.120406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:35.122439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:35.142662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.143134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.143595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.144729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.144849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.145187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.678420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:35.698346 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bc5e097-4959-4e07-b740-f1d516344dfa tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1488 microversion: 2.1 time: 0.908816 Sep 23 03:59:35.700699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2168/4447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:34 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1488 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:35.721448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.53"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:35.728765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:35.737623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.738983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.739684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.740952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.741789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.742534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.773547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:59:35.774333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquired lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:59:35.778970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:35.791545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6bca8a90-b4d2-4b3a-bc89-e692693e1858 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.681111 Sep 23 03:59:35.792781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2280/4448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:35 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:35.809114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:35.809966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:35.824451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.824451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.824766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.825478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:35.826149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:35.826848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:35.833470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:35.864056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:59:35.988407 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-402a6ea3-fe65-4c52-9f48-796a0c37956c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 204 len: 0 microversion: 2.1 time: 0.188535 Sep 23 03:59:35.990093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2281/4449] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:59:35 2022] DELETE /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:59:35.998202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:35.999792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:36.009209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:36.010034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:36.010653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:36.011869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:36.012541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:36.013140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:36.433928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:36.448272 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4762810c-be09-47bd-a7dd-bca5d1cef615 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1679 microversion: 2.1 time: 0.455142 Sep 23 03:59:36.449143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2282/4450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:35 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1679 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:36.467188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:36.468242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:36.483325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:36.484082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:36.484953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:36.486438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:36.487615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:36.488224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:36.954439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:36.965663 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-725fa167-b020-4f9f-b548-d30949ecda58 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.515118 Sep 23 03:59:36.967780 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2283/4451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:36 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:36.977541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:36.977541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:36.984971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:36.985755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:36.996160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.001513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.002023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.003429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.430732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:37.442676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92c40fc1-57ed-4dd4-b374-0a4934065075 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1494 microversion: 2.1 time: 0.471351 Sep 23 03:59:37.454471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2284/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:36 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1494 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:37.471089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:37.475777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:37.490516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.491612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.492593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.495005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.496168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.496658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.519141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action HTTP/1.1 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 65 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2', 'body': {'rebuild': {'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda'}}} Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 03:59:37.521289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 03:59:37.526113 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:37.528357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:37.529469 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c95f378e-cd38-4cd8-b99f-f7e7649059ef tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action" status: 404 len: 111 microversion: 2.1 time: 0.073644 Sep 23 03:59:37.530273 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2285/4453] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:37 2022] POST /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:37.544240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:37.545671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:37.568849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.570071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.571026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.572362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.575735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.576879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.726538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:37.745872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-57c409fd-40ae-436a-abe1-18b58546e7f4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 200 len: 1612 microversion: 2.1 time: 0.214232 Sep 23 03:59:37.747179 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2286/4454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:37 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 1612 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:37.761906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:37.764842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:37.790899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.791399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.815023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:37.817459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:37.817974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:37.818427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:38.551836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:38.565868 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82b34927-d598-4939-8aeb-4023359d4f93 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.816746 Sep 23 03:59:38.566534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2287/4455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:37 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:38.570921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778b652-a107-41b7-b3b9-d193fc529f4e", "name": "network-vif-deleted", "tag": "2cbc9039-9dd6-46f2-83df-677a04460e3c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:38.600729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:38.601222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:38.601685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:38.625624 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] Creating event network-vif-deleted:2cbc9039-9dd6-46f2-83df-677a04460e3c for instance f778b652-a107-41b7-b3b9-d193fc529f4e on n-h2-858495-2 Sep 23 03:59:38.632462 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3ac388c0-e131-4227-a578-06617aec458b req-fe39699a-f4f8-4e83-a541-e17644930459 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063386 Sep 23 03:59:38.634370 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2288/4456] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:38.645234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:38.647647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:38.665257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:38.666242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:38.667967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:38.669864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:38.672501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:38.673151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:38.842903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Building network info cache for instance {{(pid=128723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:59:39.070759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:39.078655 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca86c4f6-222c-49c8-9c1e-54ee96c029a6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1494 microversion: 2.1 time: 0.440548 Sep 23 03:59:39.090096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2289/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:38 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1494 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:39.095095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776a2a5b-5bd6-4c57-ac7b-627d9091bab6", "name": "network-vif-unplugged", "status": "completed", "tag": "5ec5c257-f407-4c47-97c9-d7c9dd269f1d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:39.114237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.115012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.117916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.133099 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] Creating event network-vif-unplugged:5ec5c257-f407-4c47-97c9-d7c9dd269f1d for instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 on n-h2-858495-2 Sep 23 03:59:39.150985 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-68462f3f-4ebb-48bb-83fc-c5e7c0a6fa17 req-0a5b0803-4150-4761-a002-19ebb64038de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059443 Sep 23 03:59:39.157446 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2290/4458] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:39.163760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:39.174949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:39.180757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:39.183310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.183981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.185879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.186879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.197037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.197698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.606522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:39.618234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1c37936-4c48-42e3-8e86-6eca92ac0e54 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.459320 Sep 23 03:59:39.630076 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2291/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:39 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:39.646256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:39.646961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:39.663606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.664363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.665212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.666150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.666793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.676104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.707794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e HTTP/1.1 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f778b652-a107-41b7-b3b9-d193fc529f4e'} Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:39.711374 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 03:59:39.716174 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.724792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:39.728750 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-baac38a2-8193-437a-a2e1-b3fd2f50a941 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 404 len: 111 microversion: 2.1 time: 0.097349 Sep 23 03:59:39.729160 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2292/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:39 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:39.742476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:39.748131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 9aaeff45-f07a-408c-89e8-31719ec9ebc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:39.757708 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/9aaeff45-f07a-408c-89e8-31719ec9ebc6/action HTTP/1.1 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 65 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9aaeff45-f07a-408c-89e8-31719ec9ebc6', 'body': {'rebuild': {'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda'}}} Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 03:59:39.759788 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. Sep 23 03:59:39.765561 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:39.770074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 9aaeff45-f07a-408c-89e8-31719ec9ebc6 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:39.770342 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ba75493-f829-4ddd-9a72-7c3f7bfe18df tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/9aaeff45-f07a-408c-89e8-31719ec9ebc6/action" status: 404 len: 111 microversion: 2.1 time: 0.031685 Sep 23 03:59:39.771388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2293/4461] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:39 2022] POST /compute/v2.1/servers/9aaeff45-f07a-408c-89e8-31719ec9ebc6/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:39.783545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-debd0a68-6c1b-41c5-8737-ad0cb7ccb34c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '.version_select at 0x7f0c8a6a3a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:39.808632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-debd0a68-6c1b-41c5-8737-ad0cb7ccb34c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738579876" status: 202 len: 0 microversion: 2.1 time: 0.035692 Sep 23 03:59:39.809534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2294/4462] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 03:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738579876 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:39.834472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:39.838610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:39.853753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.855790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.856238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:39.856960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:39.858913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:39.859358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.177446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:40.203453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f862f76-443d-4fbf-ad1c-fb9aea60c71a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.391978 Sep 23 03:59:40.211645 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2295/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:39 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:40.242618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:40.243245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:40.266690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.267459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.269336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.271575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.278707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.279457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.344799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Updating instance_info_cache with network_info: [{"id": "1a771a42-df17-47e7-8039-36730d6af075", "address": "fa:16:3e:1e:43:b6", "network": {"id": "585724df-e90c-4846-b16b-92fa62b61834", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-250889742-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "aae1fb33ff714654a0787eb6685b64f3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1a771a42-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:59:40.354216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.355066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.355709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.356596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'fault' on Instance uuid 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:59:40.356874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Releasing lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:59:40.362508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b9ef795-8f7a-4ef7-b88e-64eada770830 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action" status: 202 len: 0 microversion: 2.1 time: 4.657700 Sep 23 03:59:40.362508 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2169/4464] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:35 2022] POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action => generated 0 bytes in 4659 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:59:40.377836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:40.380591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:40.397284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.397685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.399903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.400671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.401160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.403324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.429420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:40.442597 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9844a36-b0a4-473a-986d-c8657fb3157b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 200 len: 1305 microversion: 2.1 time: 0.214384 Sep 23 03:59:40.463968 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2296/4465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:40 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 1305 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:40.476167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Action: 'action', calling method: .version_select at 0x7f0c918b6820>, body: {"removeFloatingIp": {"address": "172.25.2.53"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:40.802246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:40.809317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.809828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.810264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.810972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.812576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.813015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.836653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:40.849827 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8caa7e61-c354-4d90-933c-bfd4c2a1b590 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.483469 Sep 23 03:59:40.852214 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2170/4466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:40 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:40.867069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}, {"server_uuid": "776a2a5b-5bd6-4c57-ac7b-627d9091bab6", "name": "network-vif-deleted", "tag": "5ec5c257-f407-4c47-97c9-d7c9dd269f1d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:40.897699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:40.898234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:40.902668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:40.939550 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Creating event network-changed:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:59:40.944301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] Creating event network-vif-deleted:5ec5c257-f407-4c47-97c9-d7c9dd269f1d for instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 on n-h2-858495-2 Sep 23 03:59:40.963138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-54ed83bc-dd53-44e9-807a-538c08063126 req-2850ed46-d4a7-4e90-b7b5-ed751bd8474a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108961 Sep 23 03:59:40.969872 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2171/4467] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:40.990375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:40.994591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 16c7ae34-cf31-4ce7-b6ce-82536b74591f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:41.012941 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/16c7ae34-cf31-4ce7-b6ce-82536b74591f/action HTTP/1.1 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 15 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: {"restore": {}} Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '16c7ae34-cf31-4ce7-b6ce-82536b74591f', 'body': {'restore': {}}} Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:41.018506 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 16c7ae34-cf31-4ce7-b6ce-82536b74591f could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:41.022549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7037161c-38c0-4f82-b58c-dc021863b1bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/16c7ae34-cf31-4ce7-b6ce-82536b74591f/action" status: 404 len: 111 microversion: 2.1 time: 0.047421 Sep 23 03:59:41.027523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2172/4468] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:40 2022] POST /compute/v2.1/servers/16c7ae34-cf31-4ce7-b6ce-82536b74591f/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:41.037009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ca66e37-6ac2-416c-b3c2-713adfa00ce8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: .version_select at 0x7f0c8a807790>, body: {"keypair": {"name": "tempest-keypair-1409776178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp8KNqq62C52kVZILzgavNcLccp9EAf/VsfESDZwaaX+Ih3tm1uV+baJi22V9E9OBnCjq3LzjqTSRJk3A4jXpErlFwwqNfixUCwPHZWU8KHlcExh7IHsWquZZjDh7aLSg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:41.058549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9ca66e37-6ac2-416c-b3c2-713adfa00ce8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:59:41.067039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9ca66e37-6ac2-416c-b3c2-713adfa00ce8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:59:41.139914 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ca66e37-6ac2-416c-b3c2-713adfa00ce8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114355 Sep 23 03:59:41.142521 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2173/4469] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 03:59:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:41.167364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:41.172531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:41.189770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.190785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.191237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:41.191960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.192425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.192893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:41.432728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 03:59:41.433153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquired lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 03:59:41.605323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:41.620665 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-edb5e605-1853-4702-9ea4-9091caf2b650 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.475616 Sep 23 03:59:41.622798 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2174/4470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:41 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:41.636677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:41.639292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:41.661973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.664935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.666753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:41.668161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.669937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.671590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:41.700635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 HTTP/1.1 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '776a2a5b-5bd6-4c57-ac7b-627d9091bab6'} Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:41.702263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:41.707285 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-247abdd9-7e08-4492-a475-353624c7ca51 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 404 len: 111 microversion: 2.1 time: 0.079494 Sep 23 03:59:41.717477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2175/4471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:41 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:41.725627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:41.725627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:41.741248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.741815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.743493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:41.745934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:41.746428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:41.747610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:42.294336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:42.313954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f57fdfc6-7ee1-46a0-8a1d-5c9b29eb52b8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.602685 Sep 23 03:59:42.315574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2176/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:41 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:42.326961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-51894244", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "818d1340-bf85-4ec0-a935-ce2e89fcea7f"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:42.410562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] validate_networks() for [('818d1340-bf85-4ec0-a935-ce2e89fcea7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:59:43.501142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Building network info cache for instance {{(pid=128724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 03:59:43.597529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:59:43.598061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:59:43.598449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:59:43.598923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:59:43.599359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:59:43.626953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:43.627521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:43.627973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:43.628729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:43.629229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:43.629675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:43.665563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:59:43.680893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Getting quotas for user 0822d3170afd48aca442be6a5d11a5d3 and project 4b9828a782284736b26b844a9b4d500b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:59:43.719188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:59:43.722164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:59:43.794837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:43.824859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18e3fc97-d9e3-4555-bca0-224e6f0c2499 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507938 Sep 23 03:59:43.826947 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2177/4473] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:59:43.833750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:43.842051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:43.858756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:43.863125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:43.865173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:43.865974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:43.866448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:43.866899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:43.950596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'restore' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 15 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: {"restore": {}} Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'restore' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'restore': {}}} Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state active. Cannot restore while the instance is in this state. Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:43.957183 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'restore' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf976a1b-770f-46a3-94ad-e5fbfb0af7a9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 145 microversion: 2.1 time: 0.131395 Sep 23 03:59:43.965387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2178/4474] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:43 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 145 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:59:43.980563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1656057764", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477af16e-1c5b-4384-8f7b-9015a1b1fdab"}], "security_groups": [{"name": "tempest-securitygroup--813039020"}], "key_name": "tempest-keypair-1409776178", "user_data": "}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:44.225174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] validate_networks() for [('477af16e-1c5b-4384-8f7b-9015a1b1fdab', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 03:59:44.425738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Updating instance_info_cache with network_info: [{"id": "1a771a42-df17-47e7-8039-36730d6af075", "address": "fa:16:3e:1e:43:b6", "network": {"id": "585724df-e90c-4846-b16b-92fa62b61834", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-250889742-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "aae1fb33ff714654a0787eb6685b64f3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1a771a42-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 03:59:44.448486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Releasing lock "refresh_cache-e3c5c233-8aa2-4394-8a8d-1b873d88cd00" {{(pid=128724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 03:59:44.451672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc41e6dd-048c-459c-a234-5ed2dcd785b4 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action" status: 202 len: 0 microversion: 2.1 time: 3.984942 Sep 23 03:59:44.454252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2297/4475] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:40 2022] POST /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00/action => generated 0 bytes in 3989 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 03:59:44.487627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:44.513720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:44.516034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:44.516743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:44.551451 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] Creating event network-changed:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:59:44.557279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8e6465de-ca85-4885-b217-2cea13148f7e req-b7c382ea-6c1d-4b1f-bc66-c7eb937f2c6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101372 Sep 23 03:59:44.558581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2298/4476] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:44.564070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-efde9504-8151-4e94-ab61-81833cb59b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:44.565139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-efde9504-8151-4e94-ab61-81833cb59b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:44.720125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-efde9504-8151-4e94-ab61-81833cb59b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:44.732003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-efde9504-8151-4e94-ab61-81833cb59b3a tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1213 microversion: 2.1 time: 0.171527 Sep 23 03:59:44.734869 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2299/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:44 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:44.755027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:44.755894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:44.768863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:44.769682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:44.771101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:44.772105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:44.772795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:44.773496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:45.149310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:59:45.150011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:59:45.150199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:45.150788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:59:45.151350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:59:45.152240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:59:45.164829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:45.165847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:45.166853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:45.167374 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f68d3756-dba2-49f2-ba7c-ada779e12c3a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.429473 Sep 23 03:59:45.167967 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2300/4478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:44 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:45.168373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:45.169783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:45.172475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:45.181838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1edae582-f07d-436f-9d73-6a9a8f94789d tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '.version_select at 0x7f0c8a459670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:45.198475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 03:59:45.205945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Getting quotas for user 310efb884806402cbea5f65238e91188 and project 767515854d364c4fa516f4a4685254b0. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 03:59:45.224666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 03:59:45.227207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 03:59:45.294759 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c78647d9-7419-4951-984e-bf04e204d8e8 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.326230 Sep 23 03:59:45.296191 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2179/4479] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:59:45.311444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:45.315103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:45.358474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:45.364118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:45.367817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:45.369658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:45.374913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:45.377553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:46.148514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:46.161938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-586b900c-2c7b-44c4-8a34-04b3e549fc99 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.860340 Sep 23 03:59:46.162588 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2180/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:45 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:46.178533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c02f93e7-baaa-4e65-8c6f-19c69e0ddf40 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:46.179164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c02f93e7-baaa-4e65-8c6f-19c69e0ddf40 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:46.335414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c02f93e7-baaa-4e65-8c6f-19c69e0ddf40 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:46.344265 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c02f93e7-baaa-4e65-8c6f-19c69e0ddf40 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1242 microversion: 2.1 time: 0.180424 Sep 23 03:59:46.348120 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2181/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:46 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:46.357890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:46.358990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:46.375994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:46.377081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:46.377916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:46.380232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:46.381273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:46.382277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:46.494755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:46.497588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:46.520868 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95eea2e8-970b-4a86-bee3-875791d7ce18 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1271 microversion: 2.1 time: 0.171257 Sep 23 03:59:46.523302 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2182/4482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:46 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:46.531288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:46.534029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: e73e960c-ac9f-49bc-b68d-9e03727d03cb] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:46.541534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/e73e960c-ac9f-49bc-b68d-9e03727d03cb/action HTTP/1.1 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 14 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: {"resume": {}} Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e73e960c-ac9f-49bc-b68d-9e03727d03cb', 'body': {'resume': {}}} Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:46.550721 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:46.555777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:46.555777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:46.555777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. Sep 23 03:59:46.555777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:46.558098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance e73e960c-ac9f-49bc-b68d-9e03727d03cb could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:46.559352 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5deb6f0b-c720-4442-afb9-2a2171d1cbb8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/e73e960c-ac9f-49bc-b68d-9e03727d03cb/action" status: 404 len: 111 microversion: 2.1 time: 0.034233 Sep 23 03:59:46.560870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2183/4483] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:46 2022] POST /compute/v2.1/servers/e73e960c-ac9f-49bc-b68d-9e03727d03cb/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:59:46.571680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:46.573579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:46.582702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:46.583201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:46.583718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:46.585644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:46.586530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:46.587203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:47.060867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:47.086549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-419bdd6d-cc35-4482-8a0a-725678909ca0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.520721 Sep 23 03:59:47.087103 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2184/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:46 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:47.094021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:47.107006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:47.119688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:47.121066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:47.123111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:47.124111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:47.125908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:47.128020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:47.310160 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1cb46b69-1496-4c77-af09-63e39dd1a7cd tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.219176 Sep 23 03:59:47.313686 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2185/4485] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:47 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:47.360467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:47.367398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:47.399783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:47.400838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:47.401326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:47.402137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:47.410498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:47.412725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.488351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1edae582-f07d-436f-9d73-6a9a8f94789d tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9e8e4248-ff0c-4792-8c32-169f6285d518" status: 202 len: 0 microversion: 2.1 time: 3.315463 Sep 23 03:59:48.489203 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2301/4486] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 03:59:45 2022] DELETE /compute/v2.1/os-floating-ips/9e8e4248-ff0c-4792-8c32-169f6285d518 => generated 0 bytes in 3320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:48.500699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:48.501787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:48.512879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.513400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.513833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.514753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.515219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.515644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.536912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:48.554831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:48.572289 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01665187-b520-4f4b-9491-11bdc4634012 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 1.228508 Sep 23 03:59:48.573514 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2186/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:47 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:48.585955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:48.587574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:48.604192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.605810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.606927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.613299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.613299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.613725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.857070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:48.867803 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-560eb76f-7292-4aa7-96ec-d8cf2484ff85 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1300 microversion: 2.1 time: 0.292042 Sep 23 03:59:48.868995 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2187/4488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:48 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:48.887179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:48.889591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:48.902859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.903955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.904874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:48.905979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:48.906599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:48.908209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:49.183994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:49.199659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4915f593-5fc1-40e5-8091-76f9aad740d9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1670 microversion: 2.1 time: 0.708702 Sep 23 03:59:49.201184 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2302/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:48 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1670 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:49.207810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef84717b-f53e-469e-9fab-1be1bdf3be9e tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '.version_select at 0x7f0c8a6a3700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:49.461264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:49.477757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-372494e2-9171-4b29-a758-1ef3453988d6 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.599490 Sep 23 03:59:49.478625 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2188/4490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:48 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:49.484347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:49.485102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:49.492744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:49.493542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:49.494152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:49.495056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:49.495545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:49.495965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:49.526932 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'resume' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 14 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: {"resume": {}} Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'resume' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'resume': {}}} Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state active. Cannot resume while the instance is in this state. Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:49.528855 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'resume' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17657038-ac5a-47d3-85f5-93e4a89f7978 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 144 microversion: 2.1 time: 0.050460 Sep 23 03:59:49.533831 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2189/4491] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:49 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 144 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:59:49.541720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:49.543324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:49.552168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:49.552943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:49.553581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:49.554839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:49.556022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:49.556653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.146946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:50.181748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae71ab01-603e-404b-ae98-8c4f881ce910 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.642759 Sep 23 03:59:50.194041 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2190/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:49 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:50.196325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:50.197158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:50.219324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef84717b-f53e-469e-9fab-1be1bdf3be9e tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/afd13999-7a4d-4c89-9a10-5799989eea71" status: 202 len: 0 microversion: 2.1 time: 1.016207 Sep 23 03:59:50.220046 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2303/4493] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 03:59:49 2022] DELETE /compute/v2.1/os-security-groups/afd13999-7a4d-4c89-9a10-5799989eea71 => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:50.230970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:50.231746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:50.235760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.237208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.239678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.240635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.241852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.243805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.249507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.254143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.255069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.256048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.256808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.259027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.447948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:50.456955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11578483-6c5a-4075-b5cf-46847441a413 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1300 microversion: 2.1 time: 0.271888 Sep 23 03:59:50.457593 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2191/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:50 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:50.473801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:50.474691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:50.488088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.497267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.498068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.499097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:50.500051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:50.502819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:50.954986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:50.973465 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df470960-a510-4549-afc8-1d13b979c627 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.744973 Sep 23 03:59:50.978621 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2304/4495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:50 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:50.995262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:50.996803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:51.023809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:51.030879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.031364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.032373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.033145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.033640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.034074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.043202 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc0ca5f6-02bd-4aa9-bc55-541c8c45c561 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1675 microversion: 2.1 time: 0.573150 Sep 23 03:59:51.058295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2192/4496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:50 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1675 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:51.070842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:51.073414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:51.084812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 03:59:51.094539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.097917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.099501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.104505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.113588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.116192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.337256 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cbaa4a3f-e8a2-4029-b4e9-c678fd6702c5 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 204 len: 0 microversion: 2.1 time: 0.356701 Sep 23 03:59:51.339210 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2305/4497] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 03:59:50 2022] DELETE /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:59:51.350223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-782e373b-1815-4001-8816-8153c0d20a60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-782e373b-1815-4001-8816-8153c0d20a60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 160 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9586326b-a441-4e4d-8a95-584444e131a4"}]}} Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda', 'flavorRef': '452', 'networks': [{'uuid': '9586326b-a441-4e4d-8a95-584444e131a4'}]}}} Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 03:59:51.369860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 03:59:51.376634 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:51.383871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-782e373b-1815-4001-8816-8153c0d20a60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:51.385878 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-782e373b-1815-4001-8816-8153c0d20a60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.045358 Sep 23 03:59:51.387099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2306/4498] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 03:59:51 2022] POST /compute/v2.1/servers => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:59:51.394365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:51.395448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:51.407158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.408829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.409650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.411244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:51.412163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:51.412893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:51.990353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:52.016543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0374c142-2200-4507-8fa5-1154e8f711d4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.955300 Sep 23 03:59:52.019939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2193/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:51 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:52.036857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:52.038592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:52.048542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.049003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.049701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.052508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.053436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.054490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.278365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:52.289179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b89e7ee-b9bb-41d0-b1ad-285fe4a10193 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1508 microversion: 2.1 time: 0.900667 Sep 23 03:59:52.292768 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2307/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:51 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1508 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:52.307129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:52.309106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:52.323887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.325375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.326089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.327231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.327850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.328499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.454111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:52.470249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea0f7b8a-f8bb-43e8-a793-ab69eadfc959 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.446980 Sep 23 03:59:52.489043 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2194/4501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:52 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:52.503783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:52.505135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:52.517983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.520044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.520768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.522360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.523358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.523985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.907313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:52.915508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4da5a89b-4a7e-439e-bf30-4b4088d70470 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.621274 Sep 23 03:59:52.916361 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2308/4502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:52 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:52.927840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b54d47-6d20-4d24-b5a0-8c71a7322707", "tag": "ec2d3965-e37a-41b9-9700-5e33b4b031b6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:52.940721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.941589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.942266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.955481 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] Creating event network-changed:ec2d3965-e37a-41b9-9700-5e33b4b031b6 for instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 on n-h2-858495-2 Sep 23 03:59:52.962141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d1f9f885-3674-4fbf-a518-5577901f1e1f req-6936268e-366b-4ee7-a35b-9814438d4bb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043870 Sep 23 03:59:52.963816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2309/4503] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:52.975992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:52.976989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:52.983554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.984377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.985026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:52.986078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:52.987275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:52.987914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.034531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:53.050463 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c4961a0-6896-420e-bf44-805cafb4a04d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.559801 Sep 23 03:59:53.052447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2195/4504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:52 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:53.067208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:53.068136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:53.079316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.080147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.080593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.081309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.081797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.082229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.604546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:53.617821 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-57530f4b-e462-499d-9dde-03b0f9bca333 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.563828 Sep 23 03:59:53.620259 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2196/4505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:53 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:53.628981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:53.630431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:53.631185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:53.639620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.640841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.641727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.643402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.643524 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e9101e64-d64f-42f6-b8ba-30aeaf1c9e57 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.677894 Sep 23 03:59:53.644236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.645424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.646534 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2310/4506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:52 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:53.670454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:53.672815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:53.680599 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/7e9bddc6-4d82-4915-9a1a-79aa7a27fd12/action HTTP/1.1 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 14 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: {"shelve": {}} Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7e9bddc6-4d82-4915-9a1a-79aa7a27fd12', 'body': {'shelve': {}}} Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:53.689829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 7e9bddc6-4d82-4915-9a1a-79aa7a27fd12 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:53.693860 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98ba287d-b706-4579-9cc4-b5daaaa6d189 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/7e9bddc6-4d82-4915-9a1a-79aa7a27fd12/action" status: 404 len: 111 microversion: 2.1 time: 0.028489 Sep 23 03:59:53.694268 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2311/4507] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:53 2022] POST /compute/v2.1/servers/7e9bddc6-4d82-4915-9a1a-79aa7a27fd12/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:59:53.703548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:53.706326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:53.714787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.715363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.715897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:53.716675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:53.717208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:53.717739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.084321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:54.096961 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4edcd2e-8a6b-4f1b-8c14-d4fc9b1b6ed2 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1508 microversion: 2.1 time: 0.474980 Sep 23 03:59:54.097743 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2197/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:53 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:54.104066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:54.105119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:54.114017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.114867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.115599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.116662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.117475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.118114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.153718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:54.181210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3007610f-46c9-4ce5-b266-f7bdcebc1ec7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.482535 Sep 23 03:59:54.181959 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2312/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:53 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:54.216202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:54.216722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:54.224489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.224990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.225871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.226702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.227177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.227724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.492347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:54.504444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39e39ab3-1d11-4127-9b6c-7ec00346c63d tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.405183 Sep 23 03:59:54.506301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2198/4510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:54 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:54.626142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:54.644885 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c611e32b-81f4-4f2f-9235-5d3aa388435b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.432822 Sep 23 03:59:54.645827 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2313/4511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:54 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:54.656651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:54.659873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:54.676431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:54.677039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:54.678696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.682881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.684416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.685319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.686381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.687618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.688284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.689425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.689652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.691302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:54.693206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:54.697513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:54.738811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:54.752651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lazy-loading 'flavor' on Instance uuid 97379c08-f144-4054-a9b9-f7a548e2a061 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 03:59:54.999876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:55.007515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:55.025415 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89b09e88-ad9f-4ad9-9748-e85ae908d776 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.382392 Sep 23 03:59:55.047154 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2199/4512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:54 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:59:55.060777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70d54db-21cd-4c0c-ab41-2a7828f6ea3b", "tag": "543bd5ff-e768-44be-b1da-6f15bf6e8547"}, {"server_uuid": "e3c5c233-8aa2-4394-8a8d-1b873d88cd00", "name": "network-vif-deleted", "tag": "1a771a42-df17-47e7-8039-36730d6af075"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:55.085694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.087160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.087806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.088743 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-917a1126-ae49-495d-94f1-b50cfdae414f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.420792 Sep 23 03:59:55.094944 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2314/4513] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 03:59:54 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:59:55.103470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:55.104839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:55.121990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.123077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.124301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.125735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.127795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.129416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.139263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Creating event network-changed:543bd5ff-e768-44be-b1da-6f15bf6e8547 for instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b on n-h2-858495-2 Sep 23 03:59:55.140108 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] Creating event network-vif-deleted:1a771a42-df17-47e7-8039-36730d6af075 for instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 on n-h1-858495-2 Sep 23 03:59:55.149251 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c643095b-98b2-424a-8ae9-e239c5c0d482 req-1f982652-02cc-41a3-8c01-5ca1ad08cc75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.100606 Sep 23 03:59:55.150538 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2200/4514] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:55.157295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:55.159142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:55.166376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.167163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.167846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.168781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.169669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.170326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.193933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:55.263041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d15160939d40f0a177b9ba1698ae07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae1fb33ff714654a0787eb6685b64f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:55.272604 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd41c544-d9bc-47dd-aef1-677481675168 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 200 len: 1293 microversion: 2.1 time: 0.120595 Sep 23 03:59:55.273286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2201/4515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:55 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:55.346493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:55.360667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69583aa5-4944-45c2-b004-9586639c8c02 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.263352 Sep 23 03:59:55.365881 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2315/4516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:55 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:55.531861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:55.533369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:55.540911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.541817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.542381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.543201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:55.543874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:55.544414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:55.784189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:55.793998 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a83f59d5-3813-4eba-816b-546a900eff70 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.266057 Sep 23 03:59:55.795372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2202/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:55 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:56.299429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:56.299429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] [instance: e3c5c233-8aa2-4394-8a8d-1b873d88cd00] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:56.314846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.323197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.323925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:56.327534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.328039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.328499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:56.348707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 03:59:56.382581 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] HTTP exception thrown: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Request method failure captured: Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 HTTP/1.1 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7weDXTyFWv95UTzRrzMV-zwr9vklja6lWDdAe_TTCRA_ZWeLyvL_r371etcoic1kLgucsRI5u67f5iCU4aCOwS7m-5IiXHzSe5WnRaOjFt66lLJoTAvMBh8EdFJNx9ihBGzbLCdv8w70I1MFLf2tkM2eDkk-9lyt5-6QBCVVUr4JU Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: aae1fb33ff714654a0787eb6685b64f3 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1593810245 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aae1fb33ff714654a0787eb6685b64f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aae1fb33ff714654a0787eb6685b64f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aae1fb33ff714654a0787eb6685b64f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aae1fb33ff714654a0787eb6685b64f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1593810245 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: aae1fb33ff714654a0787eb6685b64f3 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1593810245 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueTestJSONUnderV235-1593810245-project Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 99d15160939d40f0a177b9ba1698ae07 Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1593810245-project Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e3c5c233-8aa2-4394-8a8d-1b873d88cd00'} Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:56.394609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. Sep 23 03:59:56.401609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 03:59:56.406021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] Returning 404 to user: Instance e3c5c233-8aa2-4394-8a8d-1b873d88cd00 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 03:59:56.407380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88e4b8d0-be80-4ef6-9a1f-6976f9a99815 tempest-ServerRescueTestJSONUnderV235-1593810245 tempest-ServerRescueTestJSONUnderV235-1593810245-project] 10.222.0.25 "GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00" status: 404 len: 111 microversion: 2.1 time: 0.115575 Sep 23 03:59:56.409552 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2203/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:56 2022] GET /compute/v2.1/servers/e3c5c233-8aa2-4394-8a8d-1b873d88cd00 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:59:56.417853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:56.418941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:56.430716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.431742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.432524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:56.433633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.434682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.435481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:56.436129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:56.436829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:56.456255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.460545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.462524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:56.467464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:56.469721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:56.471641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:57.016581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:57.032360 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a458203-428d-4ae8-ad97-692ba18edfd8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.621355 Sep 23 03:59:57.034123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2204/4519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:56 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:57.043856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:57.048074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:57.059454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:57.060339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:57.061005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:57.062312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:57.063006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:57.063654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:57.317075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:57.329035 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4510dfe1-3f5a-416b-83d6-b8fce6efe8fb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 1.278143 Sep 23 03:59:57.330907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2316/4520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:56 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:57.387553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:57.402000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce4bdf14-7bba-4e28-8c75-e6804d3cf534 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.366412 Sep 23 03:59:57.404384 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2205/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:57 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:58.060696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:58.061505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:58.079089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.080651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.082573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.084143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.084942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.085658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.310035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b54d47-6d20-4d24-b5a0-8c71a7322707", "name": "network-vif-plugged", "status": "completed", "tag": "ec2d3965-e37a-41b9-9700-5e33b4b031b6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:59:58.362471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.363924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.366399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.414243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] Creating event network-vif-plugged:ec2d3965-e37a-41b9-9700-5e33b4b031b6 for instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 on n-h2-858495-2 Sep 23 03:59:58.423855 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2b9d8029-894a-47af-a1c5-b66a930620a5 req-a1f63320-64b8-4d71-8c1f-ba639318cf52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118339 Sep 23 03:59:58.425408 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2206/4522] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 03:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:59:58.437289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:58.438645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:58.446424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.447746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.448553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.449871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.450636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.451391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.744848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:58.756042 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d83ea4fa-8016-482a-b4a1-02a70c0f0e20 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.700316 Sep 23 03:59:58.757304 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2317/4523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:58 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:58.763149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:58.764893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:58.772721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.773543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.774197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:58.775150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:58.776607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:58.777491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:59.083974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:59.114095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ddbc6e82-c1fd-4caf-8b35-2f9350ff64c3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.684958 Sep 23 03:59:59.116619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2207/4524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:58 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:59.168362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:59:59.180366 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da448505-cc1a-4a4a-9531-5c39c0fb64d1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.421490 Sep 23 03:59:59.181698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2318/4525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:58 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:59:59.783178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:59:59.784480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 03:59:59.793899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:59.798758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:59.801464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 03:59:59.803715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 03:59:59.805755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 03:59:59.806383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:00.144498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:00.147236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:00.147860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:00.159165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:00.160198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0bcae65-0908-4b91-bb7d-c1847d5b092b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.381068 Sep 23 04:00:00.161337 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2208/4526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 03:59:59 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:00.171242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:00.173779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:00.175332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:00.176007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:00.176655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:00.185808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:00.208407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:00.209023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:00.229705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:00.230217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:00.230667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:00.234448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:00.234949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:00.235393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:00.582383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:00.606114 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36a6e558-3ded-4ae2-a538-6816a427964c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.466679 Sep 23 04:00:00.614922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2319/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:00 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:00.666036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:00.675985 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e80378b4-c317-4a3d-81e7-e577ce31b922 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.473067 Sep 23 04:00:00.677076 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2209/4528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:00 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:01.184342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:01.185706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:01.194719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.195674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.196420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:01.197783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.198465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.199114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:01.504349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:01.525653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-058a3627-5bca-480f-a327-8594bc97c2b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.344976 Sep 23 04:00:01.527878 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2320/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:01 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:01.641324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:01.643549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:01.660365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.660893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.661316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:01.662065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.662547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.662986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:01.701746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:01.702625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:01.716601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.717726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.718429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:01.719431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:01.723085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:01.723765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:02.012788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:02.042708 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7180071-a973-4f77-b0f2-179a13d51069 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1313 microversion: 2.1 time: 0.411968 Sep 23 04:00:02.048989 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2210/4530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:01 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:02.118243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:02.136028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db8cd20e-5732-49c9-9ab0-9ea9b8cba990 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.440030 Sep 23 04:00:02.138495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2321/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:01 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:02.553706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:02.554332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:02.568175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:02.568692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:02.569141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:02.569918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:02.570370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:02.576117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:02.819053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:02.833606 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2d776d8-f55f-4c9c-8ecc-f119394ab239 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.285012 Sep 23 04:00:02.845525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2211/4532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:02 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:03.078705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:03.080660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:03.137522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.138174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.138657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.150129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.150632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.151248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.166574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:03.167921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:03.179250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.181708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.185007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.186293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.189798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.190826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.565144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:03.573804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66898f54-2919-4c86-90f6-993842507b80 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1499 microversion: 2.1 time: 0.505195 Sep 23 04:00:03.588853 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2322/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:03 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1499 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:03.612264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:03.616595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:03.617712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:03.629144 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a53165d-ff9b-4596-b414-f740f3420c45 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.465341 Sep 23 04:00:03.630813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.632763 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2212/4534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:03 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:03.634807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.635285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.636021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.636844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.637588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.698386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'flavor' on Instance uuid a9b54d47-6d20-4d24-b5a0-8c71a7322707 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:00:03.843730 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d702d60b-fb8d-4e5f-b23b-1255cfc37526 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "POST /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707/action" status: 202 len: 0 microversion: 2.1 time: 0.230218 Sep 23 04:00:03.855699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:03.857107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:03.863872 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2323/4535] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:00:03 2022] POST /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:00:03.869114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.876611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.879670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:03.881787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.882939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.884478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:03.887299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.891219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.901740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.911468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.912350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:03.913253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:03.913988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:03.914598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:04.361267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:04.370337 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52279940-2a67-4438-9352-cc7afbf4ee4c tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1507 microversion: 2.1 time: 0.519478 Sep 23 04:00:04.376773 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2213/4536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:03 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:04.487937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:04.500260 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-44f30e6b-9308-4904-83b5-1c3a3d07370f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.634434 Sep 23 04:00:04.503628 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2324/4537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:03 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:04.655403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:04.656017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:04.659810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70d54db-21cd-4c0c-ab41-2a7828f6ea3b", "name": "network-vif-plugged", "status": "completed", "tag": "543bd5ff-e768-44be-b1da-6f15bf6e8547"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:04.673255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:04.676484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:04.680133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:04.680626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:04.681063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:04.681445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:04.683300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:04.687990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:04.706566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] Creating event network-vif-plugged:543bd5ff-e768-44be-b1da-6f15bf6e8547 for instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b on n-h2-858495-2 Sep 23 04:00:04.714005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:04.714504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-002ba04b-5717-48c3-a501-6940fda5f782 req-25129977-056c-413a-a105-19be3eab0fc5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057957 Sep 23 04:00:04.715580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2325/4538] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:05.290297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:05.305280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c87ccd36-5e14-4a7a-83fd-f8ee842bf661 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.654113 Sep 23 04:00:05.306327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2214/4539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:04 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:05.411081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:05.412386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:05.419214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.419788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.420660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:05.421594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.422914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.423586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:05.528932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:05.529593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:05.538529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.539024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.539675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:05.540573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.541205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.541874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:05.895631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:05.910690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90e83415-9e46-4cc3-9f84-31c61f4b22b8 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1490 microversion: 2.1 time: 0.507057 Sep 23 04:00:05.911848 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2326/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:05 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1490 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:05.940166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:05.941928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:05.942430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:05.951161 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a2b40732-32cd-42c8-94ac-210d2b7b254c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.426770 Sep 23 04:00:05.957412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.958292 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2215/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:05 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:05.959638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.960094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:05.960833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:05.961290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:05.961822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:06.061343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:00:06.217670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:06.218398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:06.240124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:06.240660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:06.242140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:06.242904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:06.243387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:06.243828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:06.279281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13a1c0f3-9ac0-472d-9065-d6b557233ef3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 204 len: 0 microversion: 2.1 time: 0.337543 Sep 23 04:00:06.281892 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2327/4542] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:05 2022] DELETE /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:00:06.324155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:06.325301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:06.335964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:06.338175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:06.345846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:06.348225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:06.350395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:06.351110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.054366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.060645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.066724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51240f7a-3e6a-4a46-8c87-6b4b174f276b tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1496 microversion: 2.1 time: 0.778397 Sep 23 04:00:07.071412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.073434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.075002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7898e893-2c3e-4f25-a054-d642b0983ef8 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2953 microversion: 2.42 time: 0.863312 Sep 23 04:00:07.075893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2216/4543] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:00:06 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2953 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:00:07.081613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:07.082548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:07.084801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2328/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:06 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1496 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:07.089782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.090814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.091705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.093254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.093970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.094695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.100553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:07.102158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:07.111961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.112740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.113829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.115388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.117059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.117710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.487448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.506127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:07.509493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-652b9588-aa28-44ef-bc17-1807ae8becbd tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1367 microversion: 2.1 time: 0.430912 Sep 23 04:00:07.510716 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2217/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:07 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:07.527210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:07.533992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:07.536490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f084b6a-1f77-4547-9ae3-884c36e7c0c5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.448488 Sep 23 04:00:07.537447 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2329/4546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:07 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:07.545101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:07.548631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.549748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.550853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.552026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:07.552769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:07.553596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:07.574650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:07.907883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0c60a7f-2324-4c42-b3b1-f8b10977336c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.393820 Sep 23 04:00:07.908682 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2218/4547] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 04:00:07 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a/os-interface => generated 1830 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:00:08.096419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:08.097867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:08.105724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.106564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.107228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:08.110154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.111434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.112598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:08.532789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:08.534053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:08.548474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.549268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.551109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:08.552381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.552871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.553331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:08.840300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:08.849865 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66e9f4b2-b652-4884-a051-93b1fefe4f2f tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1496 microversion: 2.1 time: 0.758501 Sep 23 04:00:08.851222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2330/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:08 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1496 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:08.856243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:08.857040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:08.863312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.864299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.864932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:08.865915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:08.866576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:08.867220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:09.209991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:09.220500 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f220131b-10f2-43f2-8f46-403dd301a923 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1555 microversion: 2.1 time: 0.691679 Sep 23 04:00:09.221302 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2219/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:08 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1555 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:09.250387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:09.251752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:09.259722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:09.260670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:09.261294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:09.262682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:09.263670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:09.264215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:09.592221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:09.603441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-427039f9-8346-40dc-a2ef-a7d7fbd04a9b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.751027 Sep 23 04:00:09.604612 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2331/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:08 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:09.617590 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-64c60002-2df8-418e-b4b0-bea0694d4754 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360934 Sep 23 04:00:09.619769 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2220/4551] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:00:09 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:00:09.881257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:09.882666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:09.886188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:09.893927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:09.894711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:09.895361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:09.896309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:09.897084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:09.897760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:10.628963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:10.638528 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa637bb7-75f1-45a3-85a8-c7c3a1933dc1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1454 microversion: 2.1 time: 0.763723 Sep 23 04:00:10.660344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:10.661481 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2332/4552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:09 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1454 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:10.662856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:10.679443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:10.682806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:10.683743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:10.684717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:10.687073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:10.688991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:11.086752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b54d47-6d20-4d24-b5a0-8c71a7322707", "name": "network-vif-deleted", "tag": "ec2d3965-e37a-41b9-9700-5e33b4b031b6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:11.109846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:11.111327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:11.112360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:11.116741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:11.147970 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] Creating event network-vif-deleted:ec2d3965-e37a-41b9-9700-5e33b4b031b6 for instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 on n-h2-858495-2 Sep 23 04:00:11.164330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7f7d4544-a715-42a9-8df8-bcc5e07b3859 req-99a0e337-2736-4eaa-a958-f70c1a6908b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081703 Sep 23 04:00:11.169071 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2333/4553] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:11.656799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:11.671096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:11.671885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:11.674115 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2456427c-d0b8-4573-8efe-845cf5a062b5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 1.025816 Sep 23 04:00:11.689236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2221/4554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:10 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:11.692975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:11.695810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:11.696530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:11.699000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:11.700543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:11.701180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:11.769628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:11.770367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:11.770960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:11.771640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lazy-loading 'fault' on Instance uuid a9b54d47-6d20-4d24-b5a0-8c71a7322707 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:00:11.884299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0822d3170afd48aca442be6a5d11a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9828a782284736b26b844a9b4d500b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:11.907683 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b685a66-827e-40d5-a526-aff09d9fdb55 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 200 len: 1303 microversion: 2.1 time: 0.241024 Sep 23 04:00:11.912579 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2334/4555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:11 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:12.702702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:12.704718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:12.713612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:12.714111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:12.714561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:12.715283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:12.715808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:12.716164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:12.966472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:12.969155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.001064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.012249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.013516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.015285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.015781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.016257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.034836 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 HTTP/1.1 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a9b54d47-6d20-4d24-b5a0-8c71a7322707'} Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.036777 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.041707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.043448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.044650 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-afe7cc54-166d-4bf8-add5-db30039fb2b1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 404 len: 111 microversion: 2.1 time: 0.102826 Sep 23 04:00:13.045823 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2335/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:12 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.061897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.063906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.073309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.074228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.074914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.075960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.076690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.077458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.096387 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 HTTP/1.1 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a9b54d47-6d20-4d24-b5a0-8c71a7322707'} Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.098538 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.102340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.106717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.107935 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-85f7df75-3699-4dfc-9346-2becd4f504b3 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 404 len: 111 microversion: 2.1 time: 0.051888 Sep 23 04:00:13.109076 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2336/4557] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:13 2022] DELETE /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.121424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.122505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: a9b54d47-6d20-4d24-b5a0-8c71a7322707] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.130800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.131695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.132400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.133398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.134608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.135532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.159231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 HTTP/1.1 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a9b54d47-6d20-4d24-b5a0-8c71a7322707'} Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.161895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. Sep 23 04:00:13.166643 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.167326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance a9b54d47-6d20-4d24-b5a0-8c71a7322707 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.168808 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b09ef9f1-d45a-4b0b-be3a-911fb8fdad4e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707" status: 404 len: 111 microversion: 2.1 time: 0.053309 Sep 23 04:00:13.170009 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2337/4558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:13 2022] GET /compute/v2.1/servers/a9b54d47-6d20-4d24-b5a0-8c71a7322707 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.179521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.180409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.188702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.189502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.190189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.191148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.191832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.192572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.204087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:13.213506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7de60989-21f8-4fa2-81e7-3ec7e36079d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.514692 Sep 23 04:00:13.218508 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2222/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:12 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:13.236566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 HTTP/1.1 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '776a2a5b-5bd6-4c57-ac7b-627d9091bab6'} Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.239186 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5d36b31b-f7c7-4ac7-8edd-3ac7c1aff229 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 404 len: 111 microversion: 2.1 time: 0.065688 Sep 23 04:00:13.243069 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2338/4560] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:13 2022] DELETE /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.252220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.253041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 776a2a5b-5bd6-4c57-ac7b-627d9091bab6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.263627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.264408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.264589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.265402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.265780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.266798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.307564 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 HTTP/1.1 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '776a2a5b-5bd6-4c57-ac7b-627d9091bab6'} Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.309294 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 776a2a5b-5bd6-4c57-ac7b-627d9091bab6 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11be2b4c-f0ef-439f-90e0-2c925118f4a4 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6" status: 404 len: 111 microversion: 2.1 time: 0.064679 Sep 23 04:00:13.314098 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2223/4561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:13 2022] GET /compute/v2.1/servers/776a2a5b-5bd6-4c57-ac7b-627d9091bab6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.320855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.320855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.331024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.331529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.331972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.340514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.341142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.341623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.374624 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef HTTP/1.1 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e346b663-e628-4790-b102-70ead520bcef'} Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.377015 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.382625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.385101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.386496 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0324cb80-1af9-48c4-8930-fe31bea6b682 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 404 len: 111 microversion: 2.1 time: 0.069924 Sep 23 04:00:13.387451 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2339/4562] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:13 2022] DELETE /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:00:13.397104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.398080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e346b663-e628-4790-b102-70ead520bcef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.407374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.408177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.408960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.410324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.411274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.411928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.428526 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef HTTP/1.1 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e346b663-e628-4790-b102-70ead520bcef'} Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.430434 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. Sep 23 04:00:13.434263 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.436298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e346b663-e628-4790-b102-70ead520bcef could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.437503 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fca63f69-75e6-40fa-b2e2-9317f6cc6c24 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef" status: 404 len: 111 microversion: 2.1 time: 0.044715 Sep 23 04:00:13.438781 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2224/4563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:13 2022] GET /compute/v2.1/servers/e346b663-e628-4790-b102-70ead520bcef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.448064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.448978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.456323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.457192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.458385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.459398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.460092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.460738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.480579 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 HTTP/1.1 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '04f3afb5-28e2-4e6f-b52a-13f884b4fab8'} Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.482534 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.486910 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.489612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.490792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05ab0d76-0b6d-4537-931e-b92916b76b6e tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 404 len: 111 microversion: 2.1 time: 0.048002 Sep 23 04:00:13.492117 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2340/4564] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:13 2022] DELETE /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:00:13.500890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.501980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 04f3afb5-28e2-4e6f-b52a-13f884b4fab8] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.514489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.515411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.516150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.517181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:13.519984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:13.520798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:13.563318 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 HTTP/1.1 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '04f3afb5-28e2-4e6f-b52a-13f884b4fab8'} Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.564951 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 04f3afb5-28e2-4e6f-b52a-13f884b4fab8 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b19dcc50-9f24-413a-b4d8-30dac8187654 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8" status: 404 len: 111 microversion: 2.1 time: 0.070041 Sep 23 04:00:13.568856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2225/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:13 2022] GET /compute/v2.1/servers/04f3afb5-28e2-4e6f-b52a-13f884b4fab8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.578010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.579431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.585834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 HTTP/1.1 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24'} Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.588010 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.592669 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.596222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.597424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bcd3651e-b7cd-4b84-8a72-744f5ab241b7 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24" status: 404 len: 111 microversion: 2.1 time: 0.023302 Sep 23 04:00:13.598580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2341/4566] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:13 2022] DELETE /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:13.606656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:13.607671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:13.614636 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 HTTP/1.1 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24'} Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:13.616704 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:13.620786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:13.620786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:13.620786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:13.620786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. Sep 23 04:00:13.620786 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:13.623161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:13.624611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-00f1590a-cfb4-46ec-a826-a932f39811f1 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24" status: 404 len: 111 microversion: 2.1 time: 0.022076 Sep 23 04:00:13.625998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2226/4567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:13 2022] GET /compute/v2.1/servers/6f3f6f64-0aa3-49f9-a4e4-34ad14c8ac24 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:14.242916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:14.243672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:14.284973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:14.285707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:14.286350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:14.288719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:14.299077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:14.299803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:14.409096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70d54db-21cd-4c0c-ab41-2a7828f6ea3b", "tag": "543bd5ff-e768-44be-b1da-6f15bf6e8547"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:14.444696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:14.445540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:14.446107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:14.485071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] Creating event network-changed:543bd5ff-e768-44be-b1da-6f15bf6e8547 for instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b on n-h2-858495-2 Sep 23 04:00:14.509664 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9fa3e5ac-376d-4058-b41a-c5791be12373 req-375d21b9-401e-47a3-bf5e-f73274186b5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105977 Sep 23 04:00:14.514131 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2227/4568] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:15.372507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:15.388936 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98949161-1e18-435b-a9e6-346f1a30ce0c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 1.150097 Sep 23 04:00:15.389916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2342/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:14 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:16.428053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:16.428759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:16.452067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:16.464147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:16.474396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:16.475412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:16.476801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:16.481941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:16.839388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:16.850257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45f145f3-1ea0-4c12-b08a-1b10b4107d03 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.426760 Sep 23 04:00:16.855779 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2228/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:16 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:17.888632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:17.889955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:17.905839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:17.909901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:17.910920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:17.915891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:17.916757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:17.917393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:18.739047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:18.750959 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b0b8e94-1596-4df4-a1e1-ed47900034ab tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.868680 Sep 23 04:00:18.751562 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2343/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:17 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:19.778477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:19.779199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:19.791480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:19.792336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:19.795312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:19.796296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:19.796870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:19.799555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.299047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:20.308009 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-651c87df-2a92-4da6-8ce0-1407d0e6e565 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.533839 Sep 23 04:00:20.312553 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2229/4572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:19 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:20.603273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:20.604356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:20.616553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.622113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.622576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.623318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.626333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.626852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.657771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 HTTP/1.1 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '31157afe-3d76-47fd-9f14-5c5e00300c76'} Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:20.663897 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.668646 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.671424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:20.679098 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfa7bc3f-b998-431e-b823-c5c0047b5aef tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 404 len: 111 microversion: 2.1 time: 0.080299 Sep 23 04:00:20.680248 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2344/4573] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:20 2022] DELETE /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:20.688648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:20.689597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: 31157afe-3d76-47fd-9f14-5c5e00300c76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:20.702382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.703233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.703868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.704789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.710135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.716461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.771369 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 HTTP/1.1 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '31157afe-3d76-47fd-9f14-5c5e00300c76'} Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.773107 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance 31157afe-3d76-47fd-9f14-5c5e00300c76 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:20.779740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-958a7136-9e72-45b2-8811-90a4d66b3441 tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76" status: 404 len: 111 microversion: 2.1 time: 0.093965 Sep 23 04:00:20.787844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:20.788339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:20.793519 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2230/4574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:20 2022] GET /compute/v2.1/servers/31157afe-3d76-47fd-9f14-5c5e00300c76 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:20.794757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.795247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.795685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.796394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.796850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.814161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.847193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 HTTP/1.1 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e8f85146-3106-49a6-a33d-8eafd3d758f4'} Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:20.848771 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-859dc873-76eb-48fa-8902-8bb829dbffee tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 404 len: 111 microversion: 2.1 time: 0.066220 Sep 23 04:00:20.854065 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2345/4575] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:00:20 2022] DELETE /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:20.858752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:20.859674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] [instance: e8f85146-3106-49a6-a33d-8eafd3d758f4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:20.868662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.884729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.885513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.886443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:20.887121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:20.887714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:20.919312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] HTTP exception thrown: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Request method failure captured: Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 HTTP/1.1 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS4P0yhDQoGPK-eHnfGTOSOl3JLyJ7hfSH-vRppK6JZsxPuj3O6nRTroQNrV6hX94ljgFVRNkmE51xsJYOLygjN0hJX638FwPlB1E60vFCWJBBSpbVenGHpf1lZKq-CuYmT3EWQBOQ5pppefNEUsk3lTRqDeqMTEQMYWlHIBCvBs_Wo Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9828a782284736b26b844a9b4d500b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9828a782284736b26b844a9b4d500b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4b9828a782284736b26b844a9b4d500b Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-744347323 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0822d3170afd48aca442be6a5d11a5d3 Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-744347323-project Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e8f85146-3106-49a6-a33d-8eafd3d758f4'} Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:00:20.922766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. Sep 23 04:00:20.926750 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:00:20.929682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] Returning 404 to user: Instance e8f85146-3106-49a6-a33d-8eafd3d758f4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:00:20.935943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-59f02a51-2b23-4848-a9c9-8eb8efbdd3eb tempest-DeleteServersTestJSON-744347323 tempest-DeleteServersTestJSON-744347323-project] 10.222.0.25 "GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4" status: 404 len: 111 microversion: 2.1 time: 0.080888 Sep 23 04:00:20.937070 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2231/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:20 2022] GET /compute/v2.1/servers/e8f85146-3106-49a6-a33d-8eafd3d758f4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:00:21.344806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:21.345446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:21.363747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:21.364245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:21.364679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:21.371928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:21.383129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:21.384676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:21.984561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:22.017062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-744436a4-c1e8-40f0-9fa2-c9d5da6e0d97 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1531 microversion: 2.1 time: 0.677106 Sep 23 04:00:22.020697 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2346/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:21 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1531 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:23.055064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:23.055568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:23.074956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:23.079157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:23.082188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:23.085824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:23.088496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:23.091604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:23.486275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:23.494840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e3f1503-ab0a-4c3f-aa46-c22c7fb6075e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1531 microversion: 2.1 time: 0.445013 Sep 23 04:00:23.496078 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2232/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:23 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1531 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:24.520841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:24.522198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:24.529052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:24.550220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:24.550683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:24.551516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:24.551986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:24.552418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:25.381174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:25.389831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4fcabdea-40fd-4c72-aaa0-316d51c5245f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.872783 Sep 23 04:00:25.397576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2347/4579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:24 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:26.423408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:26.424028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:26.443303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:26.444251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:26.444903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:26.446077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:26.449650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:26.450453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:27.096893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:27.110184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3f8b1fe-c218-4c15-8432-c8bdbd35ec60 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.690660 Sep 23 04:00:27.113715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2233/4580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:28.147861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:28.149098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:28.165622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.166124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:28.166570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:28.167323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.167791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:28.168287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:28.391253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:28.393268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:28.437335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.451955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:28.452411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:28.478148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.478789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:28.479256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:28.554679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:28.579900 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f646d4e0-02ef-4330-9ffc-da8b4cc5a820 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.441225 Sep 23 04:00:28.581710 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2348/4581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:28 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:28.924013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:28.946146 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-013660f3-7924-49a5-80a2-d26f4ddbe5c7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.558311 Sep 23 04:00:28.948060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2234/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:28 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:28.975565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:28.976393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:28.988730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.989767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:28.990726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:28.991700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:28.998989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.001321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.250287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:29.262368 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6034b34-aa82-4c85-9765-b6d33796ff3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.290843 Sep 23 04:00:29.264697 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2349/4583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:28 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:29.286509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:29.287180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:29.293872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.294386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.294839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.295565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.303671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.304432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.625649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:29.626275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:29.644850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.647636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:29.654344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.654799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.656547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.659628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.662059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.664875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3d6375a9-ff0b-48dd-a8a9-699c46ef38d0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.382180 Sep 23 04:00:29.682187 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2235/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:29 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:29.695244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:29.695886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:29.716541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.717056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.717544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:29.718281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:29.737022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:29.737542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:30.318525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:30.343065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f298d75-2584-415c-b163-9db22ae0c2a5 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.723270 Sep 23 04:00:30.363934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2350/4585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:29 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:30.478350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:30.502695 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4cfbb70-dc6e-487e-bae3-60f0afb401c9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.809438 Sep 23 04:00:30.505375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2236/4586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:29 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:30.832153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1996401542", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "035b98c4-22a0-4a66-81a1-f3cedd6f6f67"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:30.942852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "name": "network-vif-plugged", "status": "completed", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:31.010824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:31.011526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:31.011981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:31.022284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] validate_networks() for [('035b98c4-22a0-4a66-81a1-f3cedd6f6f67', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:00:31.044909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] Creating event network-vif-plugged:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h1-858495-2 Sep 23 04:00:31.068847 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a2b57dcc-d121-46d0-ba97-29d8fc45ca00 req-76c1064f-4bc6-4df8-8387-134f66d91671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138628 Sep 23 04:00:31.085016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2237/4587] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 04:00:31.370113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:31.371026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:31.395227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:31.395728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:31.401717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:31.405298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:31.420009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:31.421067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:32.394503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:32.404458 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e41b54d-eaf5-4fc2-bb0e-83f533ae95e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 1.039218 Sep 23 04:00:32.408397 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2238/4588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:31 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:32.950625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:00:32.951806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:00:32.952481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:00:32.953468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:00:32.954060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:00:32.979615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:32.980398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:32.980845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:32.984969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:32.987842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:32.990190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:33.044035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:00:33.056424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:00:33.109139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:00:33.112128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:00:33.305783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0aeda0a1-62c2-4e96-84c6-0a9723450d41 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477947 Sep 23 04:00:33.306458 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2351/4589] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:00:33.319299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-662385ca-5c02-4615-a5cb-af5186cb885b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:33.320453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-662385ca-5c02-4615-a5cb-af5186cb885b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:33.440001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:33.440688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:33.455255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:33.477586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:33.478220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:33.479015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:33.479477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:33.479913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:33.794356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-662385ca-5c02-4615-a5cb-af5186cb885b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:33.807818 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-662385ca-5c02-4615-a5cb-af5186cb885b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1215 microversion: 2.1 time: 0.492011 Sep 23 04:00:33.809983 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2239/4590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:33 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:34.798312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-101ff804-c05a-4c56-89ee-fb04c0707f70 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-904749386", "availability_zone": "foo_zone"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:34.803026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.aggregate [None req-101ff804-c05a-4c56-89ee-fb04c0707f70 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Generated uuid 7efa0d6b-504b-4c73-965b-bfdbbb8f9f60 for aggregate {{(pid=128723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:00:34.904108 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-101ff804-c05a-4c56-89ee-fb04c0707f70 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.783625 Sep 23 04:00:34.905150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2240/4591] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Sep 23 04:00:34 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:34.917154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:34.919742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:34.943514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:34.944313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:34.946140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:34.947085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:34.948383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:34.950079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:35.409786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:35.436839 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f7169cd-dd6b-4545-8ed5-ce7296c80188 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1211 microversion: 2.1 time: 0.529785 Sep 23 04:00:35.443398 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2241/4592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:34 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1211 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:35.459632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3207d159-0050-4433-9227-0a72cbe802fd tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:35.544084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3207d159-0050-4433-9227-0a72cbe802fd tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.099214 Sep 23 04:00:35.551715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2242/4593] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 04:00:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:35.575456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:35.591558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:35.597828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:35.599266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:35.606962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:35.607668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:35.608137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:35.747863 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c56fbf5e-b091-4f6c-b07b-cb5272938659 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.189793 Sep 23 04:00:35.753058 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2243/4594] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Sep 23 04:00:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:35.768584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4c27c1a4-292f-4bb8-9ba9-24658a5eb54b tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:35.794942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4c27c1a4-292f-4bb8-9ba9-24658a5eb54b tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.036147 Sep 23 04:00:35.798355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2244/4595] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Sep 23 04:00:35 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:35.809392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eaa9e169-b942-4206-b925-62f3c18f9c43 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:35.835303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaa9e169-b942-4206-b925-62f3c18f9c43 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:35.836110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaa9e169-b942-4206-b925-62f3c18f9c43 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:35.836752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eaa9e169-b942-4206-b925-62f3c18f9c43 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:35.914127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:35.941926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd89b77a-c129-46bc-a611-1ed3f30b0817 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 2.509270 Sep 23 04:00:35.943206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2352/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:33 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:36.471761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:36.472395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:36.506622 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eaa9e169-b942-4206-b925-62f3c18f9c43 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.701322 Sep 23 04:00:36.510466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2245/4597] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 04:00:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:00:36.513666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:36.535879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:36.538255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:36.539622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:36.540113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:36.545767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:36.548099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf65fe7d-a9b5-4143-a850-0ed5f26a1198 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:36.578212 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf65fe7d-a9b5-4143-a850-0ed5f26a1198 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.058424 Sep 23 04:00:36.581595 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2246/4598] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:00:36 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:36.592970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63ab6d95-8116-4c0e-a545-97b1ace9f789 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1798528987", "availability_zone": "foo_zone"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:36.743449 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63ab6d95-8116-4c0e-a545-97b1ace9f789 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.154273 Sep 23 04:00:36.758713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2247/4599] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 04:00:36 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:00:36.779298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1cdee14-f0e6-42d8-a778-41b5ed28f96d tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:36.887650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:36.896061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1cdee14-f0e6-42d8-a778-41b5ed28f96d tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.132826 Sep 23 04:00:36.899108 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2248/4600] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 04:00:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:36.904326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dfd432ad-52f8-4077-ba2e-bd2b226a8a60 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1273 microversion: 2.1 time: 0.433700 Sep 23 04:00:36.905263 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2353/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:36 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1273 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:36.928728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3b401bf0-93a3-4609-95b3-b85ad2c7a506 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:36.970896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:36.972131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:36.975195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3b401bf0-93a3-4609-95b3-b85ad2c7a506 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.060636 Sep 23 04:00:36.982412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:36.986865 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2249/4602] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:00:36 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:36.987929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:36.988586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:36.989722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:36.990351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:36.992106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:37.016744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c30b700-7755-4feb-9bbb-edef28af3d49 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858495-2"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:37.065580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c30b700-7755-4feb-9bbb-edef28af3d49 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:37.075765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c30b700-7755-4feb-9bbb-edef28af3d49 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:37.077018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c30b700-7755-4feb-9bbb-edef28af3d49 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:37.110015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:37.143841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:37.418380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c30b700-7755-4feb-9bbb-edef28af3d49 tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.423249 Sep 23 04:00:37.425146 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2250/4603] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Sep 23 04:00:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:37.433409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6a968be-9230-4733-b7d6-37b6890d0b3f tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:37.521780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6a968be-9230-4733-b7d6-37b6890d0b3f tempest-TestAggregatesBasicOps-417163305 tempest-TestAggregatesBasicOps-417163305-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.091649 Sep 23 04:00:37.522621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2251/4604] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 04:00:37 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:00:37.929604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:37.931303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:37.945424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:37.946583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:37.948748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:37.949874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:37.951132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:37.951965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:37.952561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:37.969617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16caeb7d-0c71-45f2-8add-3eec4f0afaa0 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1530 microversion: 2.1 time: 1.001759 Sep 23 04:00:37.972425 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2354/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:36 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1530 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:38.643495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:38.659427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a74d9648-4157-4cf8-afb0-723f30d3fa51 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.734986 Sep 23 04:00:38.660103 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2252/4606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:37 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:38.996306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:39.000951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:39.016474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:39.017311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:39.017970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:39.018880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:39.019596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:39.020219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:39.599895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:39.618394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2090265b-5310-4fc8-ba4f-c21efc42c25d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.625965 Sep 23 04:00:39.626381 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2355/4607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:38 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:39.689865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:39.691440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:39.717713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:39.721689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:39.722897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:39.728747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:39.734068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:39.734887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:40.136641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-242494075", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "d500b51c-2328-40e1-ad2d-1fee96574523"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:40.264113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] validate_networks() for [('d500b51c-2328-40e1-ad2d-1fee96574523', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:00:40.344939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:40.362627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7007cc11-30e7-45a0-944d-5e8eeeb50e34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.679622 Sep 23 04:00:40.371426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2356/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:39 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:40.648330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:40.649232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:40.651624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:40.669665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:40.671864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:40.681820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:40.683169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:40.683827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:40.684629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:40.693427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:41.468495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:41.486601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6be4c845-09a4-4a4c-af6e-6ca936c783e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.834661 Sep 23 04:00:41.489817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2357/4609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:40 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:41.508583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:41.511012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:41.544663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:41.549840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:41.550634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:41.552334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:41.555454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:41.560976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:42.429504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:42.439076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2abab358-ea09-4831-a231-846c8b1cd1ad tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.945844 Sep 23 04:00:42.457386 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2358/4610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:41 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:42.519100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:42.520637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:42.547667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:42.552027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:42.552027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:42.558535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:42.559075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:42.559614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:42.937587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:42.950540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf134712-ec9a-4a17-93d9-4ad623ba1441 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.435937 Sep 23 04:00:42.966997 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2359/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:42 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:43.003557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:00:43.004086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:00:43.004466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:00:43.004885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:00:43.005298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:00:43.027508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.027998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:43.028669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:43.029757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.035553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:43.036303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:43.082826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Getting quotas for project d4dc59d9c7894ade8139c864215f286d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:00:43.096904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Getting quotas for user 88738208419c44b69f226db39051c8bf and project d4dc59d9c7894ade8139c864215f286d. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:00:43.143239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:00:43.146300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:00:43.174660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c4b7cd-b822-464e-8113-b62c712f741c", "tag": "47075061-f5f5-4fc8-8293-56438a5d995b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:43.183879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:43.192458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:43.222688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.226376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:43.226843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:43.290946 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] Creating event network-changed:47075061-f5f5-4fc8-8293-56438a5d995b for instance d1c4b7cd-b822-464e-8113-b62c712f741c on n-h2-858495-2 Sep 23 04:00:43.320560 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-30f2d936-8cf0-4ebb-ba98-99f593cffacb req-2468aad9-bb52-448b-b281-1b4c76a6e92e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150928 Sep 23 04:00:43.329519 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2360/4612] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:43.339316 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae15031f-9315-4042-a97e-a84d05ee46d3 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.100088 Sep 23 04:00:43.349270 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2253/4613] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:00:43.362433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d70eb843-8836-4966-b5ef-075e895ce175 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:43.363936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d70eb843-8836-4966-b5ef-075e895ce175 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:43.472738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:43.473663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:43.498756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.499579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:43.501752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:43.502887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.504479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:43.506434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:43.657413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d70eb843-8836-4966-b5ef-075e895ce175 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:43.667551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d70eb843-8836-4966-b5ef-075e895ce175 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1227 microversion: 2.1 time: 0.310827 Sep 23 04:00:43.680669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2361/4614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:43 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1227 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:43.978645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:43.980333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:43.991355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:43.997843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:44.000432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:44.001468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:44.005335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:44.008970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:45.251873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:45.265895 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7da2bca7-99b2-448c-9f9f-cdd093c5719c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 1.797855 Sep 23 04:00:45.269819 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2254/4615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:43 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:45.279338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:45.283841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:45.302409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:45.303170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:45.304056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:45.308292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:45.309152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:45.309794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:45.852367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:45.865955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e31857d6-0e13-4aa8-9904-25338fbe516d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1279 microversion: 2.1 time: 0.594472 Sep 23 04:00:45.905381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2255/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:45 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1279 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:46.134002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:46.153529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38442e98-4694-4425-98c3-d05251dbfeaf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 2.179410 Sep 23 04:00:46.156934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2362/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:43 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:46.294038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:46.294932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:46.312981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:46.314435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:46.317157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:46.319111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:46.319630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:46.320076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:46.919657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:46.920283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:46.941813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:46.942502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:46.943138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:46.944418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:46.945780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:46.947342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:47.246706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:47.255380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2011cdb5-f319-417e-98c1-2609cd3656bf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.967405 Sep 23 04:00:47.264543 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2256/4618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:46 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:47.278970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:47.282215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:47.319960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:47.320527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:47.320813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:47.321598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:47.322074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:47.322517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:47.368732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:47.382925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8ea869b2-a98c-4ad2-b08c-b516a31ecca8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1285 microversion: 2.1 time: 0.468354 Sep 23 04:00:47.383526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2363/4619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:46 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1285 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:48.284281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:48.285202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:48.299135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:48.300700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:48.302115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:48.310013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:48.311327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:48.312758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:48.637389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:48.663368 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26d8dbd0-b740-4567-89c5-bade93af9b88 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 1.397465 Sep 23 04:00:48.663977 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2257/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:47 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:48.679770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:48.687346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:48.703401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:48.703902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:48.704532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:48.705334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:48.706168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:48.706806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:49.131811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:49.141632 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b0be93d-a3c6-4576-95bd-68711cf76eee tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1285 microversion: 2.1 time: 0.476308 Sep 23 04:00:49.153859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2258/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:48 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1285 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:49.178923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:49.224184 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7eff7eac-5fdb-4332-bbe3-dc23cfb141b6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.925568 Sep 23 04:00:49.225980 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2364/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:48 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:49.699677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:49.700315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:49.726299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:49.726880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:49.727531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:49.728495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:49.729175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:49.729937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:50.177093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:50.179162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:50.193165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:50.200162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:50.205074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:50.206392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:50.210267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:50.212279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:51.293852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:51.321240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23d6ee8e-6539-4f7f-b347-99cf1ea57809 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 1.628098 Sep 23 04:00:51.322734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2259/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:49 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:51.344442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:51.346270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:51.370024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:51.370770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:51.371765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:51.372639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:51.380506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:51.382311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:51.751583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:51.760608 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b83a8b76-a352-471a-b4f5-9d96c048d6c2 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 1.590233 Sep 23 04:00:51.780306 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2365/4624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:50 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:52.359468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:52.360483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:52.378999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:52.379769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:52.380423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:52.381316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:52.381995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:52.382596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:52.414038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:52.429640 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22e7df97-27bc-4d54-8630-5f98336acf99 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 1.105033 Sep 23 04:00:52.433027 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2260/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:51 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:52.794367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:52.796687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:52.825120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:52.833201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:52.834204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:52.835001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:52.835494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:52.835939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:53.064738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:53.136329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:53.666349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:00:53.727175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:53.741390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:53.761256 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8af3cdf-0616-4878-9875-2695a58b24fe tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 1.415441 Sep 23 04:00:53.767489 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2366/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:52 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:53.769023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83de1cb3-42f5-4013-a793-3f90d2832a48 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.984695 Sep 23 04:00:53.789385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2261/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:52 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:53.830691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:53.835959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:53.857511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:53.861926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:53.869806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:53.872779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:53.873876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:53.875558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:54.773909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:54.796150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f69db578-f255-4fb6-a6e5-257ff995b917 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 1.023577 Sep 23 04:00:54.797014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2367/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:53 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:54.816798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:54.818516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:54.828937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:54.829833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:54.833466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:54.833676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:54.834659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:54.834816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:54.835446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:54.837979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:54.851573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:54.852080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:54.852723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:54.853650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:54.854273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:54.858535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:55.327717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:55.342382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-faa7c3c1-ce05-4d61-8cae-b6c450f951bc tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.550713 Sep 23 04:00:55.352067 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2262/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:54 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:55.374458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b47ed4-25e1-4db1-a264-0fdf4fc95870", "tag": "636cfb70-2649-4fbd-ac1b-687831772c33"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:55.404712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:55.407138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:55.407933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:55.440825 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] Creating event network-changed:636cfb70-2649-4fbd-ac1b-687831772c33 for instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 on n-h1-858495-2 Sep 23 04:00:55.450712 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d208997a-2636-4370-a11f-10ba1a8797c1 req-cc59acc3-9f1a-48f9-97b1-8ee5a9bc36db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095949 Sep 23 04:00:55.456056 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2263/4630] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:55.509747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:55.539903 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17a5ba64-1e33-47f6-be39-69c04811c766 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.718633 Sep 23 04:00:55.541105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2368/4631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:54 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:55.778817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c4b7cd-b822-464e-8113-b62c712f741c", "name": "network-vif-plugged", "status": "completed", "tag": "47075061-f5f5-4fc8-8293-56438a5d995b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:55.816319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:55.823741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:55.824521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:55.825535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:55.832479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:55.839448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:55.839448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:55.841760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:55.854036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:55.854897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:55.860622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:55.900052 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] Creating event network-vif-plugged:47075061-f5f5-4fc8-8293-56438a5d995b for instance d1c4b7cd-b822-464e-8113-b62c712f741c on n-h2-858495-2 Sep 23 04:00:55.923513 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c1d6d09e-6de7-4498-9aab-ebd92689488c req-f9d4b371-6673-4767-90a5-3e82a90725b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150885 Sep 23 04:00:55.925176 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2264/4632] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:00:56.374805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:56.375815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:56.399045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:56.399891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:56.400519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:56.401732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:56.404135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:56.422408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:56.424648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:56.430842 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42c7ea35-2fe4-4902-9797-9b914c1a2b57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.610991 Sep 23 04:00:56.435760 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2369/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:55 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:56.568849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:56.569763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:56.576272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:56.577014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:56.577690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:56.578733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:56.579525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:56.580125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:56.674281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:56.685338 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6846526-74fb-49cd-85ca-41edfe5e0007 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.317376 Sep 23 04:00:56.687483 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2265/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:56 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:56.756783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:56.769116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65d41703-34ea-4e31-b22b-28eb26895934 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.203386 Sep 23 04:00:56.785462 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2370/4635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:56 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:57.460851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:57.462729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:57.484318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.486124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.486816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:57.487899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.488549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.489150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:57.708582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:57.710053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:57.720565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.725855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.726515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:57.727555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.728224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.728667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:57.882263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:57.891525 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-beb80a49-7f88-4271-b263-c353d73515b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1315 microversion: 2.1 time: 0.435656 Sep 23 04:00:57.906242 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2266/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:57 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:57.915832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:57.924541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:57.933908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.936390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.937598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:57.938647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:57.940729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:57.941689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:58.178770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:58.194267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:58.197457 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de3bad3b-67ac-49c6-976d-842f65a2b50d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1526 microversion: 2.1 time: 0.482780 Sep 23 04:00:58.198182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2371/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:57 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1526 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:58.208786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0bbd81e1-de85-4ad2-9413-fb0d17975ada tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.297968 Sep 23 04:00:58.210985 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2267/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:57 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:58.917073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:58.918329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:58.925717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:58.926214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:58.927276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:58.927997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:58.928458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:58.928887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.177544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:59.192210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-260679f5-8319-4811-88da-afa5f6db6fc3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1502 microversion: 2.1 time: 0.278672 Sep 23 04:00:59.197727 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2372/4639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:58 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:00:59.225879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:59.227334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:59.230936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:00:59.231712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:59.245293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.246240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.247212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.248542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.249236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.249923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.260130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.260261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.265534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.265926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.266628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.266923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.691766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Removing security group bd01b51e-3ff9-4447-9de9-59533d67c068 from port 47075061-f5f5-4fc8-8293-56438a5d995b Sep 23 04:00:59.724031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:00:59.739134 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-27788c8f-60ea-49c3-b84a-612a505c6105 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1508 microversion: 2.1 time: 0.519131 Sep 23 04:00:59.743205 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2268/4640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:59 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1508 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:00:59.755626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:00:59.759069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:00:59.772752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.772903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.775760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:00:59.776603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:00:59.781109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:00:59.782120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.078152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:00.100682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-03504b65-f206-4db8-aa6a-7415099eefaa tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.352461 Sep 23 04:01:00.103952 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2269/4641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:00:59 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:00.305297 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbd3f173-2aa9-4a5a-bedb-98813c2bb0db tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c/action" status: 202 len: 0 microversion: 2.1 time: 1.082195 Sep 23 04:01:00.305949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2373/4642] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:00:59 2022] POST /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c/action => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:01:00.317203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:00.317852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:00.328212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.329008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.329641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.330547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.331227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.331815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.344357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c4b7cd-b822-464e-8113-b62c712f741c", "tag": "47075061-f5f5-4fc8-8293-56438a5d995b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:00.362838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.364986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:00.366001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.366568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.394576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] Creating event network-changed:47075061-f5f5-4fc8-8293-56438a5d995b for instance d1c4b7cd-b822-464e-8113-b62c712f741c on n-h2-858495-2 Sep 23 04:01:00.404110 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f23f2f4c-9288-4c4a-a6a8-2a6ef7d11c3c req-0156e70b-aa83-47d9-ad3b-06ccf0a54138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064084 Sep 23 04:01:00.415828 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2374/4643] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:01:00.545665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:00.557488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ed18b3a-72e8-436d-97dc-ab767034ddaf tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1460 microversion: 2.1 time: 0.247044 Sep 23 04:01:00.558091 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2270/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:00 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1460 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:00.585461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:00.586625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:00.602097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.603727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.605547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.606556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.609952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.610729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.773157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:00.776793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:00.793317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.794056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.794480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:00.799941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:00.803357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:00.803829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:01.133623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:01.138189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:01.148931 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39341f2d-bf1b-4cc7-a753-f16ba4dd4dd8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.568400 Sep 23 04:01:01.153531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2f5badc-af16-46d9-9319-bfd784332ec4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1508 microversion: 2.1 time: 0.381014 Sep 23 04:01:01.153738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2375/4645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:00 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:01.170785 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2271/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:00 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:01.180941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:01.181956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:01.190091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:01.190943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:01.191604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:01.192748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:01.193509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:01.194144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:01.524877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1587288692", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a1a86910-f1f0-4d7a-8e91-ba715d35500f"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:01.663484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] validate_networks() for [('a1a86910-f1f0-4d7a-8e91-ba715d35500f', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:01:01.675907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:01.685281 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9dc96c77-db12-4e6e-9319-bbf2eafa59e8 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.512934 Sep 23 04:01:01.699250 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2272/4647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:01 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:01.722961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:01.723603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:01.732978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:01.733512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:01.733960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:01.734687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:01.735148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:01.754044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:02.413395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:02.429839 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4c68f76-98c8-4adc-b62a-f001053ff3f5 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.728498 Sep 23 04:01:02.431703 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2273/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:01 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:02.438470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:02.439461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:02.456229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:02.456992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:02.457496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:02.458223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:02.458685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:02.459114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:02.942842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:02.956682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2eb24fb-881c-4def-b5d6-ef6f0b96f9d8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1451 microversion: 2.1 time: 0.523544 Sep 23 04:01:02.957307 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2274/4649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:02 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1451 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:02.973976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:02.975370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:02.991175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:01:02.993487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:01:02.994294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:02.994678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:01:02.995288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:01:02.995911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:01:02.996034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:02.996457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:02.999052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:02.999842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.002171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.009524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.010357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.010962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.014623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.015418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.016360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.045731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Getting quotas for project 7e31e5073fb7413bbdc465e51ceb45ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:01:03.052574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Getting quotas for user a30310d9408a4ccd84ad6c2231b38677 and project 7e31e5073fb7413bbdc465e51ceb45ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:01:03.069965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Going to run 2 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:01:03.081823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:03.168270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=fb96c544-7291-4c8e-94c8-57a896a97501,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:03.290564 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa8cc1e2-87c0-4661-a60d-0b57d6eb17a8 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132312 Sep 23 04:01:03.291688 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2376/4650] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:01:03.304150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:03.305198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:03.320752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.321265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.321750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.322483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.325684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.328360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.341009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:03.559103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:03.569600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a49b3c0-5e56-4566-8c5c-e0149a19aee7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.611149 Sep 23 04:01:03.581811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2275/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:02 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:03.598247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:03.598990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:03.608678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.613928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.614359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.615206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:03.615566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:03.616001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:03.895960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:03.916682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a767d19d-6272-4aff-9ca3-64fa46ed4dfb tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.622983 Sep 23 04:01:03.917595 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2377/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:03 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:03.924125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:03.938438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:03.944042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Searching by: {'deleted': False, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:01:03.977197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:04.000424 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0d8d247f-6d14-4bb4-9ee7-94d8c139eefa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1451 microversion: 2.1 time: 0.416179 Sep 23 04:01:04.005378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.006127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.006821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.012509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.013178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.013714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.019759 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2276/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:03 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1451 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:04.042841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b47ed4-25e1-4db1-a264-0fdf4fc95870", "name": "network-vif-plugged", "status": "completed", "tag": "636cfb70-2649-4fbd-ac1b-687831772c33"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:04.076191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.079043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.079795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.089314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d52618d-dfdf-4fa2-8eac-1e787c2c1cd9 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.170450 Sep 23 04:01:04.093473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2378/4654] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 04:01:03 2022] GET /compute/v2.1/servers => generated 677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:04.105495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:04.106017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:04.118911 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] Creating event network-vif-plugged:636cfb70-2649-4fbd-ac1b-687831772c33 for instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 on n-h1-858495-2 Sep 23 04:01:04.131960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.137281 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e549fb9d-ceba-42e4-811f-66500a9e4ed1 req-57b2972c-79b9-4b64-9df9-f55a32b34439 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108336 Sep 23 04:01:04.138878 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2277/4655] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:04.142727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.142727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.143395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.143870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.144305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.158787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-925a2574-c7e6-40b9-9c3e-f611e29aa824 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:04.162244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-925a2574-c7e6-40b9-9c3e-f611e29aa824 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:04.282708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-925a2574-c7e6-40b9-9c3e-f611e29aa824 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:04.308194 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-925a2574-c7e6-40b9-9c3e-f611e29aa824 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1220 microversion: 2.1 time: 0.160618 Sep 23 04:01:04.322440 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2278/4656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:04 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:04.337420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:04.337981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:04.386221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.386841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.387493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.388453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.389091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.389739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.463829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lazy-loading 'flavor' on Instance uuid 97379c08-f144-4054-a9b9-f7a548e2a061 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:01:04.524437 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'shelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state shelved_offloaded Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 14 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: {"shelve": {}} Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'shelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state shelved_offloaded Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'shelve': {}}} Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:01:04.535763 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state shelved_offloaded Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state shelved_offloaded Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'shelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state shelved_offloaded {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17ad8c5c-d4f6-4e91-9ded-a559a83a479b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 155 microversion: 2.1 time: 0.213917 Sep 23 04:01:04.540829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2279/4657] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:04 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 155 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:01:04.557295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:04.562735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:04.565332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:04.569091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ca5a819-1afa-4e5c-931f-593fab213d3a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.472580 Sep 23 04:01:04.582483 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2379/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:04 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:04.588961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.589754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.590390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.593382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:04.594147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:04.596493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:04.766802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1065101721", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "035b98c4-22a0-4a66-81a1-f3cedd6f6f67"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:04.818214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:01:04.874891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] validate_networks() for [('035b98c4-22a0-4a66-81a1-f3cedd6f6f67', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:01:04.997447 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48de6ace-e3da-4a19-bdfa-3f66a19abe67 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.450984 Sep 23 04:01:05.001224 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2280/4659] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:04 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:01:05.011944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:05.017761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:05.032833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.035898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.036651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:05.038641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.040607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.041082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:05.503080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:05.517278 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5daa14ad-1f1c-4991-bb04-c271a18345c1 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 0.513642 Sep 23 04:01:05.519988 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2281/4660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:05 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:05.525668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:05.526545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:05.540294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.541296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.542006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:05.543147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.543815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.544441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:05.946885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:05.955922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f84c3521-f52d-4ce3-ae63-62f4928ffe7a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1459 microversion: 2.1 time: 0.434780 Sep 23 04:01:05.960793 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2282/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:05 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1459 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:05.972834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:05.973939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:05.986676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.988454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.989700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:05.992257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:05.994296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:05.994960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.217814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:06.235497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05a4e299-e117-452c-a283-a9f918159207 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1272 microversion: 2.1 time: 0.270814 Sep 23 04:01:06.236614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2283/4662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:05 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:06.259636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "name": "network-vif-unplugged", "status": "completed", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:06.303490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:06.304274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:06.313413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.351198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_external_events [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] Unable to find a host for instance 97379c08-f144-4054-a9b9-f7a548e2a061. Dropping event network-vif-unplugged {{(pid=128723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 04:01:06.362107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-64e625a6-c644-4709-a4e5-1def9ffb5090 req-97e91052-bc25-420a-967b-d59c25ca193a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099336 Sep 23 04:01:06.386939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2284/4663] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 134 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 04:01:06.548928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:06.552570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:06.581856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:01:06.582687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:01:06.582834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:01:06.583112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:01:06.583810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:01:06.586927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:06.587966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:06.588719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.589958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:06.593486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:06.597437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.619159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:06.619661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:06.620104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.620841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:06.621304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:06.621768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:06.742929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:01:06.770318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Getting quotas for user 5e754f4d278f4bfe91f618181cd36bc1 and project a74f804a4c3e4ee7bf9b79a25d0b082a. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:01:06.818332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:01:06.824780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:06.953476 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3cd07869-71e5-45b4-8f23-b16ee12cfa36 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189090 Sep 23 04:01:06.954638 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2380/4664] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:01:06.985102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4eacfb30-12ce-4fd6-9220-b57088958a02 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:06.987851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4eacfb30-12ce-4fd6-9220-b57088958a02 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:07.708087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4eacfb30-12ce-4fd6-9220-b57088958a02 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:07.719441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4eacfb30-12ce-4fd6-9220-b57088958a02 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1215 microversion: 2.1 time: 0.750388 Sep 23 04:01:07.723215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2381/4665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:06 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1215 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:07.736289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:07.737006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:07.753747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:07.754751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:07.755850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:07.757963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:07.760486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:07.761219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:07.924304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:07.948364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-839cdd4b-db43-44ca-bbbf-907658ccfb66 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1327 microversion: 2.1 time: 1.407302 Sep 23 04:01:07.949859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2285/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:06 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1327 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:07.961473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:07.963785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:07.984218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:07.995145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:07.995961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:07.996585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:07.998494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:07.999123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:08.000540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:08.211060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:08.228696 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c139a13-2c7d-47e0-98c5-38db3af2dda5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1278 microversion: 2.1 time: 0.276161 Sep 23 04:01:08.249600 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2286/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:07 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:08.556423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:08.567244 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62204e07-2206-4348-8728-f7d7fde19861 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.835859 Sep 23 04:01:08.568776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2382/4668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:07 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:08.755965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:08.759816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:08.783592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:08.784512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:08.791915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:08.795752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:08.796323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:08.797049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:08.972675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:08.973296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:08.984980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:08.985610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:08.988443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:08.989635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:08.990294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:08.990902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:09.063789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:09.094499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9cde281d-02e8-4a84-82d8-948a7369302e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1267 microversion: 2.1 time: 0.348726 Sep 23 04:01:09.098157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2287/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:08 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1267 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:09.259585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:09.262304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:09.275799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:09.276724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:09.277454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:09.278445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:09.279706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:09.280386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:09.298228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:09.538666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:09.574805 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-59d4529e-1cd5-4555-b347-ac9729752693 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1528 microversion: 2.1 time: 0.604972 Sep 23 04:01:09.580734 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2383/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:08 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1528 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:09.607376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:09.607954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:09.620817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:09.632027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:09.632787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:09.634151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:09.634785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:09.635419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:10.211282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:10.243232 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-422b766f-eb93-4317-beb8-5c195a181c8a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 0.992651 Sep 23 04:01:10.245756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2288/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:09 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:10.255285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:10.256294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:10.264870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:10.266974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:10.267878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:10.269000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:10.269767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:10.270447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:10.561213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:10.572909 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ef7c74c-4067-4e42-9b87-d5835d6d2282 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.975312 Sep 23 04:01:10.596363 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2384/4672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:09 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:10.602318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:10.605978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:10.619494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:10.621206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:10.623689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:10.625667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:10.626469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:10.627135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:10.882756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:10.909267 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6802fe25-1ded-4b43-ae8f-9ceb2c405ca6 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1273 microversion: 2.1 time: 0.311563 Sep 23 04:01:10.925716 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2385/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:10 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:11.058119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:11.082232 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-edead54b-473a-4412-935d-eac7ce95f96b tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1528 microversion: 2.1 time: 0.824666 Sep 23 04:01:11.098985 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2289/4674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:10 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1528 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:11.271210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:11.271806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:11.287480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.289720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.292577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:11.295547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.300988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.302036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:11.412086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:11.413037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:11.415435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:11.421459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.423506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.424215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:11.425198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.425941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.426708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:11.468894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] HTTP exception thrown: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Request method failure captured: Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 HTTP/1.1 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS9mgM99qpFpN8Vqv76c6Lqvt1P9bwSQ-SXygRf2mhkI9ryJmjM2ez_nettw13GqjNMYqCEDVHBok1fIn4h69Ak_HxV5ERGbsN7qGZG8W29PyioY9cPUz1NcrLYn2EFwJoE_-90n6mU6fc013iud_0H5zCnbChrGRWhFhbIX-Pplg5g Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 684a3e162b714781ad1b77d12dcbc0d8 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 684a3e162b714781ad1b77d12dcbc0d8 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-620373850-project Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1cabb4f12e0046b0861c92bff5267ecb Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850-project Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b6b47ed4-25e1-4db1-a264-0fdf4fc95870'} Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:01:11.471720 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:11.476254 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:11.479260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Returning 404 to user: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:11.480405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d8902dc-0a8d-4824-9545-00f613d6a878 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 404 len: 111 microversion: 2.1 time: 0.376288 Sep 23 04:01:11.481223 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2386/4675] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:01:11 2022] DELETE /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 111 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:01:11.496242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:11.497213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:11.505041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.506549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.507250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:11.508208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:11.508895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:11.509591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.218034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:12.230969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eeb35930-6cd7-426f-ac25-d4e23e39acfb tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 0.961041 Sep 23 04:01:12.233253 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2290/4676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:11 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:12.242197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:12.242837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:12.252493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.253305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.255984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.257719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.258425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.260583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.427836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:12.439995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-61784f44-6f02-4a00-96e6-50b63ae09224 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1528 microversion: 2.1 time: 0.952008 Sep 23 04:01:12.441330 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2387/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:11 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1528 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:12.461684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:12.462759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:12.473197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.474719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.485510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.491580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.494493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.495316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.683217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:12.697012 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dda42b0-e0a9-48ac-a00c-8fc85c5e83a3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1273 microversion: 2.1 time: 0.254176 Sep 23 04:01:12.698024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2388/4678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:12 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:12.703886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Action: 'update', calling method: >, body: {"server": {"name": "b6b47ed4-25e1-4db1-a264-0fdf4fc95870_new"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:12.707105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:12.722072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.722871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.723820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.725169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.726643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.727374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.748291 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] HTTP exception thrown: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Request method failure captured: Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: request: PUT /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 HTTP/1.1 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 64 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS9mgM99qpFpN8Vqv76c6Lqvt1P9bwSQ-SXygRf2mhkI9ryJmjM2ez_nettw13GqjNMYqCEDVHBok1fIn4h69Ak_HxV5ERGbsN7qGZG8W29PyioY9cPUz1NcrLYn2EFwJoE_-90n6mU6fc013iud_0H5zCnbChrGRWhFhbIX-Pplg5g Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 684a3e162b714781ad1b77d12dcbc0d8 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_684a3e162b714781ad1b77d12dcbc0d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 684a3e162b714781ad1b77d12dcbc0d8 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850 Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-620373850-project Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1cabb4f12e0046b0861c92bff5267ecb Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-620373850-project Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: {"server": {"name": "b6b47ed4-25e1-4db1-a264-0fdf4fc95870_new"}} Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b6b47ed4-25e1-4db1-a264-0fdf4fc95870', 'body': {'server': {'name': 'b6b47ed4-25e1-4db1-a264-0fdf4fc95870_new'}}} Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:01:12.750673 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:12.755410 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:12.764702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] Returning 404 to user: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:12.769272 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f817205-ef8e-433a-a29d-10afd11bb5c9 tempest-ServersNegativeTestMultiTenantJSON-620373850 tempest-ServersNegativeTestMultiTenantJSON-620373850-project] 10.222.0.25 "PUT /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 404 len: 111 microversion: 2.1 time: 0.066593 Sep 23 04:01:12.770695 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2389/4679] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 04:01:12 2022] PUT /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:01:12.777101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0986cbd-26e3-458a-9b42-9b93b6953689", "tag": "bc6b54a0-2085-43e1-a82f-567c8231dfa2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:12.818645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.819130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.819563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.839968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] Creating event network-changed:bc6b54a0-2085-43e1-a82f-567c8231dfa2 for instance d0986cbd-26e3-458a-9b42-9b93b6953689 on n-h1-858495-2 Sep 23 04:01:12.846755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e9950695-e502-4ab6-b484-333216a2f59a req-e4270bb2-ac4e-4cfe-960c-ffa8726b688f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074484 Sep 23 04:01:12.848199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2390/4680] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:12.854695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:12.855470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:12.863286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.863781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.864322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.866084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:12.866620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:12.867994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:12.929593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:01:13.073964 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-29b66404-de26-4f3e-9959-d41eb3ac8886 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 204 len: 0 microversion: 2.1 time: 0.223592 Sep 23 04:01:13.080781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2391/4681] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:01:12 2022] DELETE /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:01:13.090981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:13.100616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:13.112660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:13.131666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:13.133137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d15d6183-8767-4970-8a84-02faf5f77e6a tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.897964 Sep 23 04:01:13.145932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2291/4682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:12 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:13.146050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:13.146050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:13.146050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:13.146050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:13.146050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:13.257859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:13.258743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:13.270403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:13.272273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:13.275132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:13.276007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:13.276549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:13.279696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:14.246168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:14.264077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83507752-0078-4d14-b8be-0c4412a23377 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1534 microversion: 2.1 time: 1.174740 Sep 23 04:01:14.265123 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2392/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:13 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1534 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:14.283403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:14.292734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:14.312315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:14.312825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:14.313266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:14.341856 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] Creating event network-changed:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h2-858495-2 Sep 23 04:01:14.350094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-dd739c9e-6392-49f7-9a6d-6682d882e68c req-96ce706d-9166-4f70-a49c-664ada3233bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080292 Sep 23 04:01:14.350717 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2393/4684] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:14.366498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:14.367223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:14.377530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:14.386040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:14.386541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:14.386978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:14.387691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:14.391475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:14.393162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:14.395032 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a33090ab-18f3-4b49-9d67-08c20f58ea97 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 1.141289 Sep 23 04:01:14.398040 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2292/4685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:13 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:14.414873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:14.415511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:14.435228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:14.436139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:14.436777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:14.437861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:14.438495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:14.439090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:15.150611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:15.177082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-267f677e-2774-4d3b-9f12-ee6a1376aaea tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.821306 Sep 23 04:01:15.181698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2394/4686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:14 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:15.311703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:15.313028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:15.323367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:15.324525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:15.324968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:15.326245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:15.326697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:15.327120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:15.527923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:15.556001 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea0304b9-4ec1-4ce0-858c-ec3872e85949 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.155001 Sep 23 04:01:15.561852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2293/4687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:14 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:15.578180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:15.584506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:15.609028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:15.610282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:15.616192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:15.618098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:15.619226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:15.622944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:16.652322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:16.662803 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-305838d2-2d80-4c69-8be8-1f4484906353 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1534 microversion: 2.1 time: 1.355252 Sep 23 04:01:16.688418 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2395/4688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:15 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1534 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:16.688418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:16.701137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:16.701897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:16.713060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:16.713723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:16.714240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:16.715422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:16.718161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:16.721128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:16.983714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:17.006005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-714fd87b-afba-4433-a8ab-1b2b45ff21aa tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 1.432997 Sep 23 04:01:17.006818 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2294/4689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:15 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:17.012839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:17.014097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:17.035293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:17.038421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:17.042396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:17.043399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:17.046438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:17.050415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:17.719704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:17.740578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:17.751997 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3b7bc11-4755-49f8-bbcc-6223e30b5b3d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.071850 Sep 23 04:01:17.769268 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2396/4690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:16 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:17.778962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb96c544-7291-4c8e-94c8-57a896a97501", "tag": "1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:17.799526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:17.800474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:17.801456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:17.806426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:17.820211 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] Creating event network-changed:1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9 for instance fb96c544-7291-4c8e-94c8-57a896a97501 on n-h2-858495-2 Sep 23 04:01:17.829916 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6f3cd4fb-2e57-49a4-91ec-316c48971a7f req-1438b329-6d46-47d0-ad90-d5a46965f362 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058916 Sep 23 04:01:17.831795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2397/4691] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:17.839635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:17.840695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:17.850175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:17.851908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:17.852614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:17.853840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:17.854608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:17.855355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:18.142474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:18.164334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd7848cb-4d1d-4f30-bf8b-caefd4706406 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.156000 Sep 23 04:01:18.164949 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2295/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:17 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:18.186375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:18.188012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:18.194949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:18.195719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:18.196328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:18.197247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:18.197894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:18.198489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:19.096127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88738208419c44b69f226db39051c8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc59d9c7894ade8139c864215f286d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:19.113892 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd79991b-0403-41d0-ad04-d33cbe47617d tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 200 len: 1534 microversion: 2.1 time: 1.280052 Sep 23 04:01:19.115097 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2398/4693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:17 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 1534 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:19.133436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:19.135355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:19.154811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:19.162278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:19.164079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:19.168500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:19.169905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:19.170810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:19.832697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:19.881078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f14b9712-fd4a-4373-af30-1275480066c7 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 1.710680 Sep 23 04:01:19.885861 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2296/4694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:18 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:19.903054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:19.909391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:19.923498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:19.925191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:19.926856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:19.929131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:19.929810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:19.934110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.535637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:20.550613 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-efbe7043-28ba-47e9-b77c-b3827de6a99b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.433294 Sep 23 04:01:20.552257 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2399/4695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:19 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:20.565913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b47ed4-25e1-4db1-a264-0fdf4fc95870", "name": "network-vif-deleted", "tag": "636cfb70-2649-4fbd-ac1b-687831772c33"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:20.611597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.613044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.614144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.643438 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] Creating event network-vif-deleted:636cfb70-2649-4fbd-ac1b-687831772c33 for instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 on n-h1-858495-2 Sep 23 04:01:20.657711 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d12d257d-386e-40a5-ae0b-90a598d1a0d0 req-fdfbd624-db45-48b1-b8dc-d41cdaf75e61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103825 Sep 23 04:01:20.661624 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2400/4696] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:20.678703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:20.679416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:20.698054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.698767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.699323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.700338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.701021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.701778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.762846 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2b8fb1d3-e85a-4805-ba0b-315711ee06ac tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/ips" status: 200 len: 148 microversion: 2.1 time: 0.098948 Sep 23 04:01:20.769788 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2401/4697] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:01:20 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/ips => generated 148 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:20.799444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:20.802176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] [instance: b6b47ed4-25e1-4db1-a264-0fdf4fc95870] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:20.822223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.822926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.828425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.829292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.830075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.831194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.889086 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] HTTP exception thrown: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Request method failure captured: Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 HTTP/1.1 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS9SUoIHdyUUaWchZu0bhBL4We85w2araaU15QvEaW5fg4pT7KigGQKuKslPJ0Z0j9oHf33K2sbSsrwiMeopbri59NzZsRuNu3L4fYU0Gkz5qGE-pl2iI236ajRc4DgkxsbQE4ghwQxA5imzwgAHyIafaBZRhggKnoF-FiikKqHMUAc Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: d4dc59d9c7894ade8139c864215f286d Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1619389410 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4dc59d9c7894ade8139c864215f286d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4dc59d9c7894ade8139c864215f286d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4dc59d9c7894ade8139c864215f286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4dc59d9c7894ade8139c864215f286d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1619389410 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: d4dc59d9c7894ade8139c864215f286d Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1619389410 Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1619389410-project Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 88738208419c44b69f226db39051c8bf Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1619389410-project Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b6b47ed4-25e1-4db1-a264-0fdf4fc95870'} Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:20.898007 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. Sep 23 04:01:20.902087 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:20.906409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] Returning 404 to user: Instance b6b47ed4-25e1-4db1-a264-0fdf4fc95870 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:20.907534 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-623474bb-f76b-4681-b23c-de7edaf74ea4 tempest-ServersNegativeTestMultiTenantJSON-1619389410 tempest-ServersNegativeTestMultiTenantJSON-1619389410-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870" status: 404 len: 111 microversion: 2.1 time: 0.124802 Sep 23 04:01:20.919460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2402/4698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:20 2022] GET /compute/v2.1/servers/b6b47ed4-25e1-4db1-a264-0fdf4fc95870 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:01:20.931566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:20.959371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:20.979543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.988217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.989247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:20.990362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:20.991209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:20.991844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:21.751017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:21.769158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cde01808-1d45-463f-bd9f-fed52dbdbbff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.881663 Sep 23 04:01:21.771754 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2297/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:19 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:21.793521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:21.798971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:21.823637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:21.824442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:21.841600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:21.843502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:21.848546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:21.849299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:22.256260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:22.273795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3045a75c-7919-450f-8d59-25dd66599000 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 1.349895 Sep 23 04:01:22.277483 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2403/4700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:20 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:22.287102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0986cbd-26e3-458a-9b42-9b93b6953689", "name": "network-vif-plugged", "status": "completed", "tag": "bc6b54a0-2085-43e1-a82f-567c8231dfa2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:22.315190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:22.315855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:22.316302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:22.346517 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] Creating event network-vif-plugged:bc6b54a0-2085-43e1-a82f-567c8231dfa2 for instance d0986cbd-26e3-458a-9b42-9b93b6953689 on n-h1-858495-2 Sep 23 04:01:22.361721 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e817e213-764c-437e-8fb1-faeabd1d0903 req-18415155-aa66-40e0-94e6-b722624db49c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082036 Sep 23 04:01:22.368657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2404/4701] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:22.402708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:22.412266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c3906d76-2c69-488b-bfba-7a88977f65a8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.639196 Sep 23 04:01:22.413553 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2298/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:21 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:22.693333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e804563-e91b-4bb5-ad25-ea6bc66a7be7", "tag": "20936caf-6723-490a-ae6b-f9dfe1230659"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:22.710296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:22.710784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:22.711222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:22.744303 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] Creating event network-changed:20936caf-6723-490a-ae6b-f9dfe1230659 for instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 on n-h2-858495-2 Sep 23 04:01:22.752693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ce7e7f79-9163-4ca4-b37e-5e408f3c3e52 req-32708fec-d8c3-481e-b2df-604ae5a3f90d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064005 Sep 23 04:01:22.757122 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2405/4703] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:22.800034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:22.800784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:22.812499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:22.813099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:22.813591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:22.815214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:22.815691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:22.816133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:23.147925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:23.161386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9983a1b8-a860-4e3b-bd5e-e9eef18bc67f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.365529 Sep 23 04:01:23.162621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2299/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:23.306342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:23.307896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:23.322908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:23.323547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:23.324097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:23.325615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:23.326579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:23.327134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:23.440909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:23.442042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:23.496298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:23.497747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:23.500175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:23.505263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:23.506487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:23.507543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:24.772616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:24.787627 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3ba3b5b-c491-4492-91a2-734ca4e76815 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1320 microversion: 2.1 time: 1.491652 Sep 23 04:01:24.813477 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2406/4705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:23 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1320 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:24.827404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76d35beb-4683-42dd-bd92-89b2ad0bdd0a"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:24.853387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:24.882706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:24.883212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:24.883661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:24.884378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:24.884834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:24.885263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:25.063208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:25.093451 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9730f872-0be4-4e3a-a529-b8b9cf8c9f37 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.660609 Sep 23 04:01:25.095293 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2300/4706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:23 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:25.106881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:25.130433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:25.149897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:25.152348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:25.153228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:25.156460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:25.160595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:25.161472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:25.683404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:25.691759 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-674f914d-0e57-4fdf-833b-598486c7dec3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.594846 Sep 23 04:01:25.692366 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2301/4707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:25 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:25.823555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:25.824269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:25.835876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:25.842137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:25.842850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:25.843804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:25.844441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:25.845079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:26.594285 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8dc1649-b213-4751-a4d0-4045c70e7672 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "POST /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.773202 Sep 23 04:01:26.596796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2407/4708] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:01:24 2022] POST /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 194 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:26.612953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:26.621983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:26.632417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:26.638547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:26.639473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:26.640500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:26.641247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:26.645045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:26.804707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:26.834942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ee758d3-0337-4ea0-9be9-d5e32ab6b506 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 200 len: 1508 microversion: 2.1 time: 1.012903 Sep 23 04:01:26.859377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2302/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:25 2022] GET /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 1508 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:26.867445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:26.868534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:26.889458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:26.890689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:26.891726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:26.894572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:26.895768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:26.896507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:27.827318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:27.859029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:27.906044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-923d36c2-ee46-4c7b-a97a-e6a0379c1b10 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.300396 Sep 23 04:01:27.911776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2408/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:26 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:27.921071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ce33dbe-22c5-40df-bbe9-7e9af1f7acce tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.057783 Sep 23 04:01:27.957435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2303/4711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:27.978287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:27.994774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:28.029008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:28.034268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:28.040701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:28.056356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:28.058729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:28.064832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:28.937788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:28.938474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:28.967460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:28.968263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:28.968912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:28.969845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:28.970470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:28.973343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:30.234170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:30.252655 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-286a503a-7a17-42ec-9655-cc27b42bc649 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501" status: 200 len: 1320 microversion: 2.1 time: 2.339727 Sep 23 04:01:30.253904 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2409/4712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:27 2022] GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501 => generated 1320 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:30.264287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:30.271840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:30.300390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:30.300982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:30.301586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:30.302062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:30.305501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:30.306260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:30.306840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:30.310656 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45ee34c5-0722-4b27-9a51-885976dd15eb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.377500 Sep 23 04:01:30.318280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2304/4713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:28 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:30.935623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb96c544-7291-4c8e-94c8-57a896a97501", "name": "network-vif-plugged", "status": "completed", "tag": "1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:30.974633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:30.975122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:30.975546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:31.011094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:31.015662 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] Creating event network-vif-plugged:1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9 for instance fb96c544-7291-4c8e-94c8-57a896a97501 on n-h2-858495-2 Sep 23 04:01:31.033841 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fa095d26-04a9-422a-82eb-5645a6239769 req-43125e73-2f2f-4e24-b425-6198d2c549c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102735 Sep 23 04:01:31.041731 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2305/4714] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:31.283275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:31.284601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:31.303621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:31.307112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:31.307879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:31.319935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:31.320871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:31.321725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:32.184789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:32.204751 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e61e28ba-c394-4d5e-914a-c85c3deeb7db tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.949493 Sep 23 04:01:32.205774 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2410/4715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:30 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:32.231104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:32.231790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:32.261335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:32.275701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:32.276627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:32.278194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:32.278838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:32.279614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:32.755496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:32.765025 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b25abea-55d1-4506-83a1-96698b76bfa9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.558125 Sep 23 04:01:32.773691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:32.775254 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2411/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:32 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:32.784683 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c543d595-1ceb-4688-8b80-ebd843973d2e tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501" status: 200 len: 1320 microversion: 2.1 time: 1.506043 Sep 23 04:01:32.802281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2306/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:31 2022] GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501 => generated 1320 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:33.232625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:33.233648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:33.240718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:33.241474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:33.242086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:33.242956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:33.244192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:33.244803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:33.816476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:33.817943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:33.827610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:33.828686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:33.829946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:33.831285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:33.832234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:33.843128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:34.187933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:34.201003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3cc029a-d167-4e37-9701-0a2810740d43 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.975791 Sep 23 04:01:34.204485 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2412/4718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:33 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:34.221460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:34.222833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:34.237041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:34.240638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:34.244232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:34.245414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:34.253825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:34.254498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:34.656243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:34.669838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1fa02cd-7ea9-4115-8c11-c5cc738adea7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.869255 Sep 23 04:01:34.683557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2307/4719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:33 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:34.787963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:34.798111 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd122710-f85c-4a27-a6d6-5bc653b617a0 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501" status: 200 len: 1507 microversion: 2.1 time: 0.589952 Sep 23 04:01:34.800088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2413/4720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:34 2022] GET /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501 => generated 1507 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:34.825973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:34.826485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:34.851156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:34.851687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:34.852143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:34.852884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:34.853384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:34.853816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:34.882291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: fb96c544-7291-4c8e-94c8-57a896a97501] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:01:35.066637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d0c500c-9484-49f3-b9be-b33be7fca27b tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501" status: 204 len: 0 microversion: 2.1 time: 0.243135 Sep 23 04:01:35.068123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2308/4721] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:01:34 2022] DELETE /compute/v2.1/servers/fb96c544-7291-4c8e-94c8-57a896a97501 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:01:35.086066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:35.086968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:35.098694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:35.099637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:35.100267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:35.101221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:35.101915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:35.102549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:35.148366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: d0986cbd-26e3-458a-9b42-9b93b6953689] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:01:35.207450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:35.242087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:35.243356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:35.270433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:35.271262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:35.271671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-950668f3-fb05-4305-aedb-7fdad29a335a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689" status: 204 len: 0 microversion: 2.1 time: 0.191419 Sep 23 04:01:35.272176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:35.273692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2414/4722] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:01:35 2022] DELETE /compute/v2.1/servers/d0986cbd-26e3-458a-9b42-9b93b6953689 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:01:35.284343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:35.284846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:35.290651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:35.509142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-522812166", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a1a86910-f1f0-4d7a-8e91-ba715d35500f"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:35.599556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] validate_networks() for [('a1a86910-f1f0-4d7a-8e91-ba715d35500f', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:01:35.960881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:35.977475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e84e1841-2ea4-46fc-8de2-cf20b3a6f327 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.741972 Sep 23 04:01:35.980597 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2309/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:35 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:36.292630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:36.295318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:36.314340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:36.315059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:36.316790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:36.317564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:36.318373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:36.350801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ba63cf8-38b2-4b59-8c9e-bc055a82c31b tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.368609 Sep 23 04:01:36.355175 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2310/4724] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Sep 23 04:01:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:36.362060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:36.363323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:36.375412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:36.376098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:36.377103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:36.378032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:36.378648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:36.379232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:37.192451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:37.228167 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1a31608-38b5-448a-8ca9-e9ade608d979 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.870953 Sep 23 04:01:37.261443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2311/4725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:36 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:37.278806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1210129048", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "availability_zone": "nova:n-h2-858495-2", "networks": [{"uuid": "fe604c4b-19cd-4e8e-ae2f-6a4f8f22b12d"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:37.422355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] validate_networks() for [('fe604c4b-19cd-4e8e-ae2f-6a4f8f22b12d', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:01:37.520288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:01:37.521555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:01:37.522412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:01:37.523057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:01:37.523709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:01:37.547548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:37.548895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:37.551215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:37.553590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:37.554685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:37.555812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:37.610714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Getting quotas for project 7e31e5073fb7413bbdc465e51ceb45ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:01:37.623669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Getting quotas for user a30310d9408a4ccd84ad6c2231b38677 and project 7e31e5073fb7413bbdc465e51ceb45ac. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:01:37.657751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Going to run 2 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:01:37.661131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:37.740495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=8a0d5ef7-7e43-4405-a774-386d2619ed49,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:37.898817 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cad1a933-99fa-49dc-8219-bf78411c10ca tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.394138 Sep 23 04:01:37.902752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2415/4726] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:01:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 2399 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:01:37.921597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:37.924660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:37.941858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:37.942794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:37.944277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:37.946117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:37.947713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:37.948557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:38.713818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:38.723917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:01:38.725541 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af788282-d3f7-4849-9304-af7a2d7380aa tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.819207 Sep 23 04:01:38.726256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:01:38.726374 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2416/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:37 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:38.727401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:01:38.728400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:01:38.729063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:01:38.739062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:38.740630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:38.745113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:38.752805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Searching by: {'deleted': False, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:01:38.796594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:38.800188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:38.802637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:38.805586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:38.806117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:38.806965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:38.809660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:38.811036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:38.813316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:38.814316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:38.815748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:38.816410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:38.875810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Getting quotas for project bad7c943574a4726893a6b8e602df5be. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:01:38.883533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Getting quotas for user 3f7449d430fe4a28955560d740faf560 and project bad7c943574a4726893a6b8e602df5be. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:01:38.904335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:01:38.904985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:01:38.908132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:01:38.999255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04cbeeb2-faee-4f88-a99d-c926cb52fcf5 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.271994 Sep 23 04:01:39.002265 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2417/4728] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 04:01:38 2022] GET /compute/v2.1/servers => generated 1335 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:39.014229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:39.018280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:39.025493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-067dbd88-9495-41d0-8494-542e0ee4972a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755136 Sep 23 04:01:39.034293 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2312/4729] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:01:39.046081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0986cbd-26e3-458a-9b42-9b93b6953689", "name": "network-vif-deleted", "tag": "bc6b54a0-2085-43e1-a82f-567c8231dfa2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:39.054545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:39.056820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:39.063525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:39.066403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:39.067621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:39.068406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:39.080095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:39.085767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:39.086228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:39.130027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] Creating event network-vif-deleted:bc6b54a0-2085-43e1-a82f-567c8231dfa2 for instance d0986cbd-26e3-458a-9b42-9b93b6953689 on n-h1-858495-2 Sep 23 04:01:39.155413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bf6a4522-be1c-4209-b55f-5554b1f8ba3a req-9a1c5ca6-7533-4397-a665-ebb5db88a1eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118443 Sep 23 04:01:39.158222 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2313/4730] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:39.192001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e1c01d2a-5478-4074-8dd1-98fcca8b2826 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:39.192741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1c01d2a-5478-4074-8dd1-98fcca8b2826 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:39.425114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1c01d2a-5478-4074-8dd1-98fcca8b2826 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:39.437783 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e1c01d2a-5478-4074-8dd1-98fcca8b2826 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1217 microversion: 2.1 time: 0.274754 Sep 23 04:01:39.450836 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2314/4731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:39 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:39.465959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-295ffa52-da8b-4ca8-a6e6-f2f3b454ef5e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:39.468723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-295ffa52-da8b-4ca8-a6e6-f2f3b454ef5e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:39.750189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-295ffa52-da8b-4ca8-a6e6-f2f3b454ef5e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1329 microversion: 2.1 time: 0.301139 Sep 23 04:01:39.772448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2315/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:39 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1329 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:39.786917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:39.795274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:39.796168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:39.816023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:39.816837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:39.818002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:39.818937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:39.819605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:39.820283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:39.833288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24e73b50-acc6-4f2d-9d2c-044043cdb110 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.826386 Sep 23 04:01:39.840425 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2418/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:39 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:40.500308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:40.503593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:40.522552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:40.523707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:40.524460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:40.525626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:40.526578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:40.527398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:41.230399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:41.237070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:41.245262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-121c9acf-54b8-4213-88b4-8895c613315a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1269 microversion: 2.1 time: 0.773124 Sep 23 04:01:41.253781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2419/4734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:40 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1269 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:41.265211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:41.266781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:41.275546 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8761a21-fc94-42dc-b146-702332d928d1 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 1.500670 Sep 23 04:01:41.279654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:41.281547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:41.282535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:41.283762 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2316/4735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:39 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:41.294466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:41.298171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:41.302183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:41.302183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:41.303368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:41.315863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:41.317992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:41.318474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:41.319338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:41.319676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:41.320109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:41.494424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ca949e3-dc4a-41b9-9230-3d10c8f23d58 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1416 microversion: 2.1 time: 0.239407 Sep 23 04:01:41.500390 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2420/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:41 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1416 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:41.961910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:41.982841 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e44e4093-cc0b-43d6-a40e-d88d01f5dd8a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.696065 Sep 23 04:01:41.984294 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2317/4737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:41 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:42.271777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:42.272749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:42.311122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:42.311842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:42.315515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:42.322397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.325397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.327584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.331364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.332138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.334887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.335395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.336030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.338540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.340672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.347705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.348227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.561988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:42.572772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b64ab4e4-1287-4d50-ab73-6682206687f1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1275 microversion: 2.1 time: 0.305577 Sep 23 04:01:42.593168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2421/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:42 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:42.607655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:42.608623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:42.622188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.624041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.624785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.625342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.626034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.626263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.796338 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5a4cfd9-086f-413c-91b0-7ddf0a1426a2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1416 microversion: 2.1 time: 0.201892 Sep 23 04:01:42.796963 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2422/4739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:42 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1416 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:42.812581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e804563-e91b-4bb5-ad25-ea6bc66a7be7", "name": "network-vif-plugged", "status": "completed", "tag": "20936caf-6723-490a-ae6b-f9dfe1230659"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:42.831930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:42.837163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:42.837836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:42.858679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:42.860464 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] Creating event network-vif-plugged:20936caf-6723-490a-ae6b-f9dfe1230659 for instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 on n-h2-858495-2 Sep 23 04:01:42.874248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3ffa97eb-ee46-4b7c-b7c4-b463eba5f82f req-05627b87-777b-4268-aa18-f21ab46208c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075731 Sep 23 04:01:42.875266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2423/4740] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:42.888462 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-641bdf85-b015-4129-afa0-29d83a474eff tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.582934 Sep 23 04:01:42.897385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2318/4741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:42 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:43.009593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:43.010298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:43.017986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.018819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.019697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.020692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.021415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.022074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.596539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:43.598005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:43.616587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.618035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.619037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.624642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.626088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.627300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.799210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:43.812746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-408a2a8c-0a9f-41e9-8b72-7c71f85e7037 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 0.808316 Sep 23 04:01:43.819266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2424/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:43 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:43.835611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:43.836536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:43.844709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.845198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.845845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.846700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.847322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.847756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.869274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:43.882683 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-633e9adb-7e81-41d9-a377-f776714c58a1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1275 microversion: 2.1 time: 0.289806 Sep 23 04:01:43.886893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2319/4743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:43 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:43.916346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:43.918593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:43.938603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.944030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.945887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:43.947061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:43.947831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:43.948838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:44.096543 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bdd82d3f-05ef-4acc-a51b-0fcc410088d5 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1424 microversion: 2.1 time: 0.274351 Sep 23 04:01:44.097746 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2425/4744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:43 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1424 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:44.578410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:44.613473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91bc6e53-6689-4547-9977-72b8ae6b956f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.700792 Sep 23 04:01:44.619321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2320/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:43 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:44.843660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:44.844294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:44.853619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:44.854124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:44.854574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:44.866445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:44.866966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:44.867591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:44.906758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb96c544-7291-4c8e-94c8-57a896a97501", "name": "network-vif-unplugged", "status": "completed", "tag": "1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:44.925485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:44.929418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:44.930043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:44.954328 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] Creating event network-vif-unplugged:1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9 for instance fb96c544-7291-4c8e-94c8-57a896a97501 on n-h2-858495-2 Sep 23 04:01:44.979585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1498ef88-d63b-443d-abbf-169bbae62452 req-181063fd-48af-4778-97f1-1109aff6443a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077226 Sep 23 04:01:44.980565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2321/4746] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:01:44.987233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:44.988102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:45.009466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:45.009972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:45.010416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:45.011147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:45.012249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:45.012685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:45.994191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:46.018264 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa70d485-a471-4d58-b7e5-82a3238d779a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1315 microversion: 2.1 time: 1.178758 Sep 23 04:01:46.023136 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2426/4747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:44 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1315 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:46.036238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:46.036975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:46.044403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.046257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.046891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.047819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.048454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.049337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.248225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:46.270358 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ba98020-6507-403c-8785-d85be55dd567 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 1.288198 Sep 23 04:01:46.273455 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2322/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:44 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:46.299382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7e88f7a-a4e9-45a5-b1f5-d934395532d9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1422 microversion: 2.1 time: 0.274094 Sep 23 04:01:46.302866 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2427/4749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:46 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1422 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:46.305895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:46.306778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:46.314975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0d5ef7-7e43-4405-a774-386d2619ed49", "tag": "925a9683-8b0f-4a22-bb20-80af2da4a9f8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:46.324359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.325782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.329755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.332503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.333271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.334313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.334468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.335082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.335702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.392844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] Creating event network-changed:925a9683-8b0f-4a22-bb20-80af2da4a9f8 for instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 on n-h1-858495-2 Sep 23 04:01:46.413449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7127f5ce-bfb2-448b-a790-f4571ee609a9 req-9d9ca05b-c7d1-447f-9ae8-b1ac3cc8c8fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106727 Sep 23 04:01:46.416578 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2428/4750] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:46.428985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb96c544-7291-4c8e-94c8-57a896a97501", "name": "network-vif-deleted", "tag": "1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:46.456585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:46.457247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:46.458300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:46.476749 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] Creating event network-vif-deleted:1a5d73ba-ec26-405f-9ce7-9fe9da3eb1a9 for instance fb96c544-7291-4c8e-94c8-57a896a97501 on n-h2-858495-2 Sep 23 04:01:46.482231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2f076b23-c289-4fbb-a021-4e6c6c5c2b38 req-3a3e399c-e58b-4209-ad6e-337760196c1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062582 Sep 23 04:01:46.483372 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2429/4751] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:46.711264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:46.733585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ac667a28-3cd9-4dc3-95e9-3428854c7fc7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.456677 Sep 23 04:01:46.734689 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2323/4752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:46 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:47.010522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "name": "network-vif-plugged", "status": "completed", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:47.049924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:47.050262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:47.050433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:47.050812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:47.050984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:47.072579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:47.073259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:47.075318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:47.078673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:47.079507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:47.080168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:47.085967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] Creating event network-vif-plugged:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h2-858495-2 Sep 23 04:01:47.102113 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8771820a-259a-4287-a064-a09812bef9d6 req-f50a7789-730d-4c0f-90c4-51b95095652a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096853 Sep 23 04:01:47.103449 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2430/4753] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:47.308331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:47.313338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:47.356070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:47.358687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:47.359527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:47.360671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:47.361479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:47.373678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:47.644656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:48.004463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:48.025249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84f1612a-745d-4130-a18e-dd172c4b003a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1502 microversion: 2.1 time: 0.979355 Sep 23 04:01:48.039317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:48.044874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2324/4754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:47 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1502 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:48.061722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:48.061980 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a37b2c7-da7e-4e22-83d5-1137856a0b45 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.755434 Sep 23 04:01:48.062713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:48.062897 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2431/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:47 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:48.068399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:48.070336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:48.076503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.078866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.079373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.079506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.081236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.081649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.082377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.082941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.083301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.083670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.084134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.084561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.112756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:48.665344 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f994a5b-491e-4f9b-9e56-2bb4a7b2efd9 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.619337 Sep 23 04:01:48.683125 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2325/4756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:48 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:48.688638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:48.689139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:48.696178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.696931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.697728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.699386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.700315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.700966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.776376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:48.783076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0bac395-1d61-480f-b581-c5c8dc5f68e9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.718795 Sep 23 04:01:48.783678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2432/4757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:48 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:48.788987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:48.789561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:48.807085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.807600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.808084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.809212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.809717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.810153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.838476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lazy-loading 'services' on Instance uuid e70d54db-21cd-4c0c-ab41-2a7828f6ea3b {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:01:48.880360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:48.885278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:48.887857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:48.917798 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3da31bb8-6136-4fc1-a4bf-d4d80c7ed455 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7/action" status: 202 len: 0 microversion: 2.1 time: 0.132086 Sep 23 04:01:48.921829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2433/4758] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:48 2022] POST /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:01:48.927859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53bf471-a8cc-4938-80bd-72c96d046eb0", "tag": "0702e0a4-79d5-47a0-934a-eb9c14209f51"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:48.945717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:48.946405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:48.946932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:48.968406 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] Creating event network-changed:0702e0a4-79d5-47a0-934a-eb9c14209f51 for instance e53bf471-a8cc-4938-80bd-72c96d046eb0 on n-h1-858495-2 Sep 23 04:01:48.978723 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-981b38b4-1200-4976-a380-69fabf3dff10 req-e9fd51ed-8036-4c75-a7d6-368dea74c2ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056597 Sep 23 04:01:48.979328 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2434/4759] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:48.988531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:48.989806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:48.999409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.000232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.000821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.001787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.002422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.003012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.012354 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75b50b1f-0ec5-4aed-a1d1-c322e4c9e3f2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments/76d35beb-4683-42dd-bd92-89b2ad0bdd0a" status: 202 len: 0 microversion: 2.1 time: 0.324340 Sep 23 04:01:49.017133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2326/4760] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:01:48 2022] DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments/76d35beb-4683-42dd-bd92-89b2ad0bdd0a => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:01:49.025426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:49.028969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:49.038081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.038844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.039383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.040621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.041413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.042099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.118835 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68f241bb-0df2-4712-8e5a-2c6c4bbc9429 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099571 Sep 23 04:01:49.121873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2327/4761] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:49 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:49.135239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:49.139854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:49.154671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.155279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.157692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.158700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.160334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.161690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.598554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:49.609065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a05ead3-8b6f-4cf4-b3f0-710cdb3645e4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1507 microversion: 2.1 time: 0.628150 Sep 23 04:01:49.609684 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2435/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:48 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:49.690097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:49.691090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:49.703107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.703925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.704609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.705338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:49.705819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:49.711581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:49.721953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:50.321627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:50.333903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21c04ac5-b2c9-429f-a7fa-26389a353dfc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 1.210622 Sep 23 04:01:50.349390 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2328/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:49 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:50.349390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:50.349390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:50.360082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.360588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.361030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:50.361797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.362262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.362698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:50.688525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:50.696947 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8178234d-f94b-47fa-bdec-a7a3e9fdd752 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1517 microversion: 2.1 time: 0.357399 Sep 23 04:01:50.709747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2329/4764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:50 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:50.720866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:50.724042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:50.744863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.745920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.746375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:50.750228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.750881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.762372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:50.801492 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2c11d860-61b9-4431-8d6d-23deb3558c27 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 1.115081 Sep 23 04:01:50.813535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2436/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:49 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:50.822344 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90214082-b08e-45a4-9998-36b905dcc553 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111356 Sep 23 04:01:50.824070 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2330/4766] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:50 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:50.831498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:50.832429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:50.839293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.848129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.851933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:50.854391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:50.855132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:50.855742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.117890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7003e6d2-598a-4e33-8df2-627b5b414b42", "tag": "c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:51.135258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:51.145437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a29b88d-e237-4344-af09-f429bb82053f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1487 microversion: 2.1 time: 0.330475 Sep 23 04:01:51.148668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2437/4767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:50 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:51.164703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.165428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.166182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.175917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:51.177533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:51.196890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] Creating event network-changed:c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb for instance 7003e6d2-598a-4e33-8df2-627b5b414b42 on n-h2-858495-2 Sep 23 04:01:51.198236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.199813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.200829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.201751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.203715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.205008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.208945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b2bd9611-0f62-42f5-8484-3393cac9deee req-744d62e9-fd47-48b3-a559-072c9addb1d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093695 Sep 23 04:01:51.212542 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2331/4768] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:51.274016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lazy-loading 'flavor' on Instance uuid 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:01:51.366275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:51.367064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:51.381593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.384255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.384915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.386242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.386890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.387505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.622090 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc126a48-04ba-40d9-9f01-a02c1e0d4338 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7/action" status: 202 len: 0 microversion: 2.1 time: 0.452784 Sep 23 04:01:51.624116 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2438/4769] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:51 2022] POST /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:01:51.635885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:51.637563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:51.659681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.660739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.661822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:51.662815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:51.663480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:51.665741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.116389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:52.138927 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-590ec627-a56d-4fce-b0cf-af31410a2eae tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.777010 Sep 23 04:01:52.140401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2332/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:51 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:52.146044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:52.147258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:52.155610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.156376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.157537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.159350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.160700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.161497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.298569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:52.314057 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ebb2f056-4b6b-47f8-b63d-b26db2fc0c2e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1493 microversion: 2.1 time: 0.682163 Sep 23 04:01:52.325376 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2439/4771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:51 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1493 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:52.325376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:52.334954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:52.355674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.358248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.358748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.362715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.363201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.363637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.478441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fff0a83f-b77b-4432-a5e2-1c2438f376f0 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154261 Sep 23 04:01:52.479810 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2440/4772] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:52 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:52.503946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:52.504786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:52.512953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.513816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.514599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.515544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.516216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.516879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.845547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:52.868584 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-86c95e78-ad6f-4c27-85f7-c2df1f5075c9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.726676 Sep 23 04:01:52.892712 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2333/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:52 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:52.901225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0d5ef7-7e43-4405-a774-386d2619ed49", "name": "network-vif-plugged", "status": "completed", "tag": "925a9683-8b0f-4a22-bb20-80af2da4a9f8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:52.937667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.939131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.941415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.944583 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7806163-8479-427f-a0b2-94243b580e0f tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.457525 Sep 23 04:01:52.949083 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2441/4774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:52 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:52.961204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:52.962149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:52.988788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.989765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.990408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:52.992702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:52.993440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:52.994043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:53.003974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] Creating event network-vif-plugged:925a9683-8b0f-4a22-bb20-80af2da4a9f8 for instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 on n-h1-858495-2 Sep 23 04:01:53.032152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0fb9db77-b1f0-4ddf-af51-7a942f1895bb req-114817c4-a4d3-40b0-9490-e40b885c2eae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125790 Sep 23 04:01:53.038332 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2334/4775] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:53.164145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:53.164859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:53.180299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:53.180986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:53.181467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:53.182206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:53.182695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:53.183139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:53.718329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:53.729694 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d3bbb7f-8941-436b-96a0-5982cbcd9660 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.775945 Sep 23 04:01:53.733685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2442/4776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:52 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:53.742408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:53.743252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:53.771735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:53.772464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:53.773075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:53.774056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:53.774743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:53.778782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:53.950341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:53.958851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6b2adfa-136f-427e-b730-3f7cd5941b92 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.799301 Sep 23 04:01:53.968900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2335/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:53 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:53.974204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:53.985084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:54.009635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.010308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.011495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.012250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.012726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.013168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.076921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ce8a36f-f901-4a2e-b6bf-8ab6ce91477c tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106464 Sep 23 04:01:54.082824 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2336/4778] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:53 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:54.098075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:54.103611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:54.126532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.127680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.128141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.128873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.129342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.133633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.142264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:54.151794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ce49a86-06b9-40d1-8e2a-9ae750fb0ed0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1514 microversion: 2.1 time: 0.416659 Sep 23 04:01:54.155482 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2443/4779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:53 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:54.174989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:54.175978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:54.185413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.198144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.199027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.200009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.200737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.201406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.475448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a2ff7a69-62d7-40e8-8dc1-18d6b6f31ccf tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.316495 Sep 23 04:01:54.478830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2444/4780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:54 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:54.524881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:54.545505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce2c2158-8734-4463-bf16-85c673cc6f40 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.461231 Sep 23 04:01:54.546298 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2337/4781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:54 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:54.574533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae13693d-7410-4e59-b36e-5b217c390bf8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:54.588122 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ae13693d-7410-4e59-b36e-5b217c390bf8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae13693d-7410-4e59-b36e-5b217c390bf8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/fe992f94-d3cc-4208-ba4f-23bb735cc544/action HTTP/1.1 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 15 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: {"os-stop": {}} Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'fe992f94-d3cc-4208-ba4f-23bb735cc544', 'body': {'os-stop': {}}} Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:01:54.605271 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ae13693d-7410-4e59-b36e-5b217c390bf8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance fe992f94-d3cc-4208-ba4f-23bb735cc544 has no mapping to a cell. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ae13693d-7410-4e59-b36e-5b217c390bf8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/fe992f94-d3cc-4208-ba4f-23bb735cc544/action" status: 404 len: 117 microversion: 2.1 time: 0.037239 Sep 23 04:01:54.611141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2445/4782] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:54 2022] POST /compute/v2.1/servers/fe992f94-d3cc-4208-ba4f-23bb735cc544/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:01:54.617578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:54.618278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:54.627822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.628328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.628772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.629536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:54.630008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:54.630436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:54.981918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:54.991335 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6a21a55-5f53-4b3d-8728-1c7503b0d03e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.377669 Sep 23 04:01:54.991931 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2338/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:54 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:55.011732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:55.013040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:55.017879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:55.018774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:55.027362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.028999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.029640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.030541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.031267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.031985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.040623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.041128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.041612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.045760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.046302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.046764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.472412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:55.504484 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-288dd825-6ad2-474c-a52f-22a6de36f99e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.487627 Sep 23 04:01:55.521441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2339/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:55 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:55.527622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:55.534628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:55.541417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.542479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.543178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.544124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.544954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.545805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.589306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89486399-e730-4327-881c-ea8e5a3bb35b tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066050 Sep 23 04:01:55.590114 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2340/4785] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:55 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:55.595790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:55.596571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:55.607651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.608889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.609597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.611573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.612342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.614054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.649555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:55.658985 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b234274b-72ac-4041-8862-6382241885cc tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.667093 Sep 23 04:01:55.663332 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2446/4786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:54 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:55.679082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:55.679931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:55.686637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.694230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.694915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:55.696080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:55.696736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:55.697333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.092136 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a579680-91a4-4c6f-ba00-c62a5771de7c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.427505 Sep 23 04:01:56.096062 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2447/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:55 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:56.106265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:56.110627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 6535792c-59e3-4e3c-a4f6-f041a691f2d3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:56.128273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/6535792c-59e3-4e3c-a4f6-f041a691f2d3/action HTTP/1.1 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 15 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: {"suspend": {}} Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6535792c-59e3-4e3c-a4f6-f041a691f2d3', 'body': {'suspend': {}}} Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:01:56.130866 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:01:56.136164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:01:56.136164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:01:56.136164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. Sep 23 04:01:56.136164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:01:56.145965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 6535792c-59e3-4e3c-a4f6-f041a691f2d3 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:01:56.147207 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-533b90eb-2ea5-4a85-baf5-463a03a958d7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/6535792c-59e3-4e3c-a4f6-f041a691f2d3/action" status: 404 len: 111 microversion: 2.1 time: 0.049863 Sep 23 04:01:56.153425 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2448/4788] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:56 2022] POST /compute/v2.1/servers/6535792c-59e3-4e3c-a4f6-f041a691f2d3/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:01:56.166506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:56.168080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:56.186040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.188259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.189022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.193161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.196082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.196704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.293592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:56.301721 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad3103b8-6bd1-4b38-9f69-250ae30e29ef tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1514 microversion: 2.1 time: 0.710442 Sep 23 04:01:56.306099 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2341/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:55 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:56.585366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:56.595019 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6935c71e-6653-41da-b2dd-8fed0b784cfb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.440136 Sep 23 04:01:56.605874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:56.610959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:56.614794 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2449/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:56 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:56.640719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.640900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:56.641573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.642349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.642561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:56.643699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.644753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.645342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.659900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.660399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.660845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.661594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.662055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.662505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.687002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:56.690969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95640eba-dde9-4ba9-b707-7b772111f789 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092859 Sep 23 04:01:56.692052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2342/4791] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:56 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:01:56.699190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:56.702789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:56.705391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:56.726309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.727600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.728080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:56.728957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:56.729513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:56.730471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.025318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:57.033304 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-143b81f3-df9f-428a-b794-e503e9290d93 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.339932 Sep 23 04:01:57.046341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2343/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:56 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:57.051898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53bf471-a8cc-4938-80bd-72c96d046eb0", "name": "network-vif-plugged", "status": "completed", "tag": "0702e0a4-79d5-47a0-934a-eb9c14209f51"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:57.063596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.064613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.065612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.082926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:57.084561 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] Creating event network-vif-plugged:0702e0a4-79d5-47a0-934a-eb9c14209f51 for instance e53bf471-a8cc-4938-80bd-72c96d046eb0 on n-h1-858495-2 Sep 23 04:01:57.091401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-59455327-92d5-4246-878e-4c71c89a56dc req-e390c4f6-8951-4288-ae50-d0137a8b7c2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043824 Sep 23 04:01:57.093113 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2344/4793] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:57.099732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa57ebfd-fdcc-46f7-92ed-2a1c4e0bb144 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.461425 Sep 23 04:01:57.107014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2450/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:56 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:57.123899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:57.125479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:57.128901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:57.129733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:57.138965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.139529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.139912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.140594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.141054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.151811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.155536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.158143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.159493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.161010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.162545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.163281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.200216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lazy-loading 'flavor' on Instance uuid 97379c08-f144-4054-a9b9-f7a548e2a061 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:01:57.456685 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5de7380-397e-46e2-8e82-ee031324e7cb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.329871 Sep 23 04:01:57.464749 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2451/4795] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:01:57 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:01:57.482086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:57.483089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:57.500013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.500833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.503364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.505135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.506202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.508058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.674191 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b394a726-e786-4d27-a76c-84d1256e58ec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.555064 Sep 23 04:01:57.678924 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2345/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:57 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:57.703141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:57.708183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:57.727148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.727616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.728073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.728796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.729262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.748110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.922811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:57.933331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-00e52f55-b992-4c6c-ba8d-71c3eddc8dc2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1514 microversion: 2.1 time: 0.465119 Sep 23 04:01:57.934143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2452/4797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:57 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1514 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:57.956624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:57.959274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:57.966206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.966937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.967571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:57.968436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:57.969054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:57.969665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.026533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:58.042650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-380eb9c9-b71a-4519-89da-ce8741fc0062 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1512 microversion: 2.1 time: 0.361783 Sep 23 04:01:58.043844 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2346/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:57 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:58.217186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db404208-40fa-4a26-b39f-08e5432aed3e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: .version_select at 0x7f0c8a7e10d0>, body: {"keypair": {"name": "tempest-keypair-1375994308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmwS+rb2WmSdJcyHOlOUxTG3GD1JyDbPzMu9be4uwSdxbyS8RImeiQnwbiehItvw0TsmDw0OqonvpJBMB2jHnrfdAV7AMrVw5gV0eInzDbMZDvPModCcYonTSYHPn1a8A=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:58.237951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-db404208-40fa-4a26-b39f-08e5432aed3e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:01:58.245541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-db404208-40fa-4a26-b39f-08e5432aed3e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for user 0965ea0e7b6b4e1e86d9c7052130478d and project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:01:58.279452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db404208-40fa-4a26-b39f-08e5432aed3e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.234361 Sep 23 04:01:58.281038 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2347/4799] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 04:01:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:01:58.291466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:58.293189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:58.302079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.302574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.303023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.303741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.304650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.305090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.316695 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ab0c9c3-e591-4b3d-b601-8f3d255cba81 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.369739 Sep 23 04:01:58.318000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2453/4800] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:01:57 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b/os-volume_attachments => generated 25 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:01:58.401959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:58.402723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:58.408967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.409711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.410299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.411707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.412368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.412958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.446588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:01:58.568164 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bb5eb5e-0561-462d-9398-0d84a67034dc tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 204 len: 0 microversion: 2.1 time: 0.169645 Sep 23 04:01:58.572554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2454/4801] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:01:58 2022] DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:01:58.579709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:58.580513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:58.588081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.588718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.589387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.590385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.591080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.591583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.601867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:58.624039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87e2527f-5f11-471f-899b-6e77c70716ad tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1317 microversion: 2.1 time: 0.341428 Sep 23 04:01:58.624671 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2348/4802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:58 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:58.705060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:58.705900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:58.710587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:01:58.722018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.722845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.723437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:58.724765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:58.725577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:58.726666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.275626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:59.286707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8135264e-d233-48c0-9697-4b2b6740184f tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1680 microversion: 2.1 time: 0.712670 Sep 23 04:01:59.290239 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2455/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:58 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1680 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:59.302270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31185fb8-0a9c-466a-9513-320e128d1b54 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.601748 Sep 23 04:01:59.305765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:59.310204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:59.311256 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2349/4804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:58 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:01:59.320956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.321618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:59.321870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:59.322576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.324569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.325662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.327167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.327863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.337962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.338470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.338971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.340049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.340733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.341329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.555506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:59.587138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-554b41fb-2ab4-429a-9f0c-c9daf16aff70 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1514 microversion: 2.1 time: 0.295018 Sep 23 04:01:59.593976 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2456/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:59 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:59.598006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:59.599139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e804563-e91b-4bb5-ad25-ea6bc66a7be7", "name": "network-vif-plugged", "status": "completed", "tag": "20936caf-6723-490a-ae6b-f9dfe1230659"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:01:59.613334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.613855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.614291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.614791 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53a52ed3-a26c-405b-b4fe-9ac4f5ac087c tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1512 microversion: 2.1 time: 0.297875 Sep 23 04:01:59.616356 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2350/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:59 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:59.627791 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] Creating event network-vif-plugged:20936caf-6723-490a-ae6b-f9dfe1230659 for instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 on n-h2-858495-2 Sep 23 04:01:59.633710 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-86273e90-fb01-49e7-b950-04aa34ea3c00 req-fc9a0f48-2d9d-46e4-b2f6-0dd44e0730bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038182 Sep 23 04:01:59.634778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2457/4807] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:01:59.654574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:59.655114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:59.662537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.663740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.665397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.666130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.666598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.667077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.849956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:01:59.859745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4800c34-398a-4ca5-aeb5-1ea5f6f87620 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 200 len: 1504 microversion: 2.1 time: 0.209314 Sep 23 04:01:59.860889 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2351/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:59 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:01:59.884213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:01:59.884933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:01:59.897837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.898470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.898987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:01:59.899932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:01:59.900474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:01:59.901379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.090184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:00.102853 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ce80b758-8791-4285-ac62-f250add2d746 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 200 len: 1504 microversion: 2.1 time: 0.222698 Sep 23 04:02:00.119096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2458/4809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:01:59 2022] GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:00.134562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:00.137916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:00.150240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.150724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.157075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.157880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.160560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.162874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.194984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:00.316400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:00.318032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:00.329046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.330310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.331371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.334194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.334760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.335301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.347561 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ec13f5b-8113-46a4-ad48-548b97623c99 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 204 len: 0 microversion: 2.1 time: 0.211816 Sep 23 04:02:00.349982 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2352/4810] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:00 2022] DELETE /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:02:00.357899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:00.359769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:00.369075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.369875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.371277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.372567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.373197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.373811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.585707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:00.594866 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b7c9b42-cbcc-428c-9be4-26deff187780 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1680 microversion: 2.1 time: 0.283586 Sep 23 04:02:00.615388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2459/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:00 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:00.619585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0e712eb-e561-4929-8033-b371da1fc7c6 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 0.267116 Sep 23 04:02:00.620788 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2353/4812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:00 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:00.630844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1462068537", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "474c3e0a-9069-4379-9e43-e3c990d5e5d7"}], "security_groups": [{"name": "tempest-securitygroup--1502732407"}], "key_name": "tempest-keypair-1375994308", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:00.652626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:00.653142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:00.670611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.671059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.671511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.672239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.672700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.673136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.707173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:00.816048 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e6c426c-53c7-4efa-94d6-cefb11cc4d86 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 204 len: 0 microversion: 2.1 time: 0.181027 Sep 23 04:02:00.820576 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2354/4813] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:00 2022] DELETE /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:02:00.827012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:00.827981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:00.836426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.838022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] validate_networks() for [('474c3e0a-9069-4379-9e43-e3c990d5e5d7', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:02:00.838703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.839365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:00.840285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:00.841294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:00.841987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.293495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:01.305265 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51d33424-9110-4aeb-a1b0-7ae80e5c2d27 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.483101 Sep 23 04:02:01.305926 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2355/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:00 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:01.314294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:01.318512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:01.330803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.331563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.332176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.333060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.334110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.335743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.800605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:01.809660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d87837f-5acc-4118-902a-061c9d55e6f7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1495 microversion: 2.1 time: 0.502491 Sep 23 04:02:01.816621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2356/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:01 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1495 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:01.842332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:01.843399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:01.851164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.852428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.853677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.855239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.856075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.856648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.900772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:02:01.901797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:02:01.902274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:02:01.902679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:02:01.903088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:01.934294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:01.983223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:02:01.990074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for user 0965ea0e7b6b4e1e86d9c7052130478d and project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:02:02.026693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:02:02.029028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:02:02.082884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:02.139113 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3c5f3fc-3eaa-4cd5-9e45-143bf7bd156d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.522234 Sep 23 04:02:02.142518 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2460/4816] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 04:02:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:02:02.148753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:02.149588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:02.171962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:02.173402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.173934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.174545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:02.175590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.177806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.178462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.185340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.188183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9d41902-927d-44fc-8fc6-1add2459493a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 200 len: 1510 microversion: 2.1 time: 0.370028 Sep 23 04:02:02.194131 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2357/4817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:01 2022] GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:02.203683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:02.205171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:02.229957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.234118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.234856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.235330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.236016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.236637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.384045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:02.403807 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8bd0a615-1bb6-42f6-ac51-c4bdab02b8ca tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1613 microversion: 2.1 time: 0.258504 Sep 23 04:02:02.404619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2461/4818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:02 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1613 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:02.431560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7003e6d2-598a-4e33-8df2-627b5b414b42", "name": "network-vif-plugged", "status": "completed", "tag": "c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:02.470883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.471859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.473487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.493381 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] Creating event network-vif-plugged:c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb for instance 7003e6d2-598a-4e33-8df2-627b5b414b42 on n-h2-858495-2 Sep 23 04:02:02.499705 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4120121a-9bec-4ddf-ab83-f390250b9f8d req-72b42461-aa37-4f37-b81a-12854100bc5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076932 Sep 23 04:02:02.500616 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2462/4819] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:02.506549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:02.509826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:02.514671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.515170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.515613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.516422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:02.516767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:02.517197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:02.587751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lazy-loading 'flavor' on Instance uuid 97379c08-f144-4054-a9b9-f7a548e2a061 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:02:02.628785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'suspend' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state suspended Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 15 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: {"suspend": {}} Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot 'suspend' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state suspended Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'suspend': {}}} Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 23 04:02:02.630588 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state suspended Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state suspended Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'suspend' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state suspended {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaefb2f0-5a79-4878-bd01-ce37cd8d40e8 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 148 microversion: 2.1 time: 0.129913 Sep 23 04:02:02.636399 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2463/4820] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:02 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 148 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:02:02.658923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:02.659834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:03.071376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:03.084021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:03.088236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:03.094304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc115dad-884a-4395-80b7-c797e14570b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1282 microversion: 2.20 time: 0.456154 Sep 23 04:02:03.095322 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2464/4821] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:02 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1282 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:03.103388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:03.105696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:03.127806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.128976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.131481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:03.133036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.133705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.135778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:03.659123 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcdb95e6-d4ec-4f33-b4ac-e66efeaf882d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1464 microversion: 2.1 time: 1.460918 Sep 23 04:02:03.678016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2358/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:02 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1464 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:03.695437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:03.697086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:03.714985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.718626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.728149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:03.728899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.730811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.732641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:03.919017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6518ec95-a2a5-4002-9e82-03ff413e6be4 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 202 len: 0 microversion: 2.1 time: 0.239503 Sep 23 04:02:03.923033 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2359/4823] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:03 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:02:03.935473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:03.936184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:03.961673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.962572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.963269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:03.964997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:03.966902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:03.967670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.477296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:04.494489 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc0bb682-76f7-4647-87e4-1efcee4bc779 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 1.397835 Sep 23 04:02:04.510329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2465/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:03 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:04.522015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:04.523139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:04.529820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.533265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.535697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.537584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.539258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.543762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.559796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:04.579802 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-960b9346-a97b-4a00-a80d-c6c732a7e27a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 200 len: 1510 microversion: 2.1 time: 0.654967 Sep 23 04:02:04.580827 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2360/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:03 2022] GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:04.601875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:04.604657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:04.627635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.631094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.631843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.635583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.636483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.637302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.871785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310efb884806402cbea5f65238e91188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767515854d364c4fa516f4a4685254b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:04.876968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:04.887370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01182a6e-5a1b-428f-b779-0dc33360aa97 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 200 len: 1613 microversion: 2.1 time: 0.375024 Sep 23 04:02:04.893274 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2466/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:04 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 1613 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:04.898375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:04.903397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:04.919411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.924377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.925142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:04.926093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:04.926746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:04.929166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:05.472509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:05.497566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:05.511453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:05.514809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1bc1d6c6-f5cb-4caf-ae41-984320242ebb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1342 microversion: 2.20 time: 0.620172 Sep 23 04:02:05.534002 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2467/4827] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:04 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1342 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:05.545277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53bf471-a8cc-4938-80bd-72c96d046eb0", "name": "network-vif-deleted", "tag": "0702e0a4-79d5-47a0-934a-eb9c14209f51"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:05.591707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:05.592298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:05.592634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:05.666695 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] Creating event network-vif-deleted:0702e0a4-79d5-47a0-934a-eb9c14209f51 for instance e53bf471-a8cc-4938-80bd-72c96d046eb0 on n-h1-858495-2 Sep 23 04:02:05.676700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-833dfe5c-1579-4a5a-a4bb-01d635da49f0 req-a8e5372d-e3bd-455b-b773-46eec44f6af4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141304 Sep 23 04:02:05.689125 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2468/4828] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:05.697661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70d54db-21cd-4c0c-ab41-2a7828f6ea3b", "name": "network-vif-deleted", "tag": "543bd5ff-e768-44be-b1da-6f15bf6e8547"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:05.729564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:05.730360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:05.730907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:05.752939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] Creating event network-vif-deleted:543bd5ff-e768-44be-b1da-6f15bf6e8547 for instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b on n-h2-858495-2 Sep 23 04:02:05.781689 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-01f51ad7-7cc6-4517-8e21-c29292dffe09 req-9141dd2c-6361-4476-a183-9cb85cdae87d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090626 Sep 23 04:02:05.783235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2469/4829] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:05.796930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:05.797982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:05.827450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:05.828181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:05.831575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:05.837454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:05.837962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:05.838458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.159584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:06.169265 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe4e0467-61c3-4e07-b23d-880d78a9ba1b tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1501 microversion: 2.1 time: 1.586364 Sep 23 04:02:06.178230 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2361/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:04 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1501 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:06.195296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:06.201255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:06.217481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.218491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.219182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.220170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.220914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.221649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.404117 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d971060-9dea-4494-832e-2e8993775c94 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1649 microversion: 2.1 time: 0.618176 Sep 23 04:02:06.404732 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2470/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:05 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1649 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:06.439580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:06.440368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:06.501291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.509311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.509903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.510711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.511190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.511623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.826249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30310d9408a4ccd84ad6c2231b38677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e31e5073fb7413bbdc465e51ceb45ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:06.836986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-594fd1a7-d5eb-4154-8370-e3aba311d14a tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 200 len: 1468 microversion: 2.1 time: 0.431144 Sep 23 04:02:06.840771 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2471/4832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:06 2022] GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:06.852492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:06.856028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:06.878001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.881096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.883212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.889422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.890233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.890934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.937428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b HTTP/1.1 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e70d54db-21cd-4c0c-ab41-2a7828f6ea3b'} Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:06.950441 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:06.954976 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:06.957229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:06.965702 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88ba584a-96a7-4dcf-a183-5646dbae3ed4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 404 len: 111 microversion: 2.1 time: 0.120192 Sep 23 04:02:06.966718 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2472/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:06 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:06.974836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:06.977618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:06.995490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:06.996658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:06.997339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:06.999359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:07.000261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:07.001881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.031671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:08.044053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd08a757-3e4c-4a37-89a3-0125e20c1cf8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 1.864212 Sep 23 04:02:08.045395 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2362/4834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:06 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:08.050824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:08.051751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:08.058665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.059458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.060110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.061072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.061800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.062447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.253989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:08.340319 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-519fd4ed-43a7-4d0f-b3fe-149cee918fec tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1649 microversion: 2.1 time: 1.371961 Sep 23 04:02:08.344154 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2473/4835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:06 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1649 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:08.357911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d39a256-7112-4eaf-bdda-b1c8ba1a6444 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '.version_select at 0x7f0c8a8e2700>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:08.369186 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8d39a256-7112-4eaf-bdda-b1c8ba1a6444 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:02:08.524702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:08.537865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:08.539928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:08.541748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad2b9aec-1c8d-47a7-920c-c33a5125038c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1408 microversion: 2.20 time: 0.494862 Sep 23 04:02:08.543094 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2363/4836] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:08 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:08.550151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:08.551655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:08.559240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.560097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.561611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.562679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.563471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.564345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.799200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:08.812243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a22b4b1-8040-4d77-9afc-de8c8d5e203d tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1501 microversion: 2.1 time: 0.267147 Sep 23 04:02:08.813272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2364/4837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:08 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1501 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:08.825715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:08.826703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: 8a0d5ef7-7e43-4405-a774-386d2619ed49] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:08.853027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.854346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.855817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.858333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.860512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.861781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:08.929472 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] HTTP exception thrown: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Request method failure captured: Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 HTTP/1.1 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS98nazO2VHq68QGOm9LTyENR_dJs9_0b4EUGUFXfd2SOhs7Wsfby19Rh6jQbat9gZ15pUkaj9JOP11oBUOnDPjvPsTXvYKrsj_Ps3YoxQG6vXghDE7AtzBLW9Kp0AT88-zz__3vsbH72Z971RcigAEpY-rPAD9uoZDXBoO3pDVeZA8 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 7e31e5073fb7413bbdc465e51ceb45ac Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 7e31e5073fb7413bbdc465e51ceb45ac Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MultipleCreateTestJSON-828759974-project Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: a30310d9408a4ccd84ad6c2231b38677 Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MultipleCreateTestJSON-828759974-project Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8a0d5ef7-7e43-4405-a774-386d2619ed49'} Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:08.938873 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. Sep 23 04:02:08.943420 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:08.943890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Returning 404 to user: Instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:08.944441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e37f047-5644-4abc-aa07-3e47c9e595ba tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49" status: 404 len: 111 microversion: 2.1 time: 0.129869 Sep 23 04:02:08.945026 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2365/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:08 2022] GET /compute/v2.1/servers/8a0d5ef7-7e43-4405-a774-386d2619ed49 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:08.958760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0d5ef7-7e43-4405-a774-386d2619ed49", "name": "network-vif-deleted", "tag": "925a9683-8b0f-4a22-bb20-80af2da4a9f8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:08.975328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:08.975834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:08.976256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.010877 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] Creating event network-vif-deleted:925a9683-8b0f-4a22-bb20-80af2da4a9f8 for instance 8a0d5ef7-7e43-4405-a774-386d2619ed49 on n-h1-858495-2 Sep 23 04:02:09.016580 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5ac05ca6-b713-4721-9f79-2de787fca84f req-2e420016-d51f-4035-818e-7f804e596be1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068688 Sep 23 04:02:09.021615 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2366/4839] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:09.027717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:09.028693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:09.036449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.037870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.039142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.040210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.040989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.042205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.203611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c30c07a4-1a75-42c0-8f39-2fff5cb23f9e tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1649 microversion: 2.1 time: 0.180476 Sep 23 04:02:09.208885 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2367/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:09 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1649 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:09.218010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:09.232018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.233226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.233911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.249917 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] Creating event network-changed:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:02:09.258247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f8717915-7197-475a-a88d-dbeaa3d4fed8 req-923fa795-2de6-4c23-afeb-157bbab6e9e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043387 Sep 23 04:02:09.259851 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2368/4841] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:09.266827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:09.267860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] [instance: e53bf471-a8cc-4938-80bd-72c96d046eb0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:09.277977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.279065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.279752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.281288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.282022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.282654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.303815 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] HTTP exception thrown: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Request method failure captured: Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 HTTP/1.1 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS98nazO2VHq68QGOm9LTyENR_dJs9_0b4EUGUFXfd2SOhs7Wsfby19Rh6jQbat9gZ15pUkaj9JOP11oBUOnDPjvPsTXvYKrsj_Ps3YoxQG6vXghDE7AtzBLW9Kp0AT88-zz__3vsbH72Z971RcigAEpY-rPAD9uoZDXBoO3pDVeZA8 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 7e31e5073fb7413bbdc465e51ceb45ac Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e31e5073fb7413bbdc465e51ceb45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 7e31e5073fb7413bbdc465e51ceb45ac Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-MultipleCreateTestJSON-828759974 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-MultipleCreateTestJSON-828759974-project Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: a30310d9408a4ccd84ad6c2231b38677 Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-MultipleCreateTestJSON-828759974-project Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e53bf471-a8cc-4938-80bd-72c96d046eb0'} Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:09.306187 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. Sep 23 04:02:09.313421 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:09.316538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] Returning 404 to user: Instance e53bf471-a8cc-4938-80bd-72c96d046eb0 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:09.319318 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13144f5c-1b3e-49b0-a9c3-a998f29a6ed1 tempest-MultipleCreateTestJSON-828759974 tempest-MultipleCreateTestJSON-828759974-project] 10.222.0.25 "GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0" status: 404 len: 111 microversion: 2.1 time: 0.056931 Sep 23 04:02:09.320475 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2369/4842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:09 2022] GET /compute/v2.1/servers/e53bf471-a8cc-4938-80bd-72c96d046eb0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:09.328322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:09.329736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:09.336353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.337211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.338699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.339688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:09.340386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:09.341033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:09.383793 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-8d39a256-7112-4eaf-bdda-b1c8ba1a6444 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 46166. Sep 23 04:02:09.453245 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d39a256-7112-4eaf-bdda-b1c8ba1a6444 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409776178" status: 202 len: 0 microversion: 2.1 time: 1.107057 Sep 23 04:02:09.454761 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2474/4843] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 04:02:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409776178 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:02:09.468967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1617978747", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "availability_zone": "nova:n-h1-858495-2", "networks": [{"uuid": "fe604c4b-19cd-4e8e-ae2f-6a4f8f22b12d"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:09.582040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] validate_networks() for [('fe604c4b-19cd-4e8e-ae2f-6a4f8f22b12d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:02:10.030669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:10.044116 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9656ef71-5d27-466e-a771-485b6bc73705 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.722310 Sep 23 04:02:10.062449 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2370/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:09 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:10.076023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:10.076681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:10.091236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:10.092094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:10.092744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:10.095769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:10.097588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:10.098972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:10.564328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:10.575515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:10.576981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:10.578187 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50318012-7bd7-4706-98a5-4ec9626636da tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1408 microversion: 2.20 time: 0.514381 Sep 23 04:02:10.613736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2371/4845] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:10 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:10.619450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:10.620360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:10.631042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:10.636843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:10.637593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:10.638520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:10.639148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:10.639759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.144134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:02:11.144697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:02:11.145039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:02:11.145945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:02:11.146688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:02:11.168204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.168699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.169137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.169894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.170348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.170774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.208212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Getting quotas for project bad7c943574a4726893a6b8e602df5be. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:02:11.214897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Getting quotas for user 3f7449d430fe4a28955560d740faf560 and project bad7c943574a4726893a6b8e602df5be. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:02:11.228315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:02:11.231589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:02:11.279107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:11.293113 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd7d79d2-85aa-43f4-aae3-e6cdf745763e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.676071 Sep 23 04:02:11.295157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2372/4846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:10 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:11.308061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:11.309555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:11.316077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfe400fc-1187-404d-84e7-f82e7d99a1d8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859877 Sep 23 04:02:11.317339 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2475/4847] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:02:11.325539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:11.326550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:11.333009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.333865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.334539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.335559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.336230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.337008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.341001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.343057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.343749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:11.346167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:11.346884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:11.348488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:12.046629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.064308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82e728a5-a2aa-4343-ba6d-89838558b699 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.742665 Sep 23 04:02:12.065050 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2476/4848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:11 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:12.091162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a2122859-65bd-4541-804a-02c42b95f57c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:12.091762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a2122859-65bd-4541-804a-02c42b95f57c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:12.154936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.165718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3703d976-49e7-4cef-a90c-f5d5aae5b3b4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.868199 Sep 23 04:02:12.167065 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2373/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:11 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:12.184588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:12.185244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:12.203706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:12.204219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:12.204661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:12.205440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:12.205904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:12.206340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:12.331552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a2122859-65bd-4541-804a-02c42b95f57c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1329 microversion: 2.1 time: 0.252687 Sep 23 04:02:12.333655 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2477/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:12 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1329 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:12.357956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:12.364378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:12.392737 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/5a2e62b2-51fc-4df1-ab04-dae0de2c10f7/action HTTP/1.1 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 15 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: {"unpause": {}} Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '5a2e62b2-51fc-4df1-ab04-dae0de2c10f7', 'body': {'unpause': {}}} Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:12.402409 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 5a2e62b2-51fc-4df1-ab04-dae0de2c10f7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:12.408061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54280722-489a-4f57-9a17-d3c7c60b7d51 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/5a2e62b2-51fc-4df1-ab04-dae0de2c10f7/action" status: 404 len: 111 microversion: 2.1 time: 0.069620 Sep 23 04:02:12.419526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2478/4851] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:12 2022] POST /compute/v2.1/servers/5a2e62b2-51fc-4df1-ab04-dae0de2c10f7/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:12.430153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:12.435340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:12.453514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:12.458475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:12.460731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:12.462028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:12.468986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:12.469583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:12.913849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.924736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.936467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.938333 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89b533e2-1193-4172-a8c4-ea6f71c2bcca tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1408 microversion: 2.20 time: 0.770310 Sep 23 04:02:12.939105 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2374/4852] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:12 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1408 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:12.982596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:12.999809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5a772db-db6c-44a2-9c6e-15f534163b49 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.578190 Sep 23 04:02:13.000669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2479/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:12 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:13.033133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:13.037956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:13.063727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:13.064236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:13.065918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:13.066643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:13.071821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:13.072320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:13.192277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:13.193471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:13.218724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:13.221326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:13.223148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:13.225866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:13.229788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:13.231376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.184640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:14.203760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e126a7cd-8aa5-4cec-b64e-679105753ab9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 1.182940 Sep 23 04:02:14.207457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2375/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:13 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:14.214693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:14.215619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:14.256538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.261475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.262102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.264086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.264780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.267316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.279066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:14.308004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:14.319840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b5f5459-e132-47c1-97c6-f66d0244e0cb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 1.132746 Sep 23 04:02:14.341667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2480/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:13 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:14.546399 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1dae61cc-72cc-40e0-828a-e24e03a52cb0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1422 microversion: 2.1 time: 0.337369 Sep 23 04:02:14.561524 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2376/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:14 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1422 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:14.576388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "name": "network-vif-plugged", "status": "completed", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:14.649298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.655914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.659865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.691314 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] Creating event network-vif-plugged:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:02:14.714586 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ee044d30-3d05-4003-bbd4-10b7d9b16aac req-a0624e13-f54a-4308-90a5-4ad280323300 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138693 Sep 23 04:02:14.715554 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2377/4857] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:14.758104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:14.759048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:14.799130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.800973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.801473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.802232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.802687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.813937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.900881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:14.901566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:14.924318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.925870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.927915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:14.934525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:14.938799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:14.939421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.012250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:15.185242 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9774d2f2-d921-460a-9f41-b2db3ced1244 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 204 len: 0 microversion: 2.42 time: 0.841530 Sep 23 04:02:15.189419 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2481/4858] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:02:14 2022] DELETE /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:02:15.199889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:15.200809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:15.209106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.209920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.210548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.211447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.212095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.212700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.246944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'unpause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 15 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: {"unpause": {}} Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot 'unpause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'unpause': {}}} Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state active. Cannot unpause while the instance is in this state. Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:15.249211 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:15.254273 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:15.254273 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:15.254273 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:15.254273 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:15.254273 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:15.255626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'unpause' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:15.258250 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52d7cf09-2011-4457-ab43-3430e51cd424 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 145 microversion: 2.1 time: 0.066079 Sep 23 04:02:15.259573 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2482/4859] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:15 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:02:15.265257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:15.266121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:15.273335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.274191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.274809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.275921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.276553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.277153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.783094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:15.797938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:15.805796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:15.807292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8543031-0ec7-4604-afe6-9430d4f1cd8d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1408 microversion: 2.20 time: 1.090017 Sep 23 04:02:15.808403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2378/4860] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:14 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1408 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:15.813420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:15.819327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:15.832576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.835605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.836393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:15.837412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:15.840913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:15.841642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.232676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:16.244442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e450f23e-df70-4c40-b2f1-0ebf9149fe13 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.434146 Sep 23 04:02:16.249168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2379/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:15 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:16.265881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:16.268506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:16.269981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:16.282122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:16.283880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:16.285330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0f3ccfe-d684-489c-ada0-694396f4c89c tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2959 microversion: 2.42 time: 1.024485 Sep 23 04:02:16.287156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.293873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.297539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.298592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.299295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.299972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.301859 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2483/4862] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:15 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2959 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:16.311319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:16.313711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:16.381631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.382358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.383000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.383936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.384666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.388556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.819955 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d574d915-459f-4d80-9ee2-c4ad4a1324c4 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.515578 Sep 23 04:02:16.821431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2484/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:16 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:16.834871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47dcf5f4-11dd-4747-a9ea-4b846babdbf6", "tag": "831a4441-d75c-4df6-9a63-df0e1ab9124f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:16.859950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.863477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.864116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.909406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:16.918391 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] Creating event network-changed:831a4441-d75c-4df6-9a63-df0e1ab9124f for instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 on n-h1-858495-2 Sep 23 04:02:16.924507 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd7490ed-dad5-4f19-8259-00c288f91458 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.672161 Sep 23 04:02:16.928545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-90c461b4-f906-495e-adf5-44dbb6f6fcad req-2b006d7c-b6c1-4349-9de3-10048a94b5ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104692 Sep 23 04:02:16.929927 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2485/4864] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:16.936855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:16.937770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:16.941839 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2380/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:16 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:16.946792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.947736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.948498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.949536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.951051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.951610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.954623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:16.955250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:16.972571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.973433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.974118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:16.975184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:16.976061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:16.976939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:17.590311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:17.616099 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9f6c5a4-2dc3-4419-b867-13f82c895f69 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.684472 Sep 23 04:02:17.623969 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2486/4866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:16 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:17.623969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:17.624604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:17.654922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:17.656392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:17.656861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:17.663685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:17.664215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:17.664670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:17.756910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:17.779607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:17.785316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:17.794238 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9110a9d9-d7cf-463a-85fd-a9fc0b00f573 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1408 microversion: 2.20 time: 0.847156 Sep 23 04:02:17.794848 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2381/4867] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:16 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1408 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:17.828624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:17.842299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: c2ed1ffb-2e28-4f3e-a918-3699853a2446] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:17.867140 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/c2ed1ffb-2e28-4f3e-a918-3699853a2446/action HTTP/1.1 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 18 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: {"unshelve": null} Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c2ed1ffb-2e28-4f3e-a918-3699853a2446', 'body': {'unshelve': None}} Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.869537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.874769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance c2ed1ffb-2e28-4f3e-a918-3699853a2446 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:17.882348 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5056317-0716-4d71-9745-918b78823ac9 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/c2ed1ffb-2e28-4f3e-a918-3699853a2446/action" status: 404 len: 111 microversion: 2.1 time: 0.069206 Sep 23 04:02:17.882946 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2382/4868] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:17 2022] POST /compute/v2.1/servers/c2ed1ffb-2e28-4f3e-a918-3699853a2446/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:17.890833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:17.891337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:17.924066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:17.924726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:17.925126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:17.925947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:17.926407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:17.926839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:17.974520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b HTTP/1.1 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e70d54db-21cd-4c0c-ab41-2a7828f6ea3b'} Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:17.977252 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:17.983535 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:17.986256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:17.987413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23b21286-087f-42c4-a51b-b3c78da798aa tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 404 len: 111 microversion: 2.1 time: 0.103503 Sep 23 04:02:17.992861 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2383/4869] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:17 2022] DELETE /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:18.007664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:18.008324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:18.017556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.018060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.018499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.019328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.019794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.020225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.150959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:18.165588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:18.170250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:18.173958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0900c60-e5e7-45a7-9ab8-da27f0bec7bf tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2959 microversion: 2.42 time: 0.555578 Sep 23 04:02:18.180793 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2487/4870] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:17 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2959 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:18.187935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:18.193413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:18.212057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.213646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.214308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.215326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.215976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.222146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.253454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:18.667056 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28cc7520-e941-42e9-a6c3-4647dea045e1 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.671976 Sep 23 04:02:18.667666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2384/4871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:17 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:18.682235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:18.688201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:18.698679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.699956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.701833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.706151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.706892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.707710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.767733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:18.777850 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6bab198c-365b-41a3-9c4c-65db9fb13093 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.594626 Sep 23 04:02:18.780182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2488/4872] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:18 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:18.789988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:18.794118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: e70d54db-21cd-4c0c-ab41-2a7828f6ea3b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:18.808597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.809396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.810089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.811049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.812223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.812864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.853864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b HTTP/1.1 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e70d54db-21cd-4c0c-ab41-2a7828f6ea3b'} Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:18.860608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. Sep 23 04:02:18.864852 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:18.866416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance e70d54db-21cd-4c0c-ab41-2a7828f6ea3b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:18.870284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6951565-046b-46a5-8b1b-a11c457299f1 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b" status: 404 len: 111 microversion: 2.1 time: 0.086373 Sep 23 04:02:18.871835 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2489/4873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:18 2022] GET /compute/v2.1/servers/e70d54db-21cd-4c0c-ab41-2a7828f6ea3b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:18.882960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:18.886465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:18.901540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.904421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.905002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:18.905899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:18.914610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:18.915219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:19.855749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:19.871935 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-66b4d419-0f86-427d-8c26-003fc2c5cabb tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 1.203168 Sep 23 04:02:19.879011 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2385/4874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:18 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:19.902737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:19.903613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:19.921097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:19.926325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:19.927069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:19.930672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:19.932498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:19.935959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.014203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.027954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e446cdfd-ece0-443f-8ac4-487c872b5911 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 1.154807 Sep 23 04:02:20.050621 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2490/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:18 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:20.062774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:20.064900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:20.081817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.082637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.085596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.088326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.089103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.089749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.695622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.705344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.706924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.721790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da51a03c-f59c-4808-b87f-a1325f2ee82d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1600 microversion: 2.20 time: 0.838858 Sep 23 04:02:20.722437 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2386/4876] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:19 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1600 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:20.733531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.745130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:20.745792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:20.751390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.756368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:20.758863 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07a5b37f-76b8-4b6f-adf8-bb76e7d31373 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2959 microversion: 2.42 time: 0.706107 Sep 23 04:02:20.764330 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2491/4877] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:20 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2959 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:20.770087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:20.778707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:20.798168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.799134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.799651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.800121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.800824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.801291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.801889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.802238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.802977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.803445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.803885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.811657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.948193 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Cannot 'unshelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action HTTP/1.1 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 18 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: {"unshelve": null} Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot 'unshelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'unshelve': None}} Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 in vm_state active. Cannot unshelve while the instance is in this state. Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:02:20.949858 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 409 to user: Cannot 'unshelve' instance 97379c08-f144-4054-a9b9-f7a548e2a061 while it is in vm_state active {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b718107a-adfe-4afe-a390-5ac7ac094464 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action" status: 409 len: 146 microversion: 2.1 time: 0.185132 Sep 23 04:02:20.954704 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2492/4878] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:20 2022] POST /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061/action => generated 146 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:02:20.966142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:20.966744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:20.987774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.988197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.988641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:20.989374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:20.993399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:20.996561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.200230 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4eb60d7-9059-4931-b038-b190f8115133 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.243989 Sep 23 04:02:21.201861 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2493/4879] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 04:02:20 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:02:21.203596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:21.209048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:21.210827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:21.227425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.228799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.232142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.233163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.234199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.234863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.564857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3d3af53b-8b4e-41be-b913-9a72a44e4554 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.835906 Sep 23 04:02:21.573285 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2387/4880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:20 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:21.592802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:21.599824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:21.624792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.625262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.633692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.637914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.638408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.644423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.787692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:21.802241 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-356fcc8f-730e-4f0d-9b06-91fcd9a7c9f9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.595144 Sep 23 04:02:21.802902 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2494/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:21 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:21.816290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:21.816915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:21.847696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.850821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.852683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:21.856522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:21.858310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:21.859286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:22.325823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=16 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:22.413895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:22.470628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:22.488227 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4de86309-9e6a-4cfe-8426-1d78de02b2eb tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.913716 Sep 23 04:02:22.493500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2388/4882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:21 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:22.523508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:22.524498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:22.524788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:22.537475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:22.542227 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8894e1d6-a710-4275-b9d4-526debcd04b4 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2938 microversion: 2.42 time: 0.733066 Sep 23 04:02:22.545152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2495/4883] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:21 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2938 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:22.549580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:22.562805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:22.571467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:22.573570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:22.576055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:22.576659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:22.588282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:22.588911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:22.607987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:22.614902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:22.619413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:22.621198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:22.626135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:22.628086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:22.631903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.322929 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3dbcba6a-a8fa-4d9a-929b-07f31c226797 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.738089 Sep 23 04:02:23.327757 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2496/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:22 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:23.346108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:23.349312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:23.368397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.369536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.370209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.371463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.374756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.375980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.381552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:23.396697 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3aa149bf-21aa-44d5-8e6c-eb497dc217b6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.884462 Sep 23 04:02:23.398733 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2389/4885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:22 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:23.422984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "154b1f8d-297e-42ac-93ef-44d89c53c04b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:23.450057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.451871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.452387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.495643 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] Creating event network-vif-unplugged:154b1f8d-297e-42ac-93ef-44d89c53c04b for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:23.509112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1c0081ba-5381-4a9f-8a3c-f08c057067bf req-4cfd8b65-35cc-4ebb-bd3e-b0093c99abef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105105 Sep 23 04:02:23.510726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2390/4886] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:23.524103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1847329465_updated"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:23.530510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 41ac1d5f-b624-444f-bbf7-86c2584103a9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:23.545249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/servers/41ac1d5f-b624-444f-bbf7-86c2584103a9 HTTP/1.1 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 81 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1847329465_updated"}} Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '41ac1d5f-b624-444f-bbf7-86c2584103a9', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1847329465_updated'}}} Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 23 04:02:23.551673 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 41ac1d5f-b624-444f-bbf7-86c2584103a9 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c100252-a90e-420d-b7b8-451beb8ea6a6 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "PUT /compute/v2.1/servers/41ac1d5f-b624-444f-bbf7-86c2584103a9" status: 404 len: 111 microversion: 2.1 time: 0.041316 Sep 23 04:02:23.557012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2391/4887] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 04:02:23 2022] PUT /compute/v2.1/servers/41ac1d5f-b624-444f-bbf7-86c2584103a9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:23.566779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:23.567412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:23.608965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.610178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.610641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.611397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.611857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.612302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.758356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:23.767588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f942251-5fc2-496a-ba67-36dbdc1289d4 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.438011 Sep 23 04:02:23.773030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2497/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:23 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:23.785552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:23.793400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:23.799931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.803395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.804175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:23.808117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:23.808852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:23.809577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:24.328172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:24.349517 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6391e83c-90d5-4f56-91bd-4546e9f268bf tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.782643 Sep 23 04:02:24.362922 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2392/4889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:23 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:24.371563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:24.372465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:24.377786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:24.386488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:24.389884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:24.391077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:24.392190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:24.393102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:24.393841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:24.394435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:24.410548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:24.416441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:24.427443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5af8bf23-64e0-4399-841c-0a2243930d99 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2938 microversion: 2.42 time: 0.649678 Sep 23 04:02:24.464228 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2498/4890] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:23 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2938 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:24.526954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:24.533126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:24.581183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:24.582017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:24.586976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:24.591018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:24.599516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:24.601670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:25.197784 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b533ac02-813a-44f6-b4e0-0f6939e3c95d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.832813 Sep 23 04:02:25.214711 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2393/4891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:24 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:25.226030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:25.227118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:25.240552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:25.242349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:25.244160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:25.246637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:25.247403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:25.248254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:25.679118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:25.701599 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90915876-809d-4af4-92b3-a8cc87d147a7 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 1.226787 Sep 23 04:02:25.707171 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2499/4892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:24 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:25.736628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:25.767124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:25.768136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:25.768800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:25.784944 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] Creating event network-changed:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:02:25.794160 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-09bf1f47-5100-43bc-8ab6-db14251c1236 req-c0cb3578-6360-4efe-b83b-ec427d880106 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081131 Sep 23 04:02:25.800559 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2500/4893] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:25.807338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:25.808541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:25.826648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:25.827538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:25.828237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:25.844679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:25.845668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:25.847762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.099175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:26.108178 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c0b687b-4dd1-459c-847a-358b1e900631 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.890312 Sep 23 04:02:26.108776 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2394/4894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:25 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:26.146617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "14f2489d-67f5-4a49-adb7-6b5d73463f20"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "23565f04-5690-4520-ad41-b96190b6c520"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "b9a165f5-5498-48d5-a507-4312040da971"}, {"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "78988203-0141-4fe7-840c-b2a2258f2e39"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:26.187146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.187460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.195825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.226129 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Creating event network-vif-unplugged:14f2489d-67f5-4a49-adb7-6b5d73463f20 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:26.226824 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Creating event network-vif-unplugged:23565f04-5690-4520-ad41-b96190b6c520 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:26.227142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Creating event network-vif-unplugged:b9a165f5-5498-48d5-a507-4312040da971 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:26.227648 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] Creating event network-vif-unplugged:78988203-0141-4fe7-840c-b2a2258f2e39 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:26.255822 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-83f32cb8-79da-4dac-b4a2-97fc624dc1fd req-160af351-b766-4962-bfaf-765cceba02a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.123531 Sep 23 04:02:26.256447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2395/4895] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:26.278941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40c012e7-eadd-4ddc-ba6e-0b9fe7b85729 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40c012e7-eadd-4ddc-ba6e-0b9fe7b85729 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 HTTP/1.1 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 280 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.284678 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40c012e7-eadd-4ddc-ba6e-0b9fe7b85729 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:26.288519 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40c012e7-eadd-4ddc-ba6e-0b9fe7b85729 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 400 len: 619 microversion: 2.1 time: 0.028596 Sep 23 04:02:26.305143 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2396/4896] 10.222.0.25 () {60 vars in 1257 bytes} [Fri Sep 23 04:02:26 2022] PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:02:26.310054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:26.321200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:26.338527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.352114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.353882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.354934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.355706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.360649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.377268 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:26.385122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:26.399337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:26.410238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:26.413728 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-550df0ee-510a-440c-8d44-af9502a71a9e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2917 microversion: 2.42 time: 0.611528 Sep 23 04:02:26.416887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2501/4897] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:25 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2917 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e HTTP/1.1 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'f778b652-a107-41b7-b3b9-d193fc529f4e'} Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:26.420836 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:26.424893 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:26.431228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:26.435585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:26.439260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4d482b1-f598-43be-957c-914516bbec35 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 404 len: 111 microversion: 2.1 time: 0.132936 Sep 23 04:02:26.448051 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2397/4898] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:26 2022] DELETE /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:26.451167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:26.482594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:26.489023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.492602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:26.502352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.505990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.508044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.512508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.512832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.513983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.527094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.527912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:26.530254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:26.531645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:26.532909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.024577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:27.035580 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36d883ca-5d09-4c21-805c-1cafc509f938 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.585967 Sep 23 04:02:27.036285 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2398/4899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:26 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:27.053563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.054314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: f778b652-a107-41b7-b3b9-d193fc529f4e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.068138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.072472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.073024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.074018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.074494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.074978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.079693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:27.115636 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e HTTP/1.1 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'f778b652-a107-41b7-b3b9-d193fc529f4e'} Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.117196 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance f778b652-a107-41b7-b3b9-d193fc529f4e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c47e818d-4587-4eb2-9376-714844c4f7d4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e" status: 404 len: 111 microversion: 2.1 time: 0.074903 Sep 23 04:02:27.122876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2399/4900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/f778b652-a107-41b7-b3b9-d193fc529f4e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:27.135246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.146836 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-324ed321-41e9-4b66-926b-6ab109671b2a tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 0.719310 Sep 23 04:02:27.147880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.153856 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2502/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:26 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:27.176390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.177120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.178300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.178679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.179342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.184766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.187599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.189378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.204765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.207483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.208160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.209073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.211118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.212990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.251857 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 HTTP/1.1 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6e8d5cd8-9873-49e6-af27-20b2bffcef76'} Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:27.268744 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.273933 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.277860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:27.279111 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ded99473-11df-4efa-b2e6-0878592561c4 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 404 len: 111 microversion: 2.1 time: 0.122584 Sep 23 04:02:27.280604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2503/4902] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:27 2022] DELETE /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:27.287102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.288614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.329796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.330618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.331308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.332191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.333308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.333996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.669476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:27.688159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52fb0d46-77b8-43b9-9b32-292a9d424ff3 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.564208 Sep 23 04:02:27.688763 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2400/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:27.701520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.701520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6e8d5cd8-9873-49e6-af27-20b2bffcef76] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.725041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.725610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.726714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.727444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.728215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.728653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.752459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:27.762554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75af2f54-4b8b-4782-a7fe-e13cb03ce51c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1509 microversion: 2.1 time: 0.480618 Sep 23 04:02:27.765143 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 HTTP/1.1 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6e8d5cd8-9873-49e6-af27-20b2bffcef76'} Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.766734 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6e8d5cd8-9873-49e6-af27-20b2bffcef76 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:27.771746 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f97d4247-ef4f-42a2-877e-fd668bbe4a36 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76" status: 404 len: 111 microversion: 2.1 time: 0.078443 Sep 23 04:02:27.773210 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2504/4904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:27.782763 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2401/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/6e8d5cd8-9873-49e6-af27-20b2bffcef76 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:27.791590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.792866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.794310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-deleted", "tag": "23565f04-5690-4520-ad41-b96190b6c520"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:27.808327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.809224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.809896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.811116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.811754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.813626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.856801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.857297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.857945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.895426 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] Creating event network-vif-deleted:23565f04-5690-4520-ad41-b96190b6c520 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:27.911701 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2ffbbce4-5910-47ec-8acf-451a6eab7264 req-b60a8eb4-6402-4c8f-b8f0-6f92088df7be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121499 Sep 23 04:02:27.914038 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2402/4906] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:27.930589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-997eba13-7509-4a8a-b5a6-f3618f39f719 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-997eba13-7509-4a8a-b5a6-f3618f39f719 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: request: PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 HTTP/1.1 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 24 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: {"server": {"name": ""}} Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061', 'body': {'server': {'name': ''}}} Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi '' Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:02:27.945086 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:02:27.950502 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:27.952727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-997eba13-7509-4a8a-b5a6-f3618f39f719 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:27.953888 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-997eba13-7509-4a8a-b5a6-f3618f39f719 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 400 len: 108 microversion: 2.1 time: 0.036455 Sep 23 04:02:27.957925 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2403/4907] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 04:02:27 2022] PUT /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:02:27.970830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:27.971608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:27.988920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:27.992666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:27.993760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:27.996223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.000503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.001125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:28.242307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:28.261890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:28.263470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:28.273084 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa9ff26b-2442-4871-859f-75c0a4a42236 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2870 microversion: 2.42 time: 0.488290 Sep 23 04:02:28.273730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2505/4908] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2870 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:28.287640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:28.289570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:28.304225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.307216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.307868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:28.308792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.310560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.311655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:28.473110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:28.484832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fc3e1cf-cec1-4e4b-aea1-7824c7686b68 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1504 microversion: 2.1 time: 0.522476 Sep 23 04:02:28.486425 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2404/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:27 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:28.504732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dcf5f4-11dd-4747-a9ea-4b846babdbf6", "name": "network-vif-plugged", "status": "completed", "tag": "831a4441-d75c-4df6-9a63-df0e1ab9124f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:28.520427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.521270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.521961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:28.545368 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] Creating event network-vif-plugged:831a4441-d75c-4df6-9a63-df0e1ab9124f for instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 on n-h1-858495-2 Sep 23 04:02:28.554786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5114c334-8bee-47f2-9bdc-8637a5779d7b req-f66f9021-aea2-4a2f-b72b-cbd6f68ace57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066135 Sep 23 04:02:28.555673 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2405/4910] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:28.795631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:28.796428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:28.821025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.822874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.826240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:28.828472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:28.829909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:28.830671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:29.652045 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a93dad14-3d67-45c5-a116-4c30c2a3552c tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1464 microversion: 2.1 time: 1.366442 Sep 23 04:02:29.653568 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2506/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:28 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1464 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:29.659875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:29.660875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:29.676317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:29.677121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:29.677825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:29.679080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:29.679762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:29.681653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:30.668021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:30.683899 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-25face17-0f25-4dca-942a-9f6f39bc0a2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1506 microversion: 2.1 time: 1.893615 Sep 23 04:02:30.685116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2406/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:28 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1506 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:30.689883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-deleted", "tag": "154b1f8d-297e-42ac-93ef-44d89c53c04b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:30.720331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:30.723477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:30.724136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:30.758210 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] Creating event network-vif-deleted:154b1f8d-297e-42ac-93ef-44d89c53c04b for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:30.765117 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-13020374-169b-421f-bda9-b39d8dd8984f req-dfc6f887-0b25-45eb-a462-da9adf5ca317 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078584 Sep 23 04:02:30.775882 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2407/4913] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:30.782573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:30.786733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:30.810556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:30.819279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:30.820028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:30.820967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:30.822443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:30.823051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:30.921021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:30.924227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:30.941242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:30.954366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:30.955904 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bacc7709-8a73-4c1c-a174-613ed68119d0 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2710 microversion: 2.42 time: 1.300874 Sep 23 04:02:30.960087 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2507/4914] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:29 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2710 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:31.200049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45e3b924-8edf-4ae7-b197-2e10492299e0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1648 microversion: 2.1 time: 0.422096 Sep 23 04:02:31.200660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2408/4915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:30 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1648 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:31.229659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:31.230546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:31.253039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.255345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.262999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:31.265513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.273340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.274353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:31.714750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:31.714750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:31.722028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e07a9b7d-d21c-413e-8624-5757cd4586cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1648 microversion: 2.1 time: 0.496682 Sep 23 04:02:31.722636 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2508/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:31 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1648 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:31.746314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.746821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.747268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:31.748044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.759409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.759409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:31.759770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:31.761899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:31.773484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.773966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.774464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:31.782846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:31.783396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:31.783848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:32.641884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:32.644847 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4bc965fe-7d2d-49b7-9d1f-b46ed7a98bd2 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1648 microversion: 2.1 time: 0.901732 Sep 23 04:02:32.650975 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2509/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:31 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1648 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:32.669619 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eff3c35c-39bc-4e6b-92f5-fd9cb9c11028 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1506 microversion: 2.1 time: 0.965180 Sep 23 04:02:32.678688 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2409/4918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:31 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1506 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:32.693719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:32.694232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:32.697635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:32.700207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:32.719756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:32.722237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:32.723806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:32.724870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:32.726506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:32.727069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:32.727575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:32.728774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:32.731430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:32.734328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:32.737439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:32.738631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:32.857748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:33.080177 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-251a0e94-d4c1-485d-b60e-795e27266c23 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 204 len: 0 microversion: 2.1 time: 0.399881 Sep 23 04:02:33.084018 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2410/4919] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:32 2022] DELETE /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:02:33.092726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-deleted", "tag": "14f2489d-67f5-4a49-adb7-6b5d73463f20"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:33.117398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:33.117751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:33.123391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:33.151869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] Creating event network-vif-deleted:14f2489d-67f5-4a49-adb7-6b5d73463f20 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:33.170394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-402b3689-fe8e-46ea-98e0-adb146a6dc6a req-c08feb25-1279-41d9-875b-5d14e779007a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086585 Sep 23 04:02:33.173908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2411/4920] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:33.190113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:33.190839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:33.202784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:33.203284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:33.203915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:33.204454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:33.204898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:33.209879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:33.832489 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24b7c8dd-c4bf-40ec-9416-cdd39beed2c8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1654 microversion: 2.1 time: 0.653773 Sep 23 04:02:33.838700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2412/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:33 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1654 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:33.844684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:33.845317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:33.860887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:33.863425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:33.863918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:33.870360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:33.871494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:33.872110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:34.136003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:34.147607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:34.160895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:34.167846 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07f603ac-d14f-43cb-944d-3216e325c0f2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2549 microversion: 2.42 time: 1.497344 Sep 23 04:02:34.171965 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2510/4922] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:32 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2549 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:34.187726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e804563-e91b-4bb5-ad25-ea6bc66a7be7", "name": "network-vif-unplugged", "status": "completed", "tag": "20936caf-6723-490a-ae6b-f9dfe1230659"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:34.238046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:34.238684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:34.243829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:34.300394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.server_external_events [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] Unable to find a host for instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7. Dropping event network-vif-unplugged {{(pid=128724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 04:02:34.302811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0cc03443-c7b6-4818-8325-6c14f3787c6d req-112b522e-21ad-4f00-b926-115f419e63b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.128467 Sep 23 04:02:34.310195 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2511/4923] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 131 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 04:02:34.860629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:34.861341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:34.873290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:34.874112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:34.874272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:34.874976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:34.886058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:34.886626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:35.261300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:35.273255 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6fc48a36-3c99-4656-8863-23363d959c2f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 200 len: 1449 microversion: 2.1 time: 1.430532 Sep 23 04:02:35.275059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2413/4924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:33 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 1449 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:35.285248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:35.296652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:35.308106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:35.316418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:35.317150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:35.318161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:35.318808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:35.319441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:35.796111 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0e8ce49-649a-423e-aabf-55837a14a7b0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1654 microversion: 2.1 time: 0.939649 Sep 23 04:02:35.805044 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2512/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:34 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1654 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:35.810874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:35.811704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:35.833263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:35.833898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:35.834489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:35.835389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:35.835929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:35.843399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:35.944929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:35.955000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:35.967029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:35.968347 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc13110f-7689-44ad-90bd-0a7e75586b01 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2345 microversion: 2.42 time: 0.691519 Sep 23 04:02:35.971115 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2414/4926] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:35 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2345 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:35.994400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-deleted", "tag": "78988203-0141-4fe7-840c-b2a2258f2e39"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:36.015122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.015612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.016054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.083748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] Creating event network-vif-deleted:78988203-0141-4fe7-840c-b2a2258f2e39 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:36.099289 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0a754bf2-071b-459b-8548-9e3e094bab98 req-c9ad2aaa-59fa-4d05-a88c-04712b79f9c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126682 Sep 23 04:02:36.100276 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2415/4927] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:36.117715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:36.120190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:36.147834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.149849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.151099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.153682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.158825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.159645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.181974 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad HTTP/1.1 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6014c14c-d670-4333-a033-a26367fa56ad'} Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:36.194562 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.200666 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.202980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:36.204466 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-727c1b62-cf79-4ab3-898b-2970b4c29aec tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 404 len: 111 microversion: 2.1 time: 0.102377 Sep 23 04:02:36.205263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2416/4928] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:36 2022] DELETE /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:36.219192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:36.220136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] [instance: 6014c14c-d670-4333-a033-a26367fa56ad] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:36.232077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.233032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.233692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.235730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.236592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.237231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.257604 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] HTTP exception thrown: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Request method failure captured: Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad HTTP/1.1 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS2t_HsqkmE7_bL56sfZ3-F21eoGxZZUavRRYTepLTeKfWWXlupaiYCOx-9eywP2GzozjV1WbsDJCGMTOnrULozHc8DbiTNgBj_Fv4dGRXLpLTEVFdgOrrLMoIAutxVjRil-n4CCmOFt3jCEH6TVtH-fYRwU_c64t2sQSO8Dj6lEHAw Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/767515854d364c4fa516f4a4685254b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/767515854d364c4fa516f4a4685254b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_767515854d364c4fa516f4a4685254b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 767515854d364c4fa516f4a4685254b0 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1756525356 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 310efb884806402cbea5f65238e91188 Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeNegativeTest-1756525356-project Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6014c14c-d670-4333-a033-a26367fa56ad'} Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:36.260079 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. Sep 23 04:02:36.265740 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:36.267764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] Returning 404 to user: Instance 6014c14c-d670-4333-a033-a26367fa56ad could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:36.268838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a84982e-6cf5-4d26-826b-9607f131f3a2 tempest-AttachVolumeNegativeTest-1756525356 tempest-AttachVolumeNegativeTest-1756525356-project] 10.222.0.25 "GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad" status: 404 len: 111 microversion: 2.1 time: 0.059465 Sep 23 04:02:36.270016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2417/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:36 2022] GET /compute/v2.1/servers/6014c14c-d670-4333-a033-a26367fa56ad => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:36.667027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:36.681147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db75e6e6-14e9-4236-8a31-5f26b890bbff tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.873445 Sep 23 04:02:36.693672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2513/4930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:35 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:36.721735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:36.722794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:36.748506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.749004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.749466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.753998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.762976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.764411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.830093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:36.830780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:36.847297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.847812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.848262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:36.848990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:36.849480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:36.864970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:37.425711 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ddc786a-c399-4024-b19e-3940c2be405d tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 200 len: 1612 microversion: 2.1 time: 0.575150 Sep 23 04:02:37.437439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2514/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:36 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 1612 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:37.463944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:37.466953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:37.483004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:37.485449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:37.486027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:37.488824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:37.490577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:37.496452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:37.848346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:37.866690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:37.868740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:37.870256 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-12fed8e1-e4d1-4c99-ae07-87346de21b1d tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2164 microversion: 2.42 time: 0.431274 Sep 23 04:02:37.886223 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2515/4932] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:37 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2164 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:37.914706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dcf5f4-11dd-4747-a9ea-4b846babdbf6", "name": "network-vif-deleted", "tag": "831a4441-d75c-4df6-9a63-df0e1ab9124f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:37.939999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:37.958936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:37.963886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:37.994798 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] Creating event network-vif-deleted:831a4441-d75c-4df6-9a63-df0e1ab9124f for instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 on n-h1-858495-2 Sep 23 04:02:38.032848 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-aa3e28e7-6e1e-402d-bd27-1da518dbc12a req-aa0e8505-891f-4aa3-827c-d5150a4518af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119044 Sep 23 04:02:38.037562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:38.041837 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2516/4933] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:38.058145 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-227d5c71-dc83-41b7-814a-6c8aefa7885f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 1.333188 Sep 23 04:02:38.058826 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2418/4934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:36 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:38.084239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:38.085500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:38.103680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.104180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.108468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.109239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.109737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.110183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.455114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:38.456040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 47dcf5f4-11dd-4747-a9ea-4b846babdbf6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:38.466152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.466909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.471380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.474210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.481651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.482313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.533509 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] HTTP exception thrown: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Request method failure captured: Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 HTTP/1.1 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS-f-_9fDgHOpIkbZh1JJLzrJvEBNF1sirnD8u3ZVhigkRZF_ENpjpBc86txhjqYbieQoVdUZ3mhGJLl3cZl7o79KZSL0uGudTkQVb6C-PQionjXw2NjodZLYvCrQsmW3EU0FAGRpxn3XxAYIuQblIf4Le_QlXLhNNDytYK10MnXYj8 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: bad7c943574a4726893a6b8e602df5be Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestServerMultinode-67111540 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bad7c943574a4726893a6b8e602df5be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestServerMultinode-67111540 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: bad7c943574a4726893a6b8e602df5be Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestServerMultinode-67111540 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestServerMultinode-67111540-project-admin Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 3f7449d430fe4a28955560d740faf560 Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestServerMultinode-67111540-project-admin Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '47dcf5f4-11dd-4747-a9ea-4b846babdbf6'} Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:38.537714 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. Sep 23 04:02:38.542831 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:38.544284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Returning 404 to user: Instance 47dcf5f4-11dd-4747-a9ea-4b846babdbf6 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:38.545342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76053c7c-cacb-4685-8bf4-2279e83459cc tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6" status: 404 len: 111 microversion: 2.1 time: 0.094170 Sep 23 04:02:38.552678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2419/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:38 2022] GET /compute/v2.1/servers/47dcf5f4-11dd-4747-a9ea-4b846babdbf6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:38.570776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:38.572012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:38.584051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.584550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.585707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.586428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.587487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.588260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.641155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:38.706859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:38.854660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17b7fbd6-caf8-4a50-aa47-2ab82a9d72a0 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 204 len: 0 microversion: 2.1 time: 0.300303 Sep 23 04:02:38.855500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2420/4936] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:38 2022] DELETE /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:02:38.872699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:38.875990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:38.891077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.893756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.894522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:38.900219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:38.902468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:38.904349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:39.505726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:39.514777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72860687-e853-4171-8f5f-1f76ae9fd0da tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 1.435111 Sep 23 04:02:39.515980 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2517/4937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:38 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:39.520881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:39.521492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:39.537234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:39.537776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:39.538233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:39.538930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:39.539392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:39.539864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:39.844703 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-73b81064-dc65-4591-927b-9d1ed129c4b8 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1655 microversion: 2.1 time: 0.978114 Sep 23 04:02:39.862566 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2421/4938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:38 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1655 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:40.178474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-172762772", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "9e910aeb-11c1-4f46-b744-d2b6b8d73470"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:40.226617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:40.248478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:40.250257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:40.251772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ea32994-bc70-4116-bc2b-54937756d840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 2164 microversion: 2.42 time: 0.734595 Sep 23 04:02:40.266448 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2518/4939] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:39 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 2164 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:40.280666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:40.287986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] validate_networks() for [('9e910aeb-11c1-4f46-b744-d2b6b8d73470', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:02:40.289703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:40.299631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:40.310632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:40.311398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:40.312338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:40.312978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:40.313668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.042173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:41.050409 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2ee9508-b042-49c9-a873-bb1d1d846010 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.782799 Sep 23 04:02:41.062350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2519/4940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:40 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:41.067412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:41.079085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:41.099312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.099922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.100437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.101437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.102185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.103368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.154359 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 HTTP/1.1 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2'} Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:41.160520 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:41.165598 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:41.168261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:41.173213 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a965b3a6-7034-4e28-8ac7-93b27af93f30 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 404 len: 111 microversion: 2.1 time: 0.109658 Sep 23 04:02:41.182063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2520/4941] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:41 2022] DELETE /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:41.187004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c710beef-c0e4-47ac-a14b-30ee2c4b8b9a", "name": "network-vif-deleted", "tag": "b9a165f5-5498-48d5-a507-4312040da971"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:41.222211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.238141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.239007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.267914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] Creating event network-vif-deleted:b9a165f5-5498-48d5-a507-4312040da971 for instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a on n-h1-858495-2 Sep 23 04:02:41.283617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3e205458-5f22-472e-ac87-f3756fd69222 req-48b72388-327d-47cd-81ac-b36a63fe26b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096067 Sep 23 04:02:41.285331 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2521/4942] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:41.295995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:41.301496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:41.320035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.321502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.322090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.322931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.323513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.324062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.879509 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-983caaec-3dc8-4157-9d4f-cf58b783cea7 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1655 microversion: 2.1 time: 0.592788 Sep 23 04:02:41.886773 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2522/4943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:41 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1655 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:41.896118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:41.912125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:41.913847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:41.914637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:41.970253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Going to try to stop instance {{(pid=128724) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:02:42.063986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4044d833-b0b6-4ec2-bed2-e9eed9c738d2 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.175250 Sep 23 04:02:42.068603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2523/4944] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:41 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:02:42.074328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:42.081235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:42.088451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.089306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.090046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.091139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.091829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.092479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.122623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 HTTP/1.1 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2'} Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:42.127377 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:42.132482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:42.133151 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01b7a34f-7ec1-4fc6-b398-90c2d21eb782 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2" status: 404 len: 111 microversion: 2.1 time: 0.060589 Sep 23 04:02:42.137669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2524/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:42 2022] GET /compute/v2.1/servers/0e8ac8f7-6f91-4950-b2f3-156b0b7d0bc2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:42.151831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:42.152847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:42.160930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.161802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.162442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.163352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.164027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.165205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.469838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:02:42.470264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:02:42.470509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:02:42.470922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:02:42.471319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:02:42.474684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:42.492230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.494665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:42.495418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.496760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.499641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.501084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.504212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.505107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:42.519768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbcd6a24-6484-48bf-b5ee-1e903c54164b tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.372228 Sep 23 04:02:42.520451 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2525/4946] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:42 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:42.536782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:42.537417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:42.560491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.561255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.564404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.565390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.565854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.566286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.606629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Getting quotas for project e749e84c5d8c4137b038d29fb9990f89. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:02:42.624780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Getting quotas for user 0410bcba4a314f8bbcb4dea2fbcaaafc and project e749e84c5d8c4137b038d29fb9990f89. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:02:42.671013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:02:42.674256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:02:42.772551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d95cd9f8-95bc-4d5c-a734-a7fbc6375967 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908214 Sep 23 04:02:42.781440 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2422/4947] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:02:42.790733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:42.793515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:42.829706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.830636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.831259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.832521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:42.833173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:42.833792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:42.870900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:02:43.066707 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-942cc8c9-ec07-4b47-91c5-1a9f4340271f tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 204 len: 0 microversion: 2.1 time: 0.283500 Sep 23 04:02:43.067655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2423/4948] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:02:42 2022] DELETE /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:02:43.082846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-973530d1-b59d-4b35-b22d-4f811ae95f71 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:43.083580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-973530d1-b59d-4b35-b22d-4f811ae95f71 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:43.236969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.237558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-973530d1-b59d-4b35-b22d-4f811ae95f71 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.240391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:43.244760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-973530d1-b59d-4b35-b22d-4f811ae95f71 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1215 microversion: 2.1 time: 0.175620 Sep 23 04:02:43.253697 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2424/4949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:43 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:43.275454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:43.276495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:43.288384 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13100626-bcd9-41cc-8fdd-dc6961d444ae tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.762876 Sep 23 04:02:43.289015 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2526/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:42 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:43.301087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:43.309393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:43.317852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.319587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.320260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.323070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.325528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.326516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.332869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.333895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.334541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.337199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.337905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.338557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.411325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.416918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.417921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.422278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lazy-loading 'fault' on Instance uuid 7003e6d2-598a-4e33-8df2-627b5b414b42 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:02:43.670959 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cdb84da4-d752-4e22-89ea-7a0297545506 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1454 microversion: 2.1 time: 0.421031 Sep 23 04:02:43.671574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2425/4951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:43 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1454 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:43.695161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:43.696365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:43.707306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.723161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.727284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.728141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.728715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.729230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.826462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.839366 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f515a315-8a4d-42b4-b371-bf88a085a869 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 0.544510 Sep 23 04:02:43.843678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2527/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:43 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:43.848697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7003e6d2-598a-4e33-8df2-627b5b414b42", "name": "network-vif-deleted", "tag": "c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:43.875594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:43.876288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:43.876909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:43.900271 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] Creating event network-vif-deleted:c7e3ef1f-73d2-47b5-8c08-2d7dd8a777fb for instance 7003e6d2-598a-4e33-8df2-627b5b414b42 on n-h2-858495-2 Sep 23 04:02:43.919097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.921979 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-26789469-284f-4231-947d-65aa621d95be req-4dfa4da0-cd04-43a6-80f0-9d17ce7a0a54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074285 Sep 23 04:02:43.925913 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2528/4953] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:43.936539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.938335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:43.939607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63cbe54f-289e-4bdf-a5aa-00e61b58d88a tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.256167 Sep 23 04:02:43.940581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2426/4954] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:43 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:44.271125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:44.271772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:44.284396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.286108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.286882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.288382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.289126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.290444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.316055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:44.316716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:44.321835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:44.329858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.330215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.330656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.331369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.331824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.332249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.468886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:44.478035 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c4f85bd-a4af-4349-959c-30e054aa7a23 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1219 microversion: 2.1 time: 0.211755 Sep 23 04:02:44.479532 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2529/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:44 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:44.698063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:44.698784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:44.711007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.725041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.727882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.733634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.736325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.739888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.803037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.804520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.805208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.806008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lazy-loading 'fault' on Instance uuid 7003e6d2-598a-4e33-8df2-627b5b414b42 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:02:44.884702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:44.895476 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c630a4f-8fdf-45a3-8165-445f43f16996 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.583306 Sep 23 04:02:44.896907 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2427/4956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:44 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:44.905657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:44.906782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:44.913794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.915528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.916168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:44.917458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:44.918505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:44.919115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.017662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dea41815-593c-4f0b-966a-43cffd0a6087 tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 200 len: 1454 microversion: 2.1 time: 0.323230 Sep 23 04:02:45.033536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2530/4957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:44 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 1454 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:45.048630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:45.049516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:45.060270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.061085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.061771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.062744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.063635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.064413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.220661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:45.235447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:45.237584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:45.239053 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c724f8a-03d6-4219-99a3-d179de15439e tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.196272 Sep 23 04:02:45.240176 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2531/4958] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:45 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:45.505438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:45.506875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:45.527178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.530046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.533083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.535120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.535607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.538006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.905280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:45.919429 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44761ebd-f36e-4bf7-bda1-8964bcbe8a4e tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1510 microversion: 2.1 time: 1.021003 Sep 23 04:02:45.931900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2428/4959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:44 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1510 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:45.942964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:45.943417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:45.944968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:45.952600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71514f46-742a-4816-95ea-fc02d63bc534 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1267 microversion: 2.1 time: 0.451420 Sep 23 04:02:45.957416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.960272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.960811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:45.962210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:45.966096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:45.966591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2532/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:45 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1267 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:45.966728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.050368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:46.056730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] [instance: 7003e6d2-598a-4e33-8df2-627b5b414b42] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:46.088995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.092052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.093893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.095235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.099060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.100266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.139166 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] HTTP exception thrown: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Request method failure captured: Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 HTTP/1.1 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS-f-_9fDgHOpIkbZh1JJLzrJvEBNF1sirnD8u3ZVhigkRZF_ENpjpBc86txhjqYbieQoVdUZ3mhGJLl3cZl7o79KZSL0uGudTkQVb6C-PQionjXw2NjodZLYvCrQsmW3EU0FAGRpxn3XxAYIuQblIf4Le_QlXLhNNDytYK10MnXYj8 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: bad7c943574a4726893a6b8e602df5be Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestServerMultinode-67111540 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bad7c943574a4726893a6b8e602df5be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bad7c943574a4726893a6b8e602df5be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestServerMultinode-67111540 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: bad7c943574a4726893a6b8e602df5be Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestServerMultinode-67111540 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestServerMultinode-67111540-project-admin Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 3f7449d430fe4a28955560d740faf560 Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestServerMultinode-67111540-project-admin Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '7003e6d2-598a-4e33-8df2-627b5b414b42'} Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:46.145690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] Returning 404 to user: Instance 7003e6d2-598a-4e33-8df2-627b5b414b42 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:46.151942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-423b8e03-bbbd-4d08-8f83-0344e6b3e6ae tempest-TestServerMultinode-67111540 tempest-TestServerMultinode-67111540-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42" status: 404 len: 111 microversion: 2.1 time: 0.100932 Sep 23 04:02:46.161597 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2533/4961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:46 2022] GET /compute/v2.1/servers/7003e6d2-598a-4e33-8df2-627b5b414b42 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:46.271974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:46.275191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:46.291403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.293961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.299613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.303589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.304288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.305794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.684962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:46.702987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:46.704970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:46.706234 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b9eb1cf-c343-4a49-b600-eb85cf519171 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.445997 Sep 23 04:02:46.712848 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2534/4962] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:46 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:02:46.949216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:46.951728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:46.958773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.959573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.960304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.961948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:46.962673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:46.963325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:46.994440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:47.004790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-904b93a0-de4c-4a60-aa6f-10f2f0127212 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 1.071611 Sep 23 04:02:47.010645 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2429/4963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:45 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:47.017159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:47.018090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:47.031133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:47.034000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:47.034604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:47.035454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:47.035993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:47.036572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:47.201466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6539dc2b60a14449b5a970a8f558a691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd28846bbd84139a95f8d509db77cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:47.228294 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6255b549-0531-4a55-a4f5-67580a042224 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 200 len: 1468 microversion: 2.1 time: 0.284655 Sep 23 04:02:47.232010 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2535/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:46 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 1468 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:47.234757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:47.249013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97379c08-f144-4054-a9b9-f7a548e2a061", "name": "network-vif-deleted", "tag": "ed30d949-5804-4351-8f1d-b19d5d06cf5a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:47.265523 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-344b3351-322d-41a7-8f86-57541259d386 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1273 microversion: 2.1 time: 0.253695 Sep 23 04:02:47.270036 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2430/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:47 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:47.280661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:47.284314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:47.284932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:47.316031 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] Creating event network-vif-deleted:ed30d949-5804-4351-8f1d-b19d5d06cf5a for instance 97379c08-f144-4054-a9b9-f7a548e2a061 on n-h2-858495-2 Sep 23 04:02:47.325844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3b3fd05b-d93c-43db-a53a-fb24824f39f4 req-af60f347-fc15-4fad-8f89-bef21b839958 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087541 Sep 23 04:02:47.327604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2536/4966] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:47.741312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:47.742186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:47.755823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:47.757680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:47.759061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:47.760037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:47.761111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:47.761842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.039926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:48.041778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:48.058153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.059129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.066852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.070744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.071568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.074219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.127400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:48.142241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:48.147736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:48.151406 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d36b443-8874-4b1d-a421-f22d1c20cc76 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.413247 Sep 23 04:02:48.165461 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2431/4967] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:47 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:48.260314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:48.261202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] [instance: 97379c08-f144-4054-a9b9-f7a548e2a061] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:48.274246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.275272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.276014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.277188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.277846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.278452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.321420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] HTTP exception thrown: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Request method failure captured: Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 HTTP/1.1 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS7O--bEOlMar5E37QKPJcXOVyM1BomFFMa7GmG32_8HUYwH1yyNE7rq8zog7EFPMqXevRCVls-6TFqRKZoMBUGQ7H0PdJAGOZtg78GDHXVZWH2zbY40NJg7LsciuVbX-l3o84wnj4XW6aVZaq-UDHuIFrL1sFdwhzzZ_VspAcbNMGE Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1dd28846bbd84139a95f8d509db77cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 1dd28846bbd84139a95f8d509db77cea Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832350172 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6539dc2b60a14449b5a970a8f558a691 Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1832350172-project Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '97379c08-f144-4054-a9b9-f7a548e2a061'} Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:02:48.323415 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. Sep 23 04:02:48.328774 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:02:48.330202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] Returning 404 to user: Instance 97379c08-f144-4054-a9b9-f7a548e2a061 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:02:48.333402 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b508d963-cb2c-4aaf-82ea-a1bdd4f98f61 tempest-ServersNegativeTestJSON-1832350172 tempest-ServersNegativeTestJSON-1832350172-project] 10.222.0.25 "GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061" status: 404 len: 111 microversion: 2.1 time: 0.078742 Sep 23 04:02:48.335153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2432/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:48 2022] GET /compute/v2.1/servers/97379c08-f144-4054-a9b9-f7a548e2a061 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:02:48.345497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:48.348041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:48.364733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.365487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.366120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.369232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:48.369903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:48.371260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:48.805098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:48.818332 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4140151-fb0a-438f-b5f4-494af44d82d0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1273 microversion: 2.1 time: 0.481882 Sep 23 04:02:48.819095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2433/4969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:48 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:48.855855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:48.874285 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-974b5a5b-0eac-49f6-a938-e63f6fdbe067 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 0.842725 Sep 23 04:02:48.875286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2537/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:48 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:49.184746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:49.185867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:49.207207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.209173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.210449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:49.216963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.218700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.219297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:49.453367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:49.472733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:49.479805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:49.485077 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2629e25d-1290-4700-9983-5324717298cb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.303953 Sep 23 04:02:49.487732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2434/4971] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:49 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:49.845995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:49.846846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:49.856654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.857553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.858200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:49.859283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.859918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.860525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:49.907715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:49.908596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:49.926281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.927653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.928737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:49.930830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:49.934313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:49.937818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:51.363181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:51.366733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:51.377662 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3dddde62-4c54-4be7-ad15-ac9674bf2a2e tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 1.536473 Sep 23 04:02:51.389058 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26a80f47-b005-4e0e-8cd3-be996729f626 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1678 microversion: 2.1 time: 1.487572 Sep 23 04:02:51.397497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2538/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:49 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:51.409427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2435/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:49 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1678 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:51.416447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:51.417421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:51.429156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:51.430226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:51.430680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:51.431407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:51.441986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:51.442472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:51.715520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:51.727878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:51.735193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:51.736483 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22cd22f3-e2dd-4032-8416-e6d6c28157a3 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.337852 Sep 23 04:02:51.737674 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2539/4974] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:51 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:52.404366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:52.406193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:52.417155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:52.417894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:52.426200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:52.428873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:52.429480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:52.430657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:52.434420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:52.435035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:52.438186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:52.438877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:52.443337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:52.447402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:52.448218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:52.448767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:52.533290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:53.245772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:53.410201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:53.420231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71a9943a-4234-4b39-b28f-2dafa0f32505 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 1.022040 Sep 23 04:02:53.435905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2436/4975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:52 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:53.450793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e2c50c-8be7-42cc-87d6-0ee4f9fa818b", "tag": "859923fa-037c-42ec-a33d-b445e92ee884"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:53.469877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.477573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.478206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:53.483219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:53.513455 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] Creating event network-changed:859923fa-037c-42ec-a33d-b445e92ee884 for instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b on n-h2-858495-2 Sep 23 04:02:53.520207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6f0058ce-bbba-4322-8ec9-b4e17dec1640 req-41dbc061-2ae3-4b3b-8c32-0a7d6707243f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082675 Sep 23 04:02:53.528364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2437/4976] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:02:53.535054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:53.540678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:53.559601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.560202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.561231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:53.561630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.562190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.562729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:53.572176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:53.596869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7563d7e-08b0-4723-84d1-df2092caf5b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1655 microversion: 2.1 time: 1.184127 Sep 23 04:02:53.597511 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2540/4977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:52 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1655 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:53.634652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:02:53.650060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:53.656961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.658433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.659414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:53.770309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Going to try to start instance {{(pid=128724) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:02:53.862044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b53cae82-dbfc-4866-ac28-842c1c4ebc34 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.237889 Sep 23 04:02:53.875988 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2541/4978] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:02:53 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:02:53.891145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:53.901627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:53.908654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:53.909853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:53.911686 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-539a50ab-5f99-4a47-baec-e24faa35d4a7 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.381521 Sep 23 04:02:53.916679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:53.918195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2438/4979] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:53 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:53.963149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.963706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.966689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:53.967684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:53.968332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:53.971195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:54.447763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:54.448378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:54.455493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:54.458984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:54.464036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:54.465141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:54.470002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:54.470728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:54.635311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:54.647192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04e60978-1871-424d-8f68-cae9b33f2456 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1664 microversion: 2.1 time: 0.769791 Sep 23 04:02:54.668204 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2542/4980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:53 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1664 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:54.946889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:54.947805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:54.964836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:54.965625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:54.968493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:54.969427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:54.970060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:54.970659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:55.285158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:55.297760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9725544-e3ad-4780-a01a-e9f044bef64a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 0.854168 Sep 23 04:02:55.314215 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2439/4981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:54 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:02:55.396900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:55.410684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:55.412240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:55.413502 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0f448a4-befa-45b4-ab1b-01515c7bdcda tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.471387 Sep 23 04:02:55.415134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2543/4982] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:54 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:02:55.675482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:55.676760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:55.693661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:55.694461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:55.702151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:55.703235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:55.704044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:55.705077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:56.028125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:56.036480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74cacedf-3dcb-4b49-82e8-9f3f885953af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1664 microversion: 2.1 time: 0.364719 Sep 23 04:02:56.046160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2440/4983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:55 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1664 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:56.332046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:56.333630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:56.359206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:56.360281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:56.361152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:56.363802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:56.364480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:56.367029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:56.443500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:56.444114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:56.450039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:02:56.459297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:56.462817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:56.463499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:56.464427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:56.472129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:56.473603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:57.149861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:57.169398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:57.174567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:57.175812 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42b7c2b7-2a12-439f-bf78-e130fd011abb tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.736304 Sep 23 04:02:57.176412 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2441/4984] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:56 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:02:57.197185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:57.197185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:57.202043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:57.202932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:57.203728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:57.204782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:57.211462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:57.212127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:57.513232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:57.530955 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20a10bc9-8db2-435b-8904-cfb03fca6af0 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 1.199515 Sep 23 04:02:57.532680 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2544/4985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:56 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:58.051417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:58.065544 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1526715d-50fa-400b-8236-13645d947560 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.887714 Sep 23 04:02:58.084501 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2442/4986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:57 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:58.092804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:58.093640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:58.103358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.107369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.107884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.109241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.109758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.110911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.204657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:58.205255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:58.220861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.221370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.226006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.227302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.227778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.228214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.528154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:58.537726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:58.539729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:58.540939 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf5726f2-d0d3-4e39-9053-ae2c20b773a2 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.340202 Sep 23 04:02:58.561990 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2443/4987] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:58 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:02:58.566895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:58.575500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:58.602236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.602740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.603184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.603918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.604376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.604802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.706686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:58.724246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0eace971-74f0-4861-9434-4093b92db1b3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.632312 Sep 23 04:02:58.728884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2545/4988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:58 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:58.755533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:58.756516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:58.766945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.767455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.767900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:58.771414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:58.771927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:58.772377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:59.726123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:59.742038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19731035-cfbf-425b-bf8b-7f15c185d9ca tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.991576 Sep 23 04:02:59.757822 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2546/4989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:58 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:02:59.761583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:02:59.762258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:02:59.777434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:59.777948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:59.778401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:59.779127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:02:59.779603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:02:59.783118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:02:59.965774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:02:59.997561 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10d78da5-1f9e-40c7-aa89-35331954399a tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 1.425632 Sep 23 04:03:00.011347 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2444/4990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:02:58 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:00.043923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:00.044581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:00.082230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.082751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.083216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:00.086915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.092363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.092823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:00.135882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:00.163357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:00.190277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:00.191571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e529bdf-4c9b-484e-905f-7220817086fc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.447053 Sep 23 04:03:00.192193 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2547/4991] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:02:59 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:00.214895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:00.215398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:00.229165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.234970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.236958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:00.239722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.240605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.241254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:00.341041 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4202189-af38-4cfa-ab3b-b972c749abe1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/ips" status: 200 len: 150 microversion: 2.20 time: 0.139406 Sep 23 04:03:00.343613 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2548/4992] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Sep 23 04:03:00 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/ips => generated 150 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:03:00.524939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:00.556850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d19962d-c07f-421f-afdc-e6c9ac98d4c3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.530599 Sep 23 04:03:00.577477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2445/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:00 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:00.586348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:00.587098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:00.605099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.608428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.610085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:00.612941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:00.613978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:00.615337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.048046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:01.048046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:01.052248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.052738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.053075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.053895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.054297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.054728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.085127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:01.100276 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7856dd56-712e-4df0-9cc0-8e6ebadd2e7a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.518236 Sep 23 04:03:01.109457 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2549/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:00 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:01.132669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:01.134238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:01.145640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.149105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.149766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.151844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.152676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.153600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.208118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lazy-loading 'flavor' on Instance uuid 6c107016-cad8-4572-adcb-fd804409f4aa {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:03:01.433863 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d7d3da6-f419-43ed-b35e-cee0d3057553 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.306771 Sep 23 04:03:01.439043 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2550/4995] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:03:01 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:03:01.448249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:01.475898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:01.493843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.494652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.495741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.500918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.502771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.503582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.665600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:01.694174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:01.697148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:01.702909 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6c4dd64-dc71-4804-a6c6-5213af2e7840 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.256855 Sep 23 04:03:01.703887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2551/4996] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:01 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:01.714902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:01.717063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:01.740795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.741327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.744196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.746629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:01.748973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.749514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.750138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:01.771572 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f99fa786-37a6-4c06-b379-e9d274860f12 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 0.737838 Sep 23 04:03:01.775023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2446/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:01 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:01.837709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e2c50c-8be7-42cc-87d6-0ee4f9fa818b", "name": "network-vif-plugged", "status": "completed", "tag": "859923fa-037c-42ec-a33d-b445e92ee884"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:01.873965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:01.877594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:01.878123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:02.129291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:02.144212 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7b42638-60a5-4ed8-b3ac-8d4cf9b6611d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1676 microversion: 2.1 time: 0.437349 Sep 23 04:03:02.169783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2552/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:01 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1676 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:02.740599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:02.742200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:02.768790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:02.771632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:02.776460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:02.781387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:02.782308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:02.783268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:02.784138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] Creating event network-vif-plugged:859923fa-037c-42ec-a33d-b445e92ee884 for instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b on n-h2-858495-2 Sep 23 04:03:02.799903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-96ab89ac-18fc-4c3e-9885-57a75de572eb req-3151dfe8-0475-4d74-8793-58d822bd4988 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.966825 Sep 23 04:03:02.803909 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2447/4999] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:03:02.816074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:02.826644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:02.851640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:02.854983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:02.856499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:02.861548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:02.862899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:02.866044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.142844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:03.161671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:03.165783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:03.168698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a63f8e5-9edc-4b76-95f0-51487339fc66 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.436537 Sep 23 04:03:03.171914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2553/5000] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:02 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:03.185560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:03.186650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:03.195996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.200940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.204795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.205811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.206445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.207156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.597709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:03.614349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e073400a-1a0a-4595-a0f8-bfd9a00f803a tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1659 microversion: 2.1 time: 0.432838 Sep 23 04:03:03.614946 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2554/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:03 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1659 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:03.641811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:03.642635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:03.654420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.658078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.658802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.659724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.662134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.662809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.664877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:03.682353 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-55c9dd25-1c4a-498b-90fe-008fe5b4b045 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 0.876923 Sep 23 04:03:03.693389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2448/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:02 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:03.840202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b56a3e4-fb65-452b-90a2-7f91bb54f357 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.202264 Sep 23 04:03:03.840990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2555/5003] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:03:03 2022] POST /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:03:03.850646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:03.852765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:03.867267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.869338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.870006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.871215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.872094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:03.873124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:03.874687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.875419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.894074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.894575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.895372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.896284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:03.900490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:03.901163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:03.961738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lazy-loading 'flavor' on Instance uuid 74f9860d-c80e-4fed-ba41-76b76d507172 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:03:04.106504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:04.272102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:04.294392 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8ccb7d7-fa42-4716-8343-144461db59af tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1665 microversion: 2.1 time: 0.448010 Sep 23 04:03:04.309914 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2449/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:03 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1665 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:04.329109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:04.330117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:04.339614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4eb4c315-09b9-41c2-87f9-38b749e66cef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/action" status: 202 len: 0 microversion: 2.20 time: 0.473425 Sep 23 04:03:04.341650 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2556/5005] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 04:03:03 2022] POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:04.352226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:04.353522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:04.361100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.362468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.363344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:04.364455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.365815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.366417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.366971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:04.367098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.367558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:04.368324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.368798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.369244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:04.579935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:04.595322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:04.601819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:04.603281 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4640ccc3-228a-49a0-bd61-7ef606493358 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.288295 Sep 23 04:03:04.625315 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2450/5006] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:04 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:04.712748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:04.713756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:04.723975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.725299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.727907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:04.729843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:04.730589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:04.733475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:05.173928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.187156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.191260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.193919 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7471efdb-bbaf-438a-8cda-64f13bbfbd24 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.847499 Sep 23 04:03:05.196579 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2557/5007] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:04 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:05.209649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.222378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d2b4c0c-6c18-4dfd-b170-94e5df8c882f tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1315 microversion: 2.1 time: 0.512231 Sep 23 04:03:05.237900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2451/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:04 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:05.319091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:05.320175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:05.329749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:05.330245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:05.331442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:05.332238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:05.332704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:05.333138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:05.639229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:05.640111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:05.659248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:05.664042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:05.666574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:05.669316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:05.671854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:05.672459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:05.760821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.775563 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f100007b-da46-4610-a1f1-365cede1d4de tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1665 microversion: 2.1 time: 0.459220 Sep 23 04:03:05.776459 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2558/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:05 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1665 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:05.779639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.793528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.795425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89afe168665e43159198b1225bbb8d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e459d2f8ebf0450bb0ae024b06843645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:05.796842 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec4c0abe-05cc-4ffe-b712-ac466334dbf5 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 200 len: 1604 microversion: 2.42 time: 0.165918 Sep 23 04:03:05.810514 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2452/5010] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:05 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:06.188295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1657e59-aec0-4fb2-ab1e-db9d0afe47fa tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Action: 'create', calling method: .version_select at 0x7f0c8a33a280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-349677959", "metadata": {"Type": "work"}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1657e59-aec0-4fb2-ab1e-db9d0afe47fa tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 121 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-349677959", "metadata": {"Type": "work"}}} Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-349677959', 'metadata': {'Type': 'work'}}}} Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:03:06.192202 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1657e59-aec0-4fb2-ab1e-db9d0afe47fa tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1657e59-aec0-4fb2-ab1e-db9d0afe47fa tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.155140 Sep 23 04:03:06.204069 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2559/5011] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 23 04:03:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:03:06.205331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-071583ae-97b0-4a4c-bd8e-80c8e3c1952f tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Action: 'create', calling method: .version_select at 0x7f0c8a3768b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1333352055", "metadata": {"Type": "work"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-071583ae-97b0-4a4c-bd8e-80c8e3c1952f tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 120 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1333352055", "metadata": {"Type": "work"}}} Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1333352055', 'metadata': {'Type': 'work'}}}} Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi '0' Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:03:06.207491 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-071583ae-97b0-4a4c-bd8e-80c8e3c1952f tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-071583ae-97b0-4a4c-bd8e-80c8e3c1952f tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009445 Sep 23 04:03:06.214608 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2453/5012] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 23 04:03:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:03:06.219288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45b3b54e-e36b-44e2-a747-32611897fffc tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Action: 'create', calling method: .version_select at 0x7f0c8a6a3310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-497109759", "metadata": {"Type": "work"}}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45b3b54e-e36b-44e2-a747-32611897fffc tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 118 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-497109759", "metadata": {"Type": "work"}}} Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-497109759', 'metadata': {'Type': 'work'}}}} Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:03:06.227909 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45b3b54e-e36b-44e2-a747-32611897fffc tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-45b3b54e-e36b-44e2-a747-32611897fffc tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014238 Sep 23 04:03:06.233301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2560/5013] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 23 04:03:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:03:06.234708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.234708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.244716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ca6cf81-60fc-4379-b8c4-43b4714a0391 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Calling method '.version_select at 0x7f0c8afc54c0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.256632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.257195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.257690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.258409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.258866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.259300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.281217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-3ca6cf81-60fc-4379-b8c4-43b4714a0391 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] HTTP exception thrown: Volume tempest-invalid-1657668501 could not be found. Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ca6cf81-60fc-4379-b8c4-43b4714a0391 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1657668501 HTTP/1.1 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: exception: Volume tempest-invalid-1657668501 could not be found. Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'tempest-invalid-1657668501'} Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1657668501 could not be found. (HTTP 404) (Request-ID: req-91727847-4f5c-4cad-b384-63178c404e34) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:03:06.283262 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1657668501 could not be found. Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1657668501 could not be found. Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1657668501 could not be found. Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ca6cf81-60fc-4379-b8c4-43b4714a0391 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 404 to user: Volume tempest-invalid-1657668501 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ca6cf81-60fc-4379-b8c4-43b4714a0391 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1657668501" status: 404 len: 99 microversion: 2.1 time: 0.045817 Sep 23 04:03:06.289003 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2561/5014] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 04:03:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1657668501 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:03:06.293664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.294231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.303208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.303701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.304224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.305025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.305510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.306062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.485460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:06.510991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:06.513343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:06.514737 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d658521f-a8a0-42ac-9c0a-ebe135aa4a03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.290740 Sep 23 04:03:06.522606 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2454/5015] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:06.530635 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51bd5487-af66-4842-aa3a-6aefdb72a6dd tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004827 Sep 23 04:03:06.539333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2455/5016] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 23 04:03:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 04:03:06.556510 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75b90548-e2e9-4ddf-bfd3-0cfe10ffe18d tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009174 Sep 23 04:03:06.557523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2456/5017] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 04:03:06.572882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4643e901-21e2-48f5-8ac6-7fe2f4accf87 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Calling method '.version_select at 0x7f0c8a2f3af0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.605658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:06.618189 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f05684e-b642-46f6-aa2c-2af6551a4d35 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1503 microversion: 2.1 time: 0.330964 Sep 23 04:03:06.618907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2562/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:06.623778 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-4643e901-21e2-48f5-8ac6-7fe2f4accf87 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] HTTP exception thrown: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4643e901-21e2-48f5-8ac6-7fe2f4accf87 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-volumes/7234747f-4b33-4df1-9cbf-c43dc49642b5 HTTP/1.1 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: exception: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7234747f-4b33-4df1-9cbf-c43dc49642b5'} Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. (HTTP 404) (Request-ID: req-432d04c1-828d-4b16-85d4-b8080890dbe7) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:03:06.627222 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4643e901-21e2-48f5-8ac6-7fe2f4accf87 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 404 to user: Volume 7234747f-4b33-4df1-9cbf-c43dc49642b5 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4643e901-21e2-48f5-8ac6-7fe2f4accf87 tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/7234747f-4b33-4df1-9cbf-c43dc49642b5" status: 404 len: 109 microversion: 2.1 time: 0.064036 Sep 23 04:03:06.634306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2457/5019] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:03:06 2022] DELETE /compute/v2.1/os-volumes/7234747f-4b33-4df1-9cbf-c43dc49642b5 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:03:06.656170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.656884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ef22c2b-53be-4cc4-8aa6-1a6c054afbce tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Calling method '.version_select at 0x7f0c8b2368b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.657536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.669730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.672050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.672861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.673793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.674793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.675350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.699539 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1ef22c2b-53be-4cc4-8aa6-1a6c054afbce tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] HTTP exception thrown: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ef22c2b-53be-4cc4-8aa6-1a6c054afbce tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Request method failure captured: Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/os-volumes/859911d5-a23b-4e3b-aae5-4b1d84071b94 HTTP/1.1 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS_5pu2Ea0TyuuOkO5tHe5X-cg1OP728X77ZBGNxvuKQ18wTIOecEt7A-vdVrdNTA339qbFkmQJXSXFlHCfEx3jIFBA_T8fH5ApCpy_1-u7eW_v1BfqDNGsqsQ9DnodrU6qqkGQr-6EBu492VuwiMJTusshgDqp3PJtG7vHXlyInk0s Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8804d45be1234662a8ab3064361632d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8804d45be1234662a8ab3064361632d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8804d45be1234662a8ab3064361632d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8804d45be1234662a8ab3064361632d7 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesNegativeTest-813301466 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 4b1144872ee0498a9045a3477e38b061 Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesNegativeTest-813301466-project Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: exception: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '859911d5-a23b-4e3b-aae5-4b1d84071b94'} Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. (HTTP 404) (Request-ID: req-fd4a05f6-6e4b-4c4d-804d-8076eff600f9) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:03:06.701775 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.707063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ef22c2b-53be-4cc4-8aa6-1a6c054afbce tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] Returning 404 to user: Volume 859911d5-a23b-4e3b-aae5-4b1d84071b94 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.716293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ef22c2b-53be-4cc4-8aa6-1a6c054afbce tempest-VolumesNegativeTest-813301466 tempest-VolumesNegativeTest-813301466-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/859911d5-a23b-4e3b-aae5-4b1d84071b94" status: 404 len: 109 microversion: 2.1 time: 0.057398 Sep 23 04:03:06.716293 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2563/5020] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/os-volumes/859911d5-a23b-4e3b-aae5-4b1d84071b94 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:06.740740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:06.777537 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-863691eb-7ded-4341-a630-83488101895c tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.126222 Sep 23 04:03:06.779060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2458/5021] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Sep 23 04:03:06 2022] DELETE /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b/os-server-password => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:06.788766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.789306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.802680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.803403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.809639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.810320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.810913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.811508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.811683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.812091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.812526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.812858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.813696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.815293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.815852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.816532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.841075 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fe5db4e-212c-4322-8c6f-9be8af24b879 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.056768 Sep 23 04:03:06.844715 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2564/5022] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b/os-server-password => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:03:06.850115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.851291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.866439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.866962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.867424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.868141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.868602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.869035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.886311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] HTTP exception thrown: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Request method failure captured: Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a HTTP/1.1 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS6AMH6nXR_lPb4n49J92CWv4NMI9gaTWAVKYqn86rv28FWnZ6r1Az5w0z9OT9NwVgIOzBd9TLETmfekYkjJWCM-ydnjpaPhp-PeAzcDLdZkTI-Y3JcdwsmDC4_g3fvrCfyyvNSZDQitESuqAD4WttN7DksE7vu59Gd9v8vc6feMGRQ Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 89afe168665e43159198b1225bbb8d76 Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'c710beef-c0e4-47ac-a14b-30ee2c4b8b9a'} Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.887875 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Returning 404 to user: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0a94762-c0e3-4770-a177-f3911d9586bc tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 404 len: 111 microversion: 2.42 time: 0.043603 Sep 23 04:03:06.894580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2565/5023] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:03:06.896350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:06.896851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:06.908351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.908775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.909221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.909975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:06.910420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:06.910855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:06.941929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:07.034492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.049583 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7bebac2-176d-4a65-abd5-1b747d3266d3 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 204 len: 0 microversion: 2.1 time: 0.157811 Sep 23 04:03:07.050977 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2566/5024] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:06 2022] DELETE /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:07.052688 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c3d7790-1823-4a56-b320-1ba5d9b18e57 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.254366 Sep 23 04:03:07.065376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2459/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:06 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:07.065376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:07.065376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:07.065933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24954c5c-6110-4535-927b-02a5e7c31723 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '.version_select at 0x7f0c8b10c820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:07.067969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.068704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.070246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.071215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.071907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.072583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.092281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24954c5c-6110-4535-927b-02a5e7c31723 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837347441" status: 204 len: 0 microversion: 2.42 time: 0.038915 Sep 23 04:03:07.092905 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2567/5026] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 23 04:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837347441 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:03:07.097999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:07.098891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:07.108951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.109484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.110074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.111569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.112451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.113059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.395982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.405201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.408551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-851820a1-e6cc-4837-beb6-586b366a89fc tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1509 microversion: 2.1 time: 0.352961 Sep 23 04:03:07.409859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2460/5027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:07 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:07.415651 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78a19724-8e25-46c7-81e8-34a47db26056 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1668 microversion: 2.1 time: 0.321675 Sep 23 04:03:07.434623 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2568/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:07 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:07.441032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:07.441579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:07.447964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.448655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.449309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.450237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.450911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.451549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.513779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:07.520916 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Working on deleting snapshot 7cd58fd1-fc6f-4ca7-b6e5-c8113a04ed06 from shelved instance... Sep 23 04:03:07.547899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:07.548531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:07.556589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.557528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.558163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.559037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:07.561499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:07.562263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:07.885063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.900521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.904918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:07.906623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2c29027c-855c-49ea-bd6b-161a0117cf0b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.365062 Sep 23 04:03:07.907742 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2569/5029] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:07 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:08.438767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:08.439638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:08.454558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:08.455305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:08.459506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:08.461544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:08.463202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:08.464769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:08.652743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Doing local delete in cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) {{(pid=128723) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 23 04:03:08.654725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:08.655374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:08.658132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:08.658783 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 23 04:03:08.668523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] deallocate_for_instance() {{(pid=128723) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 23 04:03:08.804860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:08.815179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d866443f-defa-40c4-af33-f879184a7cc8 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1509 microversion: 2.1 time: 0.381484 Sep 23 04:03:08.816495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2570/5030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:08 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:08.934777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:08.935485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:08.943074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:08.943570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:08.944015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:08.944884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:08.945650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:08.946093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:09.270249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:09.279984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:09.297572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:09.299037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc246e86-8f42-40fc-b359-ee559f09c1fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.368711 Sep 23 04:03:09.299651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2571/5031] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:08 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:09.855635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:09.856383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:09.873815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:09.874511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:09.874962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:09.876458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:09.877645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:09.878208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:10.210075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0410bcba4a314f8bbcb4dea2fbcaaafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e749e84c5d8c4137b038d29fb9990f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:10.221906 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37826f1c-993b-4064-8414-88c815a6c982 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 200 len: 1509 microversion: 2.1 time: 0.382616 Sep 23 04:03:10.222480 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2572/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:09 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:10.329791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:10.330778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:10.345654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:10.346429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:10.347899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:10.348810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:10.352454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:10.353299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:10.714434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Updating instance_info_cache with network_info: [] {{(pid=128723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:03:11.094696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:11.104751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:11.110583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:11.117139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-11c464cd-fb6c-4c92-a0fb-5a5ca2d5c86f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.792320 Sep 23 04:03:11.118049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2573/5033] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:10 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:11.129417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e2c50c-8be7-42cc-87d6-0ee4f9fa818b", "name": "network-vif-deleted", "tag": "859923fa-037c-42ec-a33d-b445e92ee884"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:11.140444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a725c13-5f9b-4c00-8d03-2466df40fdfc tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 204 len: 0 microversion: 2.1 time: 3.702784 Sep 23 04:03:11.141152 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2461/5034] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:07 2022] DELETE /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 0 bytes in 3705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:11.157447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.160737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.161185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.169828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:11.171074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 2e804563-e91b-4bb5-ad25-ea6bc66a7be7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:11.192487 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] Creating event network-vif-deleted:859923fa-037c-42ec-a33d-b445e92ee884 for instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b on n-h2-858495-2 Sep 23 04:03:11.194976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.208187 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-be16305f-4c80-41e8-8898-2b1f5d1b2f93 req-d890c895-264c-4252-9cd2-0b9d076d0d05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082648 Sep 23 04:03:11.209390 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2574/5035] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:11.211391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.217438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.221893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.223762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.226783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.253305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:11.254780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] [instance: 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:11.268835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.271372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.272176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.273789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.275577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.277716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.297429 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 HTTP/1.1 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2e804563-e91b-4bb5-ad25-ea6bc66a7be7'} Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:11.308848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. Sep 23 04:03:11.314641 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.317688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 404 to user: Instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:11.318923 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fb61610-3741-4305-a4f2-870c8e334cb9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7" status: 404 len: 111 microversion: 2.1 time: 0.168546 Sep 23 04:03:11.322346 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] HTTP exception thrown: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Request method failure captured: Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b HTTP/1.1 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS_e2wvfHKHLmJ_t-Ykj9Z7XQ2uy5EH91GAAWQfZv6b-XDrMT7qKEuBrVT-UaymwVT9jM3EiCWQv97cSq4Fx2lu9YgraALzEuaaHHnj4iUeu7nMJOWXS1hn_f8wp8K7MfQMP80mlF_vzbJxNwo21LO6U0L3BMOzvdHL2r69wWoDMmpA Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e749e84c5d8c4137b038d29fb9990f89 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerPasswordTestJSON-1416133603 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e749e84c5d8c4137b038d29fb9990f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e749e84c5d8c4137b038d29fb9990f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e749e84c5d8c4137b038d29fb9990f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e749e84c5d8c4137b038d29fb9990f89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerPasswordTestJSON-1416133603 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e749e84c5d8c4137b038d29fb9990f89 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1416133603 Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerPasswordTestJSON-1416133603-project Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0410bcba4a314f8bbcb4dea2fbcaaafc Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerPasswordTestJSON-1416133603-project Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '32e2c50c-8be7-42cc-87d6-0ee4f9fa818b'} Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:11.329415 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. Sep 23 04:03:11.335330 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:11.337280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] Returning 404 to user: Instance 32e2c50c-8be7-42cc-87d6-0ee4f9fa818b could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:11.339256 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b7acb61-2525-4c82-92d7-4c4f056c7eb6 tempest-ServerPasswordTestJSON-1416133603 tempest-ServerPasswordTestJSON-1416133603-project] 10.222.0.25 "GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b" status: 404 len: 111 microversion: 2.1 time: 0.092163 Sep 23 04:03:11.342184 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2575/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:11 2022] GET /compute/v2.1/servers/32e2c50c-8be7-42cc-87d6-0ee4f9fa818b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:03:11.348313 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2462/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:11 2022] GET /compute/v2.1/servers/2e804563-e91b-4bb5-ad25-ea6bc66a7be7 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:11.369735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:11.372025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:11.395899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.396415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.396863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.407528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.408134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.408601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.516363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:11.682978 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1c47cb3-b011-49f2-ae9e-482e3d645cd3 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 204 len: 0 microversion: 2.1 time: 0.332364 Sep 23 04:03:11.685668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2576/5038] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:11 2022] DELETE /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:03:11.693687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:11.694426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:11.706604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.711199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.716074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.718530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:11.719271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:11.719797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:11.950433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:11.966239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b283969-8063-466b-b600-ea598681a23d tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1466 microversion: 2.1 time: 0.276253 Sep 23 04:03:11.967350 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2463/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:11 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1466 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:12.145697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:12.146373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:12.158959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:12.161402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:12.163623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:12.165912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:12.168596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:12.170830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:12.186248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:12.478207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:12.489875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:12.492167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:12.493419 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a6fc95b-987a-47f1-a359-957763ff4d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.352119 Sep 23 04:03:12.506181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2577/5040] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:12 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:12.997029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:12.998514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:13.014696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:13.015913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:13.030109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:13.031381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:13.033832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:13.043042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:13.256531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e804563-e91b-4bb5-ad25-ea6bc66a7be7", "name": "network-vif-deleted", "tag": "20936caf-6723-490a-ae6b-f9dfe1230659"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:13.279719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:13.290027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01382805-5ed4-4194-903e-a8b9690de0a0 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1466 microversion: 2.1 time: 0.299618 Sep 23 04:03:13.297295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2464/5041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:12 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1466 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:13.313406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:13.320605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:13.326819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:13.346569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.server_external_events [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] Unable to find a host for instance 2e804563-e91b-4bb5-ad25-ea6bc66a7be7. Dropping event network-vif-deleted {{(pid=128724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 04:03:13.356472 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f01b14fb-6798-4a88-8223-de5a509550d9 req-5158955e-0655-4a56-a39a-f43228ed1dc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.105271 Sep 23 04:03:13.357623 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2578/5042] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 23 04:03:13.527847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:13.529030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:13.539363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:13.544305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:13.545100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:13.546225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:13.548191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:13.550462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:13.841850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:13.854133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:13.857266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:13.859174 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7453957d-2b8d-47a8-b242-178d7bfff835 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.337607 Sep 23 04:03:13.859749 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2465/5043] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:13 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:14.324339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:14.324952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:14.345715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.346319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.346778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.364009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.364552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.368999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.602217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:14.603448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:14.612665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:14.614919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.615846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.617038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.618846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.620481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.621174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.648364 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] HTTP exception thrown: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Request method failure captured: Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a HTTP/1.1 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6AMH6nXR_lPb4n49J92CWv4NMI9gaTWAVKYqn86rv28FWnZ6r1Az5w0z9OT9NwVgIOzBd9TLETmfekYkjJWCM-ydnjpaPhp-PeAzcDLdZkTI-Y3JcdwsmDC4_g3fvrCfyyvNSZDQitESuqAD4WttN7DksE7vu59Gd9v8vc6feMGRQ Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89afe168665e43159198b1225bbb8d76 Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c710beef-c0e4-47ac-a14b-30ee2c4b8b9a'} Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:14.650575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.655057 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.655845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:14.658273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Returning 404 to user: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:14.659768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-715b0d17-58a1-41e2-a557-d3e2bdb04401 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 404 len: 111 microversion: 2.42 time: 0.063320 Sep 23 04:03:14.660293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7cc02631-0b39-4b69-8b5f-fe24941c0a15 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 200 len: 1300 microversion: 2.1 time: 0.341323 Sep 23 04:03:14.662874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2466/5044] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:03:14 2022] DELETE /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:03:14.668037 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2579/5045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:14 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 1300 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:14.672522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:14.673465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] [instance: c710beef-c0e4-47ac-a14b-30ee2c4b8b9a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:14.681764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.682299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.682721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.683452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.684292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.685319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.704188 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] HTTP exception thrown: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Request method failure captured: Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a HTTP/1.1 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS6AMH6nXR_lPb4n49J92CWv4NMI9gaTWAVKYqn86rv28FWnZ6r1Az5w0z9OT9NwVgIOzBd9TLETmfekYkjJWCM-ydnjpaPhp-PeAzcDLdZkTI-Y3JcdwsmDC4_g3fvrCfyyvNSZDQitESuqAD4WttN7DksE7vu59Gd9v8vc6feMGRQ Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e459d2f8ebf0450bb0ae024b06843645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: e459d2f8ebf0450bb0ae024b06843645 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-662421468 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 89afe168665e43159198b1225bbb8d76 Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-662421468-project Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c710beef-c0e4-47ac-a14b-30ee2c4b8b9a'} Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.706447 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] Returning 404 to user: Instance c710beef-c0e4-47ac-a14b-30ee2c4b8b9a could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d71bac63-c90c-4960-a840-e87b91ed3595 tempest-TaggedBootDevicesTest_v242-662421468 tempest-TaggedBootDevicesTest_v242-662421468-project] 10.222.0.25 "GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a" status: 404 len: 111 microversion: 2.42 time: 0.041721 Sep 23 04:03:14.714002 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2467/5046] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:14 2022] GET /compute/v2.1/servers/c710beef-c0e4-47ac-a14b-30ee2c4b8b9a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:03:14.893724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:14.894359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:14.913879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.914405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.916845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:14.919131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:14.921948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:14.923624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.335120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:15.352330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:15.353915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:15.358539 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-138c107c-8379-411f-a4a3-72538f22f9dc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1744 microversion: 2.20 time: 0.469037 Sep 23 04:03:15.360324 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2580/5047] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:14 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1744 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:15.386887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c4b7cd-b822-464e-8113-b62c712f741c", "name": "network-vif-deleted", "tag": "47075061-f5f5-4fc8-8293-56438a5d995b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:15.405703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:15.413838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:15.415418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.447327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1490519199", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "be7c639c-9879-4226-bbc4-b232b67f64ee"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:15.462782 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] Creating event network-vif-deleted:47075061-f5f5-4fc8-8293-56438a5d995b for instance d1c4b7cd-b822-464e-8113-b62c712f741c on n-h2-858495-2 Sep 23 04:03:15.473596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-85bf21c0-cb66-4121-b66e-09b35e8afe4d req-d69a924e-eeed-40f0-87d2-6f18eaaff06b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090439 Sep 23 04:03:15.480308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2468/5048] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:15.557493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] validate_networks() for [('be7c639c-9879-4226-bbc4-b232b67f64ee', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:03:15.687995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:15.689942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: d1c4b7cd-b822-464e-8113-b62c712f741c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:15.724438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:15.725090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:15.725688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.726471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:15.727032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:15.727560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.760332 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c HTTP/1.1 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd1c4b7cd-b822-464e-8113-b62c712f741c'} Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:15.762407 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 404 to user: Instance d1c4b7cd-b822-464e-8113-b62c712f741c could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:15.769437 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-24dccf3b-8e01-4a72-be9e-a3f96604c027 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c" status: 404 len: 111 microversion: 2.1 time: 0.080626 Sep 23 04:03:15.775611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2469/5049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:15 2022] GET /compute/v2.1/servers/d1c4b7cd-b822-464e-8113-b62c712f741c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:15.785094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:15.786248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:15.799864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:15.801605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:15.803916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.804691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:15.807916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:15.809078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:15.894058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:15.997389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=17,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:16.145524 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6a153b0-241f-4ffe-91bb-30e5cb3faefa tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 204 len: 0 microversion: 2.1 time: 0.370194 Sep 23 04:03:16.146687 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2470/5050] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:15 2022] DELETE /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:16.156535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:16.163532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:16.172218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.176452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.177048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.179406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.180048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.180621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.560616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:16.573024 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b7761ca-7f97-4491-8697-9a3a2edf3f12 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1506 microversion: 2.1 time: 0.421858 Sep 23 04:03:16.573659 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2471/5051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:16 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:16.594348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:16.595527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:16.610523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.613086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.614247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.615407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.617292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.618065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.820555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:16.821038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:16.821506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:16.822002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:16.822607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:16.841098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.841551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.842001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.842983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:16.843441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:16.845204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:16.882378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:16.889255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Getting quotas for project 7b7339be0b514c6bbfccad76f5d27058. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:03:16.896661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:16.898491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Getting quotas for user 24f92d9dc8544b74897098bad4a2f5ed and project 7b7339be0b514c6bbfccad76f5d27058. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:03:16.899061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:16.900583 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd6189b8-41f1-4a64-b193-b1b8e149de66 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1744 microversion: 2.20 time: 0.315756 Sep 23 04:03:16.901734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2472/5052] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:16 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1744 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:16.929465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:03:16.931899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:03:16.980689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:17.045396 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b76f6107-851f-4d7d-b7d7-671536ef860b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602298 Sep 23 04:03:17.046663 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2581/5053] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:03:17.058223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd6a9b40-8024-4c59-bad6-4b1b9b1551dc tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:17.058839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd6a9b40-8024-4c59-bad6-4b1b9b1551dc tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:17.330311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd6a9b40-8024-4c59-bad6-4b1b9b1551dc tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:17.345904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd6a9b40-8024-4c59-bad6-4b1b9b1551dc tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1214 microversion: 2.1 time: 0.292050 Sep 23 04:03:17.347900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2473/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:17 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:17.601622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:17.602175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:17.640711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:17.642638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:17.643338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:17.646300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:17.650317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:17.650987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:17.933951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:17.935269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:17.944200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:17.944897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:17.945547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:17.946957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:17.947749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:17.949019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:18.308394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:18.318199 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6a1b1b4-a815-4029-8f3d-7d3e4df62909 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1506 microversion: 2.1 time: 0.721555 Sep 23 04:03:18.321158 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2582/5055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:17 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:18.372405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f39736d-099b-4b82-b558-198eb0ab799b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:18.373489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f39736d-099b-4b82-b558-198eb0ab799b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:18.610593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f39736d-099b-4b82-b558-198eb0ab799b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:18.625064 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f39736d-099b-4b82-b558-198eb0ab799b tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1214 microversion: 2.1 time: 0.256905 Sep 23 04:03:18.628551 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2583/5056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:18 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:18.666072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "name": "network-vif-plugged", "status": "completed", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:18.706414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:18.712518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:18.722161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:18.745497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] Creating event network-vif-plugged:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:03:18.751705 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b69a3df0-b1c4-4c5d-a9ef-7f38c64646e6 req-907137de-014b-4422-88ea-151ff3de1662 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121928 Sep 23 04:03:18.752826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2584/5057] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:18.783099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:18.796693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:18.801558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:18.805019 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1cdf1c61-8a2e-47f7-bcda-6df94afd606b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.880904 Sep 23 04:03:18.808263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2474/5058] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:17 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:19.349617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:19.350523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:19.369654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:19.373715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:19.374228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:19.375003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:19.375489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:19.375935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:19.651916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:19.653738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:19.700994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:19.702389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:19.705229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:19.709122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:19.716960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:19.717745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:19.995733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:20.004942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-57fa4a83-185d-4c9e-8925-41c809c396ad tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1274 microversion: 2.1 time: 0.357383 Sep 23 04:03:20.021411 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2475/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:19 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:20.021411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:20.021411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:20.044778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:20.050562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:20.051364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:20.055365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:20.056891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:20.057906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:20.593993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:20.603181 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee9559db-0d91-4694-9760-d6411d922289 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1506 microversion: 2.1 time: 1.258111 Sep 23 04:03:20.623552 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2585/5060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:19 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1506 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:20.659134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e4f391-ef43-451c-b182-638e426cefd2", "name": "network-vif-deleted", "tag": "53eea247-67fd-414f-abcd-9cd60af80488"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:20.731389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:20.734405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:20.734885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:20.831312 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] Creating event network-vif-deleted:53eea247-67fd-414f-abcd-9cd60af80488 for instance 21e4f391-ef43-451c-b182-638e426cefd2 on n-h2-858495-2 Sep 23 04:03:20.842918 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fb88d9c4-c18b-4814-95a6-c347ba3b98f9 req-49834c74-c6c4-4615-812f-12ba22ea126d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201890 Sep 23 04:03:20.854395 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2586/5061] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:03:21.030073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:21.031069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:21.047010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:21.056775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:21.061507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:21.066177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:21.072633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:21.075206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:21.104839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:21.154532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:21.167818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:21.181242 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-727a768e-3af5-4c0d-9a17-16545bff75d0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 1.166394 Sep 23 04:03:21.192411 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2476/5062] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:20 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:21.515391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:21.539520 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cddc8c84-e7dc-417a-95d1-6bd1a004eb3f tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1272 microversion: 2.1 time: 0.499616 Sep 23 04:03:21.540611 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2587/5063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:21 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1272 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:21.631935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:21.632957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:21.650959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:21.651482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:21.651929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:21.655407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:21.659090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:21.663490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:21.765481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:21.768996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:21.769677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:21.770316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lazy-loading 'fault' on Instance uuid 21e4f391-ef43-451c-b182-638e426cefd2 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:03:21.946301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:21.970640 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e07db1be-e8e6-4a3c-8f65-e4ddd48af92f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 200 len: 1304 microversion: 2.1 time: 0.336086 Sep 23 04:03:21.971598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2477/5064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:21 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:22.221889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:22.222899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:22.234879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:22.239046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:22.240039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:22.242670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:22.244414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:22.245868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:22.567491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:22.568134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:22.578057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:22.578963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:22.583478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:22.585107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:22.586942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:22.587726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:23.743546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:23.752704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:23.761399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:23.768196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a2fd7e0d-51be-4915-be8e-79eaa1ce1169 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 1.551188 Sep 23 04:03:23.769883 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2588/5065] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:22 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:23.794442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:23.806291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 21e4f391-ef43-451c-b182-638e426cefd2] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:23.834720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:23.838747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:23.840002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:23.844069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:23.844755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:23.846062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:23.900326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 HTTP/1.1 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '21e4f391-ef43-451c-b182-638e426cefd2'} Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:23.902182 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. Sep 23 04:03:23.907463 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:23.917319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:23.925805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 404 to user: Instance 21e4f391-ef43-451c-b182-638e426cefd2 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:23.926931 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62c3ba84-d53c-4099-ac1b-a636be260e9f tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2" status: 404 len: 111 microversion: 2.1 time: 0.136275 Sep 23 04:03:23.936619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2589/5066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:23 2022] GET /compute/v2.1/servers/21e4f391-ef43-451c-b182-638e426cefd2 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:23.939195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fed734dd-55c4-479c-812a-6540adbea685 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 1.372024 Sep 23 04:03:23.939842 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2478/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:22 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:23.965954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:23.966467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:23.981722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:23.982230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:23.982672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:23.983829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:23.989336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:23.989827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:24.061629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:24.254065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2de8256d-c667-41af-83c3-00f0df1a9e26 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 204 len: 0 microversion: 2.1 time: 0.311139 Sep 23 04:03:24.258983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2590/5068] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:23 2022] DELETE /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:24.278593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:24.282558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:24.308667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:24.309184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:24.309659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:24.310382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:24.314724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:24.318378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:24.847058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-797469120", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:24.955591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:24.956760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:24.957562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:24.958275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:24.959138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:24.972093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:24.972956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:24.973692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:24.974608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:24.975264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:24.975880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:25.022333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Getting quotas for project 3c6870d8a8be4282b52ca732c9933b4e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:03:25.034494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Getting quotas for user 1280653eee7f40f491f1b8b27b1086c1 and project 3c6870d8a8be4282b52ca732c9933b4e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:03:25.064514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:03:25.074345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:03:25.155429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.168702 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d085e0a7-4acc-44b6-b3cd-c71fb3b63f5e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1494 microversion: 2.1 time: 0.902942 Sep 23 04:03:25.191461 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d6b4643c-fa80-4f13-b616-1accf1d0ab5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.016860 Sep 23 04:03:25.193636 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2479/5070] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 04:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:03:25.201148 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2591/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:24 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1494 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:25.207189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:25.207990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:25.209102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:25.214313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:25.226061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:25.227752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:25.228354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:25.230030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:25.230030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:25.231406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:25.246399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:25.251163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:25.266798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:25.269727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:25.274159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:25.274809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:25.613326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.628938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.638299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.639550 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b52388fd-cd81-4d79-8d2f-0a518a172718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.443396 Sep 23 04:03:25.641606 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2480/5071] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:25 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:25.661517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:25.663434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:25.812146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.823638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3ffd8f0-7540-4363-96de-d827168c70e7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.618845 Sep 23 04:03:25.837415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.844047 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2592/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:25 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:25.848475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.852707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:25.853955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e1233156-5535-4bc4-afe2-3999c033e808 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1277 microversion: 2.57 time: 0.207577 Sep 23 04:03:25.866444 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2481/5073] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:25 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:26.127426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5121e9-aed2-4507-9356-8f4f3c94aa05", "name": "network-vif-deleted", "tag": "98d69ed5-7935-4d53-9900-ce2121f6a5ad"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:26.149408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.150245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.151171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.198143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:26.198942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:26.227478 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] Creating event network-vif-deleted:98d69ed5-7935-4d53-9900-ce2121f6a5ad for instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 on n-h1-858495-2 Sep 23 04:03:26.244977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.248937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.253564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.255183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.257341 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e228f669-6e3e-4bdd-adf2-3d3bcbca64ab req-99d06b17-2ca2-4461-8d59-691d5d5dbda6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125956 Sep 23 04:03:26.260655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.261085 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2593/5074] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:26.261814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.453502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:26.490796 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-077b85f6-710a-44e2-b951-c4baf5f4622c tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 200 len: 1287 microversion: 2.1 time: 0.298105 Sep 23 04:03:26.501429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2482/5075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:26 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 1287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:26.670221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:26.670934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:26.680852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.681336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.682001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.684526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.690494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.691267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.852554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:26.853603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:26.861431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:26.871352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.876123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.878800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:26.882643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:26.885008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:26.885721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.398633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.410936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.424501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.427428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-25396e95-f7e1-4bc8-8aca-97b716c3ccde tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.762434 Sep 23 04:03:27.429478 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2594/5076] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:26 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:27.462439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.463353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:27.465758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:27.474266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-993c3d9e-8893-4460-a549-8b71ba695893 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.624494 Sep 23 04:03:27.477932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2483/5077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:26 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:27.486981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.496134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.496686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.497557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.498208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.498715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.536150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:27.536855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 8c5121e9-aed2-4507-9356-8f4f3c94aa05] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:27.556682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.562346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.564656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.565507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.567818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.568282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.648690 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 HTTP/1.1 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '8c5121e9-aed2-4507-9356-8f4f3c94aa05'} Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:27.654469 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 404 to user: Instance 8c5121e9-aed2-4507-9356-8f4f3c94aa05 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:27.659918 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90bd6c5d-3b5d-4f74-9f48-b06c1607eeba tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05" status: 404 len: 111 microversion: 2.1 time: 0.137861 Sep 23 04:03:27.660852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2484/5078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:27 2022] GET /compute/v2.1/servers/8c5121e9-aed2-4507-9356-8f4f3c94aa05 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:27.672331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:27.672891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:27.692377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.695272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.696056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.696979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:27.699950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:27.700813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:27.779762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:27.783566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.794623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.802319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:27.806885 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6576e177-5c36-4774-aa0f-533f86e0b7c2 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1329 microversion: 2.57 time: 0.375831 Sep 23 04:03:27.812830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2595/5079] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:27 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1329 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:28.063636 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4de44d57-aabf-4e3d-af49-23c4814d5711 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 204 len: 0 microversion: 2.1 time: 0.398811 Sep 23 04:03:28.065168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2485/5080] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:27 2022] DELETE /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:28.075197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:28.076251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:28.084076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.086543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.088707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.089729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.094172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.095539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.361291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb03507-aadb-4e11-af2e-0f82bbf48051", "tag": "3151af23-16a7-4991-bccc-b9b6bcc105a1"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:28.385338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.390614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.395110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.438410 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] Creating event network-changed:3151af23-16a7-4991-bccc-b9b6bcc105a1 for instance efb03507-aadb-4e11-af2e-0f82bbf48051 on n-h2-858495-2 Sep 23 04:03:28.453218 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ddb522dd-62d1-4ea3-85bf-4543a5c6b44a req-a81a2c1d-ab76-4f52-8cd1-f4a8927320e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097657 Sep 23 04:03:28.459446 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2486/5081] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:28.494303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:28.512866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:28.566743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.567435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:28.570968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.574834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.578637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.580072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88a146b1-21b2-490d-8bd8-342098f3b3a7 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1674 microversion: 2.1 time: 0.509776 Sep 23 04:03:28.580906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.581248 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2596/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:28 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1674 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:28.581466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.597771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:28.598373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:28.614212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.614996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.620233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.621763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:28.623603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:28.624230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:28.627346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:28.643046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:29.178941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.188994 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a53162cd-0b9f-428e-9aba-695e145f5b8a tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.605905 Sep 23 04:03:29.194452 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2597/5083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:28 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:29.205945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:29.208980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:29.224668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:29.232084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.246879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:29.250619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:29.253556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:29.256506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:29.257275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:29.264359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.269286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.272637 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7f233a9-6602-4994-ac12-cfc7238b8d91 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.811685 Sep 23 04:03:29.294616 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2487/5084] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:28 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:29.429030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.445178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.447026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.450771 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb3f3cc1-cdcf-4dd2-8385-4bafa7618cb3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1335 microversion: 2.57 time: 0.255222 Sep 23 04:03:29.476345 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2598/5085] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:29 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1335 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:29.611688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:29.612952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:29.629030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:29.630027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:29.631481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:29.632764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:29.634170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:29.636891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:29.673337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:29.916283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:29.925082 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f55e6f9-d53c-4eff-babb-1d51637a51b9 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1674 microversion: 2.1 time: 0.321163 Sep 23 04:03:29.927386 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2488/5086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:29 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1674 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:30.223472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:30.224084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:30.239897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.240939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.241397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.242107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.242757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.243351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.304380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:30.304994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:30.321446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.324215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.324830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.325877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.326211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.328673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.696417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:30.713696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:30.720145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:30.722084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dce7efa6-ae7e-4008-952a-d99f87eb0c05 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.422202 Sep 23 04:03:30.728370 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2489/5087] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:30 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:30.758000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:30.760270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:30.786275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.787369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.788106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.793701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.794474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.797983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.882389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:30.902132 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-29022d94-3b52-45b7-bd5f-d4b742217a68 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.682616 Sep 23 04:03:30.909820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2599/5088] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:30 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:30.952351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:30.952960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:30.965893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.971739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.971739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:30.976339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:30.976848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:30.977304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:31.004876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:31.025970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:31.031358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:31.035287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d0c7d4d-830d-4e27-91d8-f38b2f1c63d6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1335 microversion: 2.57 time: 0.305202 Sep 23 04:03:31.039598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2490/5089] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:30 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1335 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:31.502450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:31.513106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ffb89781-2b37-466d-80fc-3c9d4127c514 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1674 microversion: 2.1 time: 0.566025 Sep 23 04:03:31.533417 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2600/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:30 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1674 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:31.752585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:31.753997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:31.766231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:31.767464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:31.771115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:31.772905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:31.774440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:31.776913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:31.934024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:31.935248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:31.949218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:31.950062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:31.953536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:31.954651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:31.955357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:31.956156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:32.500658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.512912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.518716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.520279 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b083c3d8-d255-4b0c-9b25-1b3b9838c1cc tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.772658 Sep 23 04:03:32.534006 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2491/5091] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:31 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:32.549294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:32.550197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:32.557787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:32.558514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:32.559151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:32.560384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:32.561344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:32.561976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:32.972612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.986195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.990527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:32.997822 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b62e54b-d254-4774-849e-171416287b1c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1356 microversion: 2.57 time: 0.462324 Sep 23 04:03:33.009399 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2492/5092] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:32 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1356 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:33.014722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:33.016131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:33.031715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.034365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.035318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.037766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.041390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.042860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.273025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:33.287751 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6451b563-190a-4910-918a-5f2b36271d88 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1606 microversion: 2.1 time: 0.284411 Sep 23 04:03:33.291986 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2493/5093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:33 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1606 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:33.309336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:33.324961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:33.333596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.333596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.334441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.336116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.336585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.337027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.357736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:33.373265 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-734fdd4d-46ed-4112-8722-bd0dba3b957c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 1.443711 Sep 23 04:03:33.388332 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2601/5094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:31 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:03:33.553109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:33.557985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:33.578471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.579420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.581411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.585429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.586855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.590577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:33.591263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.602536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:33.603662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:33.605094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:33.605759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:33.836475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:33.855202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.857027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.858083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.858849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:33.861064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:33.861588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:33.953992 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc2eb992-d0fd-4101-83ef-1ccf5e68c03b tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "POST /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c/action" status: 202 len: 1137 microversion: 2.57 time: 0.659970 Sep 23 04:03:33.958484 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2494/5095] 10.222.0.25 () {62 vars in 1320 bytes} [Fri Sep 23 04:03:33 2022] POST /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c/action => generated 1137 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:03:33.981662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:33.983100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:34.006440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.019467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.025609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.027462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.029979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.031906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.311069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.323526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.324998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.340617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fef0377-40cb-4b91-bad1-1dd6b6fb40b2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.784059 Sep 23 04:03:34.345504 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2602/5096] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:33 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:34.353132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:34.360599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:34.363533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.374423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.378930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.379619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.381514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.382872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.383490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.409817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.429303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.435350 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f5d9a730-6e24-4d0e-992d-c27be3b98694 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.458517 Sep 23 04:03:34.436754 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2495/5097] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:33 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:34.466035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c107016-cad8-4572-adcb-fd804409f4aa", "name": "network-vif-deleted", "tag": "00a3d8a6-ecec-414f-abce-e3f9606dc5ce"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:34.494720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.496967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.498658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.527942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] Creating event network-vif-deleted:00a3d8a6-ecec-414f-abce-e3f9606dc5ce for instance 6c107016-cad8-4572-adcb-fd804409f4aa on n-h1-858495-2 Sep 23 04:03:34.555064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0698aa31-4ef3-4ecb-af1b-2aaaba31b4eb req-c3302406-f55e-47bb-8975-f531ca9868c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116635 Sep 23 04:03:34.560446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e754f4d278f4bfe91f618181cd36bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74f804a4c3e4ee7bf9b79a25d0b082a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:34.568670 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8cd11d3-5021-4325-9eef-3f5a492fa8d8 tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 200 len: 1323 microversion: 2.1 time: 0.221834 Sep 23 04:03:34.576315 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2603/5098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:34 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:34.585383 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2496/5099] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:34.603519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:34.604204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:34.626936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.627445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.627886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:34.628782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:34.629229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:34.629695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.004713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:35.020285 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38f422aa-f1b6-4e10-b477-02a7a092aac1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.435931 Sep 23 04:03:35.029880 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2604/5100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:34 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:35.374210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:35.375033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:35.387821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:35.416110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.419640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.420118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.420862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.426258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.426738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.465703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:35.467047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:35.493192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.500632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.504566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.506257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.510101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.510894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.850186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:35.863635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:35.892765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:35.905042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:35.906324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-416b87a9-f644-45b6-8242-1a4371ef26e3 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.445171 Sep 23 04:03:35.906898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2605/5101] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:35 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:35.950171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:35.951651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] [instance: 6c107016-cad8-4572-adcb-fd804409f4aa] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:35.971367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.971883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.978088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:35.978882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:35.979380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:35.979895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:36.033082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] HTTP exception thrown: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Request method failure captured: Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa HTTP/1.1 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS3NyDCiv6rbK2z-oJ-i7wJtCo8jfPQzzsZs89JEosZ6ecvWY4UaZOWkRHUHU0HdLxJNaeEcNcRrvnRhir0x0hREKUlYDK6efFukTw9kVuN0gGtUbZYb1lAFzCxTXlFVie2cS9V2By0EvBCnBlHqRXkeMIkp2Mph3IMJH2saQOnWrj8 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a74f804a4c3e4ee7bf9b79a25d0b082a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a74f804a4c3e4ee7bf9b79a25d0b082a Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-952997057 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 5e754f4d278f4bfe91f618181cd36bc1 Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-952997057-project Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6c107016-cad8-4572-adcb-fd804409f4aa'} Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:36.037699 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. Sep 23 04:03:36.043307 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:03:36.051676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Returning 404 to user: Instance 6c107016-cad8-4572-adcb-fd804409f4aa could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:36.053127 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fa53b43-fda1-4d90-af2c-b2f2b7440e2b tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa" status: 404 len: 111 microversion: 2.1 time: 0.124470 Sep 23 04:03:36.054511 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2606/5102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:35 2022] GET /compute/v2.1/servers/6c107016-cad8-4572-adcb-fd804409f4aa => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:36.080308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:36.092242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:36.093383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:36.094520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:36.098024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:36.104653 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53f40f38-4df3-4112-8e2b-aa92e1637c58 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.734514 Sep 23 04:03:36.105848 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2497/5103] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:35 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:36.110176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:36.113162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:36.115715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:36.121889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:36.123762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-99272c6e-5900-413d-9685-0d1e0fd0be7e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] Calling method '.version_select at 0x7f0c8b1fe310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:36.124459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:36.125147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:36.162938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:36.198670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-99272c6e-5900-413d-9685-0d1e0fd0be7e tempest-ServerActionsTestJSON-952997057 tempest-ServerActionsTestJSON-952997057-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050040181" status: 202 len: 0 microversion: 2.1 time: 0.090197 Sep 23 04:03:36.206465 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2498/5104] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 04:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050040181 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:03:36.936495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:36.937129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:36.962014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:36.962530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:36.975228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:36.976043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:36.976543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:36.976997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:37.471832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:37.488767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:37.494181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:37.498147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2e2c3ec-3bd0-430d-8662-0c224e114dc7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.565845 Sep 23 04:03:37.499870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2499/5105] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:36 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:37.512950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:37.514853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:37.533968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:37.534322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:37.534767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:37.535493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:37.535957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:37.536394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:37.753147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:37.783311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9244fb6d-3c7c-435e-ab35-15d24b4dbc10 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 1.724679 Sep 23 04:03:37.783910 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2607/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:36 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:37.943707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb03507-aadb-4e11-af2e-0f82bbf48051", "name": "network-vif-plugged", "status": "completed", "tag": "3151af23-16a7-4991-bccc-b9b6bcc105a1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:37.975075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:37.975860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:37.976500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:37.989368 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] Creating event network-vif-plugged:3151af23-16a7-4991-bccc-b9b6bcc105a1 for instance efb03507-aadb-4e11-af2e-0f82bbf48051 on n-h2-858495-2 Sep 23 04:03:38.007123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-964a2598-6209-40b7-982e-e1909ac44ec6 req-bf623f4f-8006-4f0b-83b0-db4c97975695 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068746 Sep 23 04:03:38.008750 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2608/5107] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:03:38.127281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.139575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.143040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.144496 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-071b870d-d471-45ff-826a-1ec14ef419ba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.640623 Sep 23 04:03:38.158324 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2500/5108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:37 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:38.527734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:38.528448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:38.548265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:38.548768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:38.549265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:38.550025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:38.550490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:38.550928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:38.722865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.739012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.750166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:38.758268 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0347ec80-2d46-491e-b10d-1970955bba8a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.233568 Sep 23 04:03:38.761737 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2609/5109] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:38 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:38.812612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:38.813729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:38.827323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:38.830015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:38.831976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:38.832733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:38.833214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:38.833725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:39.174372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:39.175013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:39.183706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:39.184204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:39.184645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:39.185374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:39.185832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:39.186266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:39.551606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:39.566110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b8ac03bc-3b90-4e24-b24a-71cf28a52992 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1314 microversion: 2.1 time: 0.758660 Sep 23 04:03:39.571308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2501/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:38 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:39.676564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:39.688843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:39.690373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:39.691589 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-462a6faa-7e75-48af-a018-2aa9a36626be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.522019 Sep 23 04:03:39.692157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2610/5111] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:39 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:39.791059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:39.794006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:39.809781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:39.810624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:39.811337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:39.812484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:39.813200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:39.814417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:40.019880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:40.036307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:40.039328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:40.052757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62cf8494-bf7a-4d35-9d67-1b1207f88ba7 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.264455 Sep 23 04:03:40.056301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2502/5112] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:39 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:40.595126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:40.595709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:40.613549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:40.618493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:40.619068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:40.622917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:40.623541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:40.624470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:40.719630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:40.721211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:40.732170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:40.733939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:40.734622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:40.736584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:40.737314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:40.738014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:41.084207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.099616 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c12772d-47e0-4617-841b-c70954172207 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1497 microversion: 2.1 time: 0.508976 Sep 23 04:03:41.104633 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2611/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:40 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1497 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:41.127665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:41.132749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:41.152784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:41.154036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:41.154764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:41.155918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:41.156857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:41.157593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:41.263023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.272133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.291805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.295425 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35591b8f-961a-48d2-a471-2c095d220bee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.579845 Sep 23 04:03:41.310266 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2503/5114] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:40 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:41.379768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.396441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.398160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:41.399621 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98cf20f6-69ab-48b5-bfae-9b359107ae87 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.293165 Sep 23 04:03:41.425476 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2612/5115] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:41 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:41.979902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:41.981370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:41.992256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:41.993320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:41.994507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:41.995687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:41.997333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:41.998136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.044305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:03:42.052775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:42.246165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ee8adfa0-4247-4242-8f91-0ef8817ae210 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 204 len: 0 microversion: 2.1 time: 0.270724 Sep 23 04:03:42.268927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:42.269836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:42.273480 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2504/5116] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:03:41 2022] DELETE /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:42.282448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.283204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.283845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.285259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.287473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.288096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.330334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:42.331563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:42.347054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.347563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.348014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.348727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.355615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.357318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.877867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:42.911123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d5ba624-c4cf-4ab2-a4b0-67473f6b9d56 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1503 microversion: 2.1 time: 0.650718 Sep 23 04:03:42.918822 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2613/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:42 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:42.944417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:42.945050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:42.945929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:42.961891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.962619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.963242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.964193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:42.964822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:42.965445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:42.965733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:42.977725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:42.979079 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5361ab2f-3244-4132-8b03-ea520577ec38 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.654734 Sep 23 04:03:42.979761 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2505/5118] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:42 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:43.090721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:43.104171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:43.108542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:43.110652 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62d4c7e9-aef3-413a-ae2f-d7c7f7063df0 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.185412 Sep 23 04:03:43.126493 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2614/5119] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:42 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:43.947691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:43.948993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:43.963389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:43.966849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:43.968826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:43.969794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:43.971420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:43.974727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:44.005812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:44.007765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:44.032233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:44.037936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:44.041164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:44.043172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:44.049095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:44.051695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:44.070636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:44.676450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.681222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.691189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b3d5eea-1a9e-40b9-a8ba-f345f7e13bec tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1503 microversion: 2.1 time: 0.748578 Sep 23 04:03:44.694340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.694933 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2506/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:43 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1503 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:44.699589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.701497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e933506-1380-48dc-94ed-d971ad1ff09f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1739 microversion: 2.20 time: 0.700441 Sep 23 04:03:44.704714 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2615/5121] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:43 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1739 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:44.723068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:44.724061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:44.731067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:44.731842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:44.732521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:44.733453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:44.734850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:44.735556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:44.911966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.925842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.928913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:44.932709 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-731a96f1-3a2f-4147-83a6-8b8e865d899d tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.235597 Sep 23 04:03:44.940739 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2507/5122] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:44 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:45.717730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:45.718539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:45.730725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:45.732238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:45.732857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:45.739344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:45.742254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:45.745003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:45.745525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:45.745968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:45.746242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:45.748049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:45.752017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:45.755133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:45.756014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:45.756649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:46.713877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.726494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1bb5afbb-bba8-47b3-89bb-a113bd10dd66 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 200 len: 1503 microversion: 2.1 time: 1.013290 Sep 23 04:03:46.742102 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2616/5123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:45 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 1503 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:46.748321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.757622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:46.760424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.762747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:46.776222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.790454 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe63f4e6-d544-4cd5-935c-56579789d4d4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1721 microversion: 2.20 time: 1.055889 Sep 23 04:03:46.791406 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2508/5124] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:45 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1721 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:46.791536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:46.792135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:46.793754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:46.795895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:46.797186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:46.797776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:46.877989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb03507-aadb-4e11-af2e-0f82bbf48051", "name": "network-vif-deleted", "tag": "3151af23-16a7-4991-bccc-b9b6bcc105a1"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:46.942940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:46.943725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:46.944372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:46.977194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.978213 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] Creating event network-vif-deleted:3151af23-16a7-4991-bccc-b9b6bcc105a1 for instance efb03507-aadb-4e11-af2e-0f82bbf48051 on n-h2-858495-2 Sep 23 04:03:46.991626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:46.993945 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a6dfaa1a-dda3-46e5-b1ff-e73d4425ae5e req-fdf7ee87-7f7c-437f-b8c0-857ebf0d9f82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136925 Sep 23 04:03:46.995885 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2509/5125] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:46.998744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:47.001153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf9b9744-6758-4d70-8bd5-864cc0dc88a8 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.267040 Sep 23 04:03:47.030692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2617/5126] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:46 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:47.765147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:47.767133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: efb03507-aadb-4e11-af2e-0f82bbf48051] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:47.776770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:47.782048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:47.783114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:47.784464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:47.786800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:47.788394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:47.822004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:47.824369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:47.841340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:47.843881 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] HTTP exception thrown: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. Sep 23 04:03:47.845993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Request method failure captured: Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 HTTP/1.1 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS__JzyOm9AvqtoqZ-jyOaZqLwkimVNcOtU2yOmKLCbguZn20ueNHlx7qt_6iG1RGi20zt763QGB-Hx9xyW8hC2zFioWSsNKXcyD_V6-zHfnORpXvYOf1HnbugUnmu31g0zfEe4-7zl6Lfu0FIk8QcFvRQFs2J2SpvNilTP1PiDhAtY Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 7b7339be0b514c6bbfccad76f5d27058 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesActionsTest-1608554520 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesActionsTest-1608554520 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 7b7339be0b514c6bbfccad76f5d27058 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesActionsTest-1608554520 Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesActionsTest-1608554520-project Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 24f92d9dc8544b74897098bad4a2f5ed Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesActionsTest-1608554520-project Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'efb03507-aadb-4e11-af2e-0f82bbf48051'} Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:03:47.849138 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. Sep 23 04:03:47.857741 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:03:47.858813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:47.858813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:47.858813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:47.858813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:47.858813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:47.875163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Returning 404 to user: Instance efb03507-aadb-4e11-af2e-0f82bbf48051 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:03:47.887535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2cd3c49d-4245-4c2a-b054-d4c95d0d82c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051" status: 404 len: 111 microversion: 2.1 time: 0.132858 Sep 23 04:03:47.889475 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2510/5127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:47 2022] GET /compute/v2.1/servers/efb03507-aadb-4e11-af2e-0f82bbf48051 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:03:48.049527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:48.050154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:48.061303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:48.061842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:48.062295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:48.066123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:48.066717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:48.067063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:48.324607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.335445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.340626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.343286 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54c8c57a-45d7-43ee-97fc-7b4abe46ad19 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.297861 Sep 23 04:03:48.378694 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2511/5128] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:48 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:48.394152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1916556715", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "be7c639c-9879-4226-bbc4-b232b67f64ee"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:48.492231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] validate_networks() for [('be7c639c-9879-4226-bbc4-b232b67f64ee', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:03:48.512452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.521766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.523772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:48.525223 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07731942-5c08-460a-a4e7-944ab8b68ec0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1721 microversion: 2.20 time: 0.713055 Sep 23 04:03:48.542141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2618/5129] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:47 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1721 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:48.887062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "name": "network-vif-unplugged", "status": "completed", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:48.912868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:48.915772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:48.918250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:48.935776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] Creating event network-vif-unplugged:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:03:48.942547 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-230f48ed-ac07-4de0-8894-460a554670b1 req-998dedc2-fc34-40e9-b68f-e98a514aa238 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.398700 Sep 23 04:03:48.943183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2619/5130] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:49.379365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:49.381120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:49.411314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.415172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.417506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.418519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.426253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.426869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.656645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:49.681384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:49.691174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:49.694703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87bbd478-1ca3-4812-af72-39a1ed8d311a tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.320684 Sep 23 04:03:49.695559 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2620/5131] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:49 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:49.710734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:49.711286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:49.724400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.724897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.727561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.729606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.730106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.730527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.760890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:49.762994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:49.764268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:49.764705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:49.765303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:49.824834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.825840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.830403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.831736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:49.833432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:49.834324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:49.902261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Getting quotas for project 7b7339be0b514c6bbfccad76f5d27058. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:03:49.909638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Getting quotas for user 24f92d9dc8544b74897098bad4a2f5ed and project 7b7339be0b514c6bbfccad76f5d27058. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:03:49.966167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:03:49.968926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:03:50.030570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-72e8c828-ff01-468e-8af6-e34faf8edbfe tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646531 Sep 23 04:03:50.031933 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2512/5132] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:03:50.047327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc599be9-2158-4605-80fa-61684cfeeaa6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:50.047976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc599be9-2158-4605-80fa-61684cfeeaa6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:50.301548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bc599be9-2158-4605-80fa-61684cfeeaa6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:50.312842 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc599be9-2158-4605-80fa-61684cfeeaa6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1214 microversion: 2.1 time: 0.269596 Sep 23 04:03:50.322009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2513/5133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:50 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:50.459517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:50.474289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:50.475770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:50.481930 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d6dea81b-e724-4f15-8e4e-b5276469992f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1721 microversion: 2.20 time: 0.785593 Sep 23 04:03:50.488125 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2621/5134] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:49 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1721 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:50.724758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:50.725840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:50.736459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:50.744948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:50.745996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:50.747909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:50.753323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:50.754091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:51.060588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:51.074824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:51.076310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:51.081823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d90ba2e3-9a7a-4893-ab3b-835834ac7422 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.358041 Sep 23 04:03:51.083601 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2514/5135] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:50 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:51.347923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:51.348584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:51.359050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:51.359521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:51.368099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:51.369639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:51.371184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:51.371935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:51.518976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:51.519801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:51.528650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:51.530883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:51.531681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:51.532953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:51.533856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:51.535526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:51.720136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:51.734157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-182ef623-116d-40cf-a34c-d04a439e8153 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1266 microversion: 2.1 time: 0.390137 Sep 23 04:03:51.760629 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2622/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:51 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:52.101219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.117502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:52.118185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.118733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:52.121701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.123689 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc7c8cc1-b4bf-4bed-bbe3-26a315f0abba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1664 microversion: 2.20 time: 0.608829 Sep 23 04:03:52.132867 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2515/5137] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:51 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1664 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:52.154592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.156589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.158260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:52.159929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.160589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.162649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:52.162807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d5e6db5-de3b-4df6-8b54-be176d7a5215"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:52.165751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:52.180732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.184160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.191927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:52.198630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.199289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.199899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:52.849790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.889280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.891301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4d79d427-2eaf-4658-a836-32e8dd2d1d8b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.736118 Sep 23 04:03:52.901870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:52.902802 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2516/5138] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Sep 23 04:03:52 2022] POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 188 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:03:52.904310 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c4b02ca-8ea2-4af4-bf9e-11bd2692d963 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.792504 Sep 23 04:03:52.906826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2623/5139] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:52 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:52.909833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:52.910456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:52.946889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.947399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.947847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:52.948572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:52.949036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:52.949502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.056263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:53.064263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8af387bf-3281-4d3f-8487-6ed2330d8785 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1272 microversion: 2.1 time: 0.160314 Sep 23 04:03:53.068773 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2517/5140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:52 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:53.256952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:53.258192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:53.271804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.272542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.274015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.276336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.277595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.278547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.338557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128724) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:03:53.535021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1de1288-a7ca-487c-8413-6d0012203c51 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/action" status: 202 len: 0 microversion: 2.20 time: 0.284643 Sep 23 04:03:53.540526 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2624/5141] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 04:03:53 2022] POST /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:03:53.544430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:53.545630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:53.562194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.564073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.564684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.566836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.568169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.569053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.938815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:53.940403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:53.958344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.958843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.959206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:53.969444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:53.969960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:53.970418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:54.121041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.147095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.149338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.151259 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-55369665-4232-442b-886c-28d689e06b17 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1750 microversion: 2.20 time: 0.611393 Sep 23 04:03:54.152198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2518/5142] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:53 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1750 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:54.204294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:54.205071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:54.224533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:54.225043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:54.225536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:54.232262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:54.240379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:54.242933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:54.252494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.304912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.307670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.315182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4da484cc-905b-4de7-b2b0-783e6353188e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.380356 Sep 23 04:03:54.315685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2625/5143] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:53 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:54.920551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:54.945455 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e757835-259d-44cc-a9b0-994376650824 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.772791 Sep 23 04:03:54.947076 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2519/5144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:54 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:55.184276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:55.187256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:55.199150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:55.200172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:55.201078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:55.202081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:55.203192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:55.204321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:55.214179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:03:55.684586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-597880980", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "21a73ba5-5491-4cad-ba2d-b151fdf4d5c7"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:55.819946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] validate_networks() for [('21a73ba5-5491-4cad-ba2d-b151fdf4d5c7', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:03:56.109428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.120033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.121508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.128086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d32146e-aa21-4d82-b565-96b38ba3ef80 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1750 microversion: 2.20 time: 0.954109 Sep 23 04:03:56.131015 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2520/5145] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:55 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1750 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:56.142748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:56.143404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:56.159408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.160038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.160486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.161240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.161733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.162183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.422685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.450823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.480007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:56.487738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff5e082c-d650-460d-9def-f780a009870c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.355229 Sep 23 04:03:56.490710 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2521/5146] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:56 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:56.507800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:56.508434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:56.526497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.528155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.528668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.531187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.531744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.533505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.884448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:56.885236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:56.885862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:56.886388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:56.887104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:56.904817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.905456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.907606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.914134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:56.916292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:56.920492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:56.965956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:03:56.974874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for user 979de0261edc45bebd9ebf2ce6c1a2c5 and project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:03:57.035471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:03:57.052539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:03:57.205547 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be9dc7da-f591-4a08-a914-323bfdaff623 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070415 Sep 23 04:03:57.213460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2626/5147] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:03:57.227158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:57.228180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:57.252928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:57.253398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:57.253982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:57.257902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:57.258395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:57.258841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:57.451469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:57.467534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc215617-ab01-49af-aeb3-e4303d7ee779 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.975146 Sep 23 04:03:57.469803 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2522/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:56 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:57.521450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:57.523048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:57.540799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:57.541829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:57.542535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:57.543704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:57.545866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:57.546585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:57.862210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:57.881601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:57.883746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:57.893069 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d020c83-a2f9-4820-a773-dddef9a2bdff tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.376605 Sep 23 04:03:57.894217 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2523/5149] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:57 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:03:57.902952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-217746321", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "21a73ba5-5491-4cad-ba2d-b151fdf4d5c7"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:58.009202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] validate_networks() for [('21a73ba5-5491-4cad-ba2d-b151fdf4d5c7', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:03:58.212004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:58.233306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:58.235412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:58.241589 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-28b766c2-ce5f-4914-abe6-20fbfa679ff0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1752 microversion: 2.20 time: 1.025482 Sep 23 04:03:58.244197 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2627/5150] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:57 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1752 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:03:58.492862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:58.493805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:58.508861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:58.515244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:58.517766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:58.518930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:58.521579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:58.522242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.117221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:03:59.125672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ccde133-d404-4112-8767-096aa76a8eaf tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.637801 Sep 23 04:03:59.130389 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2628/5151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:03:58 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:03:59.147219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:59.148153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:59.163223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.170286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.171041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.171992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.172658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.173451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.310010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:03:59.311078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:03:59.311760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:03:59.312547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:03:59.313156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:03:59.333172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.334031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.334830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.335898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.336551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.337312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.381982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:03:59.401945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for user 979de0261edc45bebd9ebf2ce6c1a2c5 and project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:03:59.444450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:03:59.448345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:03:59.563517 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc33da9c-e5b0-40fb-bf00-073cd8228645 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667414 Sep 23 04:03:59.568008 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2524/5152] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:03:59.576326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3357189-83f8-4377-b1c6-88878de1fd6e", "tag": "46747962-5fe3-4dee-9df5-bc44e09cc707"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:03:59.620091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.620671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.621012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.651039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] Creating event network-changed:46747962-5fe3-4dee-9df5-bc44e09cc707 for instance e3357189-83f8-4377-b1c6-88878de1fd6e on n-h2-858495-2 Sep 23 04:03:59.675229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-01dee549-7431-4852-9e8c-57d0c540bd99 req-bf823f01-9d36-4b88-8c40-07688405c3a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104501 Sep 23 04:03:59.675854 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2525/5153] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:03:59.698721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:03:59.699936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:03:59.709174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.713484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.715349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:03:59.716451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:03:59.722207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:03:59.723473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:00.546789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.560543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.563340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.569264 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eece10c6-b444-4c2a-81f6-c9089ad3bbb1 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 1.437546 Sep 23 04:04:00.570836 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2629/5154] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:59 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:00.577769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1840712170", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "451", "networks": [{"uuid": "21a73ba5-5491-4cad-ba2d-b151fdf4d5c7"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:00.675629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] validate_networks() for [('21a73ba5-5491-4cad-ba2d-b151fdf4d5c7', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:04:00.868055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.887462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.891352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:00.892905 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ace2e690-5b3f-448b-bdfd-e0f0b7dade85 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1752 microversion: 2.20 time: 1.215335 Sep 23 04:04:00.899227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2526/5155] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:03:59 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1752 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:00.918328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:00.924298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:00.940681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:00.941189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:00.942257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:00.942989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:00.943456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:00.943893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:01.621688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:01.643986 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be89dfcf-0a01-44d0-a205-fad9b3e94130 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.741001 Sep 23 04:04:01.645493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2527/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:00 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:01.665913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:01.667199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:01.685627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:01.686468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:01.687158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:01.688099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:01.688772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:01.689442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:02.030339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:02.043853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:02.052684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:02.058135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f763f649-9109-4fd3-bed8-6768511ebd03 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1365 microversion: 2.57 time: 0.406885 Sep 23 04:04:02.060545 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2528/5157] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:01 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:02.073034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:02.081795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:02.098834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:02.100760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:02.103793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:02.106271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:02.109291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:02.112416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:02.113915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.056548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.084461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.086434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.091715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7677b564-d340-47c6-babc-e600c36ae8c0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1752 microversion: 2.20 time: 1.027025 Sep 23 04:04:03.092630 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2529/5158] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:02 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1752 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:03.110619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:03.111569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:03.125707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.127315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.128490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.132255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.133103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.133814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.568441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.591103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0bd49fe2-2744-43b3-bed4-70828d7d5bc1 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.496441 Sep 23 04:04:03.594723 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2530/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:03 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:03.600396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:03.610351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:03.617964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.618702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.620401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.621565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.622330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.623104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.651009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:04:03.651679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:04:03.652364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:04:03.653482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:04:03.656145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:04:03.702109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.702671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.703134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.703937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:03.704402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:03.707669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:03.751720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:04:03.772538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Getting quotas for user 979de0261edc45bebd9ebf2ce6c1a2c5 and project d18cd1e8cf95430e86de6920e5f6be6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:04:03.798733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:04:03.802389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:04:03.882498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.895537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.901992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:03.903624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a07c7e2-a827-4ae0-98bd-a14819227a5e tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1371 microversion: 2.57 time: 0.307690 Sep 23 04:04:03.904670 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-795f14d5-84d8-468b-957b-827243852949 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.331266 Sep 23 04:04:03.905730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2630/5161] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:04:03.913283 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2531/5161] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:03 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:03.924630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-155ff3d6-f249-4de6-ac3e-d6fe40f5940d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:03.926972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-155ff3d6-f249-4de6-ac3e-d6fe40f5940d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:04.123287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:04.123909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:04.134583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:04.135282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:04.137273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:04.138277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:04.141144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:04.141840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:04.203070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-155ff3d6-f249-4de6-ac3e-d6fe40f5940d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:04.220179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-155ff3d6-f249-4de6-ac3e-d6fe40f5940d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1221 microversion: 2.1 time: 0.305171 Sep 23 04:04:04.225875 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2631/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:03 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:04.621748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:04.622607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:04.647171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:04.647721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:04.648266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:04.655854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:04.656508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:04.656803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:04.987756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.016500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.023454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.024708 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-309a3eb9-c888-4055-bfbf-6a9bb85627a9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1752 microversion: 2.20 time: 0.905666 Sep 23 04:04:05.025295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2532/5163] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:04 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1752 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:05.046599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:05.047806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:05.055421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.062519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.063523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.064454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.065090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.066113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.141146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.150068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d336ac80-03d9-40fa-b980-a0f87a740c98 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.532539 Sep 23 04:04:05.150659 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2632/5164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:04 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:05.233859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.249653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:05.250560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:05.252578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.258164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.259845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.262480 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f3bd5a4-f7fb-4bd9-bdd9-902dbec3dcf6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1356 microversion: 2.57 time: 0.231214 Sep 23 04:04:05.264828 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2533/5165] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:05 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:05.266190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.266682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.267443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.271207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.271855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.302815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:05.307595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:05.327393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.329522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.332706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.335340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.337516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.339375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.419141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:04:05.622382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a427c4b-4e34-438c-b8fb-c451da8a2ddd tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 204 len: 0 microversion: 2.57 time: 0.332551 Sep 23 04:04:05.626759 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2534/5166] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:04:05 2022] DELETE /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:04:05.632930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:05.633968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:05.647769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.652302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.655848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.658082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:05.659811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:05.662121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:05.725844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.734206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:05.738370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6858ffb4-f16a-48f1-abb7-c3896d87fc68 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1273 microversion: 2.1 time: 0.492774 Sep 23 04:04:05.739993 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2633/5167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:05 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1273 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:05.882292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.898912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.900541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:05.902008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d6868cf-e9e9-44d9-89ac-260ae2f3d8d4 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1362 microversion: 2.57 time: 0.273561 Sep 23 04:04:05.903090 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2535/5168] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:05 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:04:06.057258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:06.058008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:06.077540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:06.078008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:06.078476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:06.079203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:06.082866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:06.083382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:06.174436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:06.175112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:06.187517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:06.188087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:06.188627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:06.194386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:06.194890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:06.197238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:06.227356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:07.251696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.278576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.283643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.287987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8cdd5a8c-d119-4269-ab69-07cfd434af5d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1752 microversion: 2.20 time: 1.239073 Sep 23 04:04:07.291066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2634/5169] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:06 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1752 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:07.300723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:07.305305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:07.319464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:07.324460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:07.325315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:07.326291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:07.326934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:07.328755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:07.356694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.365528 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b508654e-b1a1-4c82-989d-e951350901a6 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 1.195424 Sep 23 04:04:07.378341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2536/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:06 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:07.393422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:07.394282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:07.401580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:07.402088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:07.402538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:07.403254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:07.403719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:07.404154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:07.631925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.641068 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0deab620-2f4a-49b4-b32c-4dbe87a03119 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1279 microversion: 2.1 time: 0.348648 Sep 23 04:04:07.646168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2635/5171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:07 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1279 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:07.663337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.680248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.682168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1280653eee7f40f491f1b8b27b1086c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6870d8a8be4282b52ca732c9933b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:07.683623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3283daae-2876-4e89-9456-7ca7f151806c tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 200 len: 1362 microversion: 2.57 time: 0.303520 Sep 23 04:04:07.684378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2537/5172] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:07 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:08.322368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:08.324706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:08.344221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.346366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.349228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.350368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.351490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.352607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.543057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c672701e-507a-4345-926d-f43011d5ee9e", "tag": "7475214c-827f-4788-844d-6b71196481fb"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:08.569308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.572932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.573393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.616524 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] Creating event network-changed:7475214c-827f-4788-844d-6b71196481fb for instance c672701e-507a-4345-926d-f43011d5ee9e on n-h1-858495-2 Sep 23 04:04:08.630368 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c801e3ba-a650-4ad4-823d-5caa660233ec req-317d14d2-e662-4e22-804a-6bc434767d24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.551780 Sep 23 04:04:08.632415 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2636/5173] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:08.641631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:08.643204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:08.652297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.653201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.653888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.654961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.655661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.656751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.780253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:08.794696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:08.798649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:08.799282 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cacfe6db-e812-4dd0-8bbe-4217a54ecc21 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.484448 Sep 23 04:04:08.800410 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2538/5174] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:08 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:04:08.805673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:08.807544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:08.823328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.824980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.825696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:08.827047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:08.827715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:08.828499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:09.012362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:09.024148 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79704aeb-2cf2-4eaf-92c8-ab62e0296965 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.388140 Sep 23 04:04:09.038256 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2637/5175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:08 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:09.056855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:09.058561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] [instance: 547fbbee-e860-4f17-9c8e-ade36a3ec89c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:09.080656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:09.081472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:09.082642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:09.083717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:09.084493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:09.085115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:09.114644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] HTTP exception thrown: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Request method failure captured: Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c HTTP/1.1 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTAL8tRi4mLxt5gHDGzF775EaKBuDIIYX-6zywThhPwcoqTh_Gj-bfLd5uho3FsbXcEX6lIztOQCiPYbfdlUdP_p9OF4rcQqmadkbAZia5MOO9szKlSSYkfRGFJK2W-EOsunFNdh2MvqYrFQLh5FqvPhcfWXDRLrBGJ6BEbHWjVl3ZU Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.57 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 3c6870d8a8be4282b52ca732c9933b4e Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerShowV257Test-2121100992 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c6870d8a8be4282b52ca732c9933b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c6870d8a8be4282b52ca732c9933b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c6870d8a8be4282b52ca732c9933b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c6870d8a8be4282b52ca732c9933b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerShowV257Test-2121100992 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 3c6870d8a8be4282b52ca732c9933b4e Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerShowV257Test-2121100992 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerShowV257Test-2121100992-project Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1280653eee7f40f491f1b8b27b1086c1 Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerShowV257Test-2121100992-project Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '547fbbee-e860-4f17-9c8e-ade36a3ec89c'} Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:04:09.119164 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:09.124871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] Returning 404 to user: Instance 547fbbee-e860-4f17-9c8e-ade36a3ec89c could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:04:09.128807 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-731ec490-1691-4767-a10f-2805c42059a6 tempest-ServerShowV257Test-2121100992 tempest-ServerShowV257Test-2121100992-project] 10.222.0.25 "GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c" status: 404 len: 111 microversion: 2.57 time: 0.086548 Sep 23 04:04:09.129618 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2638/5176] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:09 2022] GET /compute/v2.1/servers/547fbbee-e860-4f17-9c8e-ade36a3ec89c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:04:09.357546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:09.411445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:09.435302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e3cddc0-8760-4add-9d06-bc3f46eeabc6 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.625132 Sep 23 04:04:09.436549 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2539/5177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:08 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:09.826812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:09.827330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:09.835809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:09.840718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:09.841247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:09.842190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:09.843820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:09.849912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.055991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:10.059356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:10.064032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:10.086117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.087398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.089608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.091744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.093767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.094976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.218663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:10.232218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:10.237502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:10.238781 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ae04a11-0ec7-457a-bac6-a06575031d23 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.416003 Sep 23 04:04:10.241007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2639/5178] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:09 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:10.264434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3357189-83f8-4377-b1c6-88878de1fd6e", "name": "network-vif-plugged", "status": "completed", "tag": "46747962-5fe3-4dee-9df5-bc44e09cc707"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:10.279995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.282071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.282466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.298514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] Creating event network-vif-plugged:46747962-5fe3-4dee-9df5-bc44e09cc707 for instance e3357189-83f8-4377-b1c6-88878de1fd6e on n-h2-858495-2 Sep 23 04:04:10.306277 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4c3955f5-a4ac-46a7-8d3a-3839175e06e2 req-2505b9b8-4d60-4b80-8f95-c1cf18aaa9bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063359 Sep 23 04:04:10.307135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2640/5179] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:10.472724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:10.474043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:10.501894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.502396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.504407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.506255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.508197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.509747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.731601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:10.753205 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94155c2f-d9fb-4c91-af19-56680e2524c7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.702432 Sep 23 04:04:10.758052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2540/5180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:10 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:10.768222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54fadb3-2b94-41de-ab5f-61e639abe7d9", "tag": "f170490f-6051-4038-ab0d-00249d664d41"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:10.787952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:10.789900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:10.790985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:10.807228 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] Creating event network-changed:f170490f-6051-4038-ab0d-00249d664d41 for instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 on n-h2-858495-2 Sep 23 04:04:10.815351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4da9dde5-b08d-4d16-a265-9f3bc9fa02bc req-bf479086-e6ac-4356-be54-ca89d8f8e8fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054604 Sep 23 04:04:10.818036 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2541/5181] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:11.013728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:11.021844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55600233-a9ba-4825-ac75-097a53b2498c tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.561691 Sep 23 04:04:11.022427 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2641/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:10 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:11.272375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:11.273201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:11.292526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:11.293030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:11.295181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:11.297622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:11.298370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:11.298803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:11.506497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:11.532369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:11.577638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:11.579907 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fda0aa57-1d89-4b06-9a0e-2c62f8b91a69 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.312672 Sep 23 04:04:11.594491 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2542/5183] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:11 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:11.777429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:11.778737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:11.787954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:11.788851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:11.789337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:11.790561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:11.791536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:11.792299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:12.010203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:12.022727 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.249995 Sep 23 04:04:12.023672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2642/5184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:11 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:12.045659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.046389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:12.055399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:12.058014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:12.058901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:12.060560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:12.061589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:12.062035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:12.238390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:12.265841 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.220057 Sep 23 04:04:12.278375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2543/5185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:12.453124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.454668 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001801 Sep 23 04:04:12.463269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2643/5186] 10.222.0.25 () {56 vars in 886 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:04:12.464026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.465182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001690 Sep 23 04:04:12.466740 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2544/5187] 10.222.0.25 () {54 vars in 1035 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 23 04:04:12.475556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.476590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8810bbb-26c6-4a36-ba14-f69f7214dd55 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001577 Sep 23 04:04:12.481475 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2644/5188] 10.222.0.25 () {54 vars in 1041 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:12.486567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.488004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2bb6b7f-9b3d-42ad-a6f8-0b958fdb9acb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002094 Sep 23 04:04:12.494704 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2545/5189] 10.222.0.25 () {56 vars in 886 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 23 04:04:12.620420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:12.621145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:12.666202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:12.666815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:12.671589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:12.675512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:12.677020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:12.679157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:13.055431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:13.061023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:13.075276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:13.078882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:13.082721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:13.085043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:13.085957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:13.087900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:13.726972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:14.007835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:14.024736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:14.026339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:14.028530 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb9dbad1-26a0-4825-a033-1944c254e2e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 1.419205 Sep 23 04:04:14.048906 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2645/5190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:12 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:14.082987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:14.086733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:14.110978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:14.111765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:14.114937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:14.118212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:14.119172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:14.120005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:14.214843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:14.847222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:14.860800 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2da9059a-00d6-4c65-a3b1-b67a0ebb03db tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1314 microversion: 2.1 time: 1.809359 Sep 23 04:04:14.873450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2546/5191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:13 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1314 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:15.299857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1491072213", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:15.653322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] validate_networks() for [('8a9249ac-d298-4349-b85e-7c8f5cabc93d', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:04:16.540725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:16.556267 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31e32ddc-8eb1-4f6e-95a2-210d72f34299 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 2.505740 Sep 23 04:04:16.580260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2646/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:14 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:16.624336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d564127-ea7c-4a45-a964-25cf78670d75", "tag": "d9535563-80a6-4e4b-8f67-6247a8e19560"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:16.672984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:16.674462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:16.677301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:16.721002 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] Creating event network-changed:d9535563-80a6-4e4b-8f67-6247a8e19560 for instance 6d564127-ea7c-4a45-a964-25cf78670d75 on n-h1-858495-2 Sep 23 04:04:16.758831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e7a1f249-3a6d-42cc-9b5b-c2a3834fe399 req-8286b5b5-3419-4590-8c5e-eef809449aca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173778 Sep 23 04:04:16.762186 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2647/5193] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:16.767683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:16.768406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:16.830787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:16.832036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:16.835439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:16.838735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:16.843146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:16.848284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:17.897679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:17.914749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:17.916221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:17.917467 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a8309f9-3f4a-4df3-9894-11e3771782e9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 1.154050 Sep 23 04:04:17.937924 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2648/5194] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:16 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:17.970102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:17.970858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:17.975781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:17.995396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:17.996108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:17.996668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:17.997555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.003536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.004142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.069851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:04:18.070940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:04:18.071436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:04:18.071849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:04:18.072427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:04:18.085340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.085493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.085936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.087101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.087848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.088472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.118432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:04:18.125583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for user 6f00c88acca24c0fa6497dba45552fc9 and project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:04:18.140019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:04:18.143169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:04:18.207126 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-367e9bb4-edd0-44a9-80eb-2c609c357e43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.338953 Sep 23 04:04:18.208210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2547/5195] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:04:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:04:18.213555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c672701e-507a-4345-926d-f43011d5ee9e", "name": "network-vif-plugged", "status": "completed", "tag": "7475214c-827f-4788-844d-6b71196481fb"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:18.227129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.228006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.228714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.280597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] Creating event network-vif-plugged:7475214c-827f-4788-844d-6b71196481fb for instance c672701e-507a-4345-926d-f43011d5ee9e on n-h1-858495-2 Sep 23 04:04:18.293951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e472edf5-d416-400b-b95e-a26e0df30b17 req-71e70fe9-9291-49f9-8a61-870f35cff940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084192 Sep 23 04:04:18.297555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2548/5196] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:18.307718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:18.311125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:18.326956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.327435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.327878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.328923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:18.329416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:18.330269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:18.896390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:18.904600 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fb82ca5d-0fde-4757-9bd0-82dafafa2ae7 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1497 microversion: 2.1 time: 0.944847 Sep 23 04:04:18.933278 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2649/5197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:17 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1497 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:18.967992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-51528ee1-60bb-42a8-bc78-dccc036070ed tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:18.969146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-51528ee1-60bb-42a8-bc78-dccc036070ed tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:19.071219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:19.080507 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7b75b2b-2e55-4427-b038-804cc159666d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.781108 Sep 23 04:04:19.087957 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2549/5198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:18 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:19.095589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:19.096237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:19.107140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:19.107681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:19.114457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:19.116143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:19.117524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:19.118166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:19.487045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-51528ee1-60bb-42a8-bc78-dccc036070ed tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:19.500724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-51528ee1-60bb-42a8-bc78-dccc036070ed tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1222 microversion: 2.1 time: 0.549700 Sep 23 04:04:19.501742 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2650/5199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:18 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1222 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:19.875601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-905087047", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:20.023628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:20.037269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] validate_networks() for [('8a9249ac-d298-4349-b85e-7c8f5cabc93d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:04:20.042684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:20.056138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:20.062078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fdf05772-ff7e-4d9c-bd5a-e514798c76f4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.972687 Sep 23 04:04:20.067512 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2550/5200] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:19 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:20.101600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:20.102242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:20.111441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.111974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.112393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.113708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.114173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.124724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.161146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:04:20.405526 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9355dbbc-e63f-4b57-82d7-bfa6e3af4201 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 204 len: 0 microversion: 2.1 time: 0.308306 Sep 23 04:04:20.409737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2551/5201] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:04:20 2022] DELETE /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:04:20.418188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:20.420107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:20.438085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.439398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.442911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.444015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.445711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.447281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.837782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:20.852104 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9fd6ad72-3a3d-40f2-9e87-af296b0fe6a1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.440414 Sep 23 04:04:20.852823 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2552/5202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:20 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:20.865636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54fadb3-2b94-41de-ab5f-61e639abe7d9", "name": "network-vif-plugged", "status": "completed", "tag": "f170490f-6051-4038-ab0d-00249d664d41"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:20.886672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.893205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.898083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.944938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] Creating event network-vif-plugged:f170490f-6051-4038-ab0d-00249d664d41 for instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 on n-h2-858495-2 Sep 23 04:04:20.959257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0d7db497-ad05-46c2-ac9a-4d0d4f15104e req-ef485206-85eb-4610-9bd7-f1f7398b68be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104590 Sep 23 04:04:20.960665 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2553/5203] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:20.967158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:20.979825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:20.996657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:20.997266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:20.998590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:20.999407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:21.001562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:21.002101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:22.502539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:22.515441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a2200190-9432-4fa9-86fa-373417a66f38 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1503 microversion: 2.1 time: 1.553183 Sep 23 04:04:22.518027 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2554/5204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:20 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1503 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:22.531974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:22.537789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:22.553151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:22.554014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:22.554674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:22.555612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:22.556345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:22.557494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:22.686449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:04:22.689133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:04:22.690915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:04:22.691640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:04:22.693496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:04:22.727248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:22.729797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:22.730671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:22.731676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:22.735636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:22.736788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:22.809855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:04:22.826045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for user 6f00c88acca24c0fa6497dba45552fc9 and project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:04:22.856793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:04:22.859738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:04:22.990586 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab97ade6-d23c-46b3-8838-0fc5f12aa4d9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.118471 Sep 23 04:04:22.993671 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2651/5205] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:04:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:04:23.007485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:23.011686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:23.041430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:23.042222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:23.044109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:23.047425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:23.049636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:23.053117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:24.994682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.011403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.013138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.014602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-301b8183-82ac-40b0-9136-5c51f4e8fa4a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 2.488566 Sep 23 04:04:25.015368 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2555/5206] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:22 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:25.020129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:25.021129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:25.027478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:25.028221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:25.028857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:25.029786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:25.030427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:25.031173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:25.036192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:25.130243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.160803 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a692579-507a-44cd-83b9-eb48c0642b4e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 2.164970 Sep 23 04:04:25.162163 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2652/5207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:22 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:25.183641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:25.188128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:25.196042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:25.196788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:25.197594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:25.198490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:25.199124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:25.199553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:25.243283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.252387 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-028982f8-8015-4fcf-bfe9-83c511cf0f1c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1273 microversion: 2.1 time: 0.235766 Sep 23 04:04:25.266600 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2556/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:25 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:25.279132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d564127-ea7c-4a45-a964-25cf78670d75", "name": "network-vif-plugged", "status": "completed", "tag": "d9535563-80a6-4e4b-8f67-6247a8e19560"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:25.292074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:25.292589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:25.293071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:25.308544 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] Creating event network-vif-plugged:d9535563-80a6-4e4b-8f67-6247a8e19560 for instance 6d564127-ea7c-4a45-a964-25cf78670d75 on n-h1-858495-2 Sep 23 04:04:25.314591 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-55fbf8df-223c-4984-b11b-b9ad73864fdb req-dfcfc1a0-103a-4fdb-9e39-ddf28a972320 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Sep 23 04:04:25.318939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2557/5209] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:25.683992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:25.705372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-43d53c7b-d3ce-4c3c-a4f0-46137699a87c tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1503 microversion: 2.1 time: 0.526511 Sep 23 04:04:25.706089 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2653/5210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:25 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:26.064082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3357189-83f8-4377-b1c6-88878de1fd6e", "name": "network-vif-deleted", "tag": "46747962-5fe3-4dee-9df5-bc44e09cc707"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:26.067008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:26.071030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:26.107446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.108368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.110923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.111724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.113384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.114308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.115363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.115982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.117802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.166703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] Creating event network-vif-deleted:46747962-5fe3-4dee-9df5-bc44e09cc707 for instance e3357189-83f8-4377-b1c6-88878de1fd6e on n-h2-858495-2 Sep 23 04:04:26.185394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-cdb8ec32-5a33-48a8-87e5-b3762cdb0af5 req-6a75fb73-5570-4bff-a950-07a97730cb65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124658 Sep 23 04:04:26.188498 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2654/5211] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:26.213111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:26.218615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:26.232950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.233673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.235286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.236447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.237202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.238689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.764477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:26.780222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f134b3bf-e1d9-4b3d-825f-9f6605c86201 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1321 microversion: 2.1 time: 0.588840 Sep 23 04:04:26.781112 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2655/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:26 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:26.797677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:26.798045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:26.798559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:26.808861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:26.809545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.810093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.810525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:26.810687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.811736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ffb1f4f-3561-49c7-9ecf-0babb9df40a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.773621 Sep 23 04:04:26.812521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.813002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.817232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.826153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2558/5213] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:26 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:26.854944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:26.857663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:26.872517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.872984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.873459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:26.877094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:26.879849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:26.880335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.000424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:27.001702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:27.003627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:27.005224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.005726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lazy-loading 'fault' on Instance uuid e3357189-83f8-4377-b1c6-88878de1fd6e {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:04:27.013794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-159e1ba5-afd3-45e6-8c95-4b6c3cc7cf3a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1279 microversion: 2.1 time: 0.228533 Sep 23 04:04:27.016497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2656/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:26 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:27.261806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f92d9dc8544b74897098bad4a2f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7339be0b514c6bbfccad76f5d27058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:27.272681 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-579e4b48-f35c-41a4-ae5c-a76e1a00ff73 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 200 len: 1304 microversion: 2.1 time: 0.445333 Sep 23 04:04:27.274429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2559/5215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:26 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 1304 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:27.804623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:27.805948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:27.837888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:27.839289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:27.839965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.841183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:27.841887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:27.842720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.842962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:27.844402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:27.853329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:27.856017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:27.856474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.857198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:27.859174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:27.859624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:27.895741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:28.104736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:28.133888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:28.238024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.250243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-44b37e80-9924-471d-9d91-b7743f722e93 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1511 microversion: 2.1 time: 0.449029 Sep 23 04:04:28.252965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.255169 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2657/5216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:27 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:28.262297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.267040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.268174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:28.271786 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf4d202d-02c6-4a79-94a4-29c5818d4da1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.433294 Sep 23 04:04:28.272523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2560/5217] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:27 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:28.273722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:28.279477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:28.283156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:28.297333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.297725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.297881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.298140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.298280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.298590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.298985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.299307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.299425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.300349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.300485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.300786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.535743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.561623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3dfbb080-c05f-43df-9cca-46023cd0cb62 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1279 microversion: 2.1 time: 0.304740 Sep 23 04:04:28.563280 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2658/5218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:28 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1279 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:28.569984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:28.571854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] [instance: e3357189-83f8-4377-b1c6-88878de1fd6e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:28.593714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.594624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.595498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.597192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.597884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.598499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.621086 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] HTTP exception thrown: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Request method failure captured: Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e HTTP/1.1 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS__JzyOm9AvqtoqZ-jyOaZqLwkimVNcOtU2yOmKLCbguZn20ueNHlx7qt_6iG1RGi20zt763QGB-Hx9xyW8hC2zFioWSsNKXcyD_V6-zHfnORpXvYOf1HnbugUnmu31g0zfEe4-7zl6Lfu0FIk8QcFvRQFs2J2SpvNilTP1PiDhAtY Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 7b7339be0b514c6bbfccad76f5d27058 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesActionsTest-1608554520 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b7339be0b514c6bbfccad76f5d27058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesActionsTest-1608554520 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 7b7339be0b514c6bbfccad76f5d27058 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesActionsTest-1608554520 Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesActionsTest-1608554520-project Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 24f92d9dc8544b74897098bad4a2f5ed Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesActionsTest-1608554520-project Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e3357189-83f8-4377-b1c6-88878de1fd6e'} Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:04:28.623268 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. Sep 23 04:04:28.630372 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:04:28.632708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] Returning 404 to user: Instance e3357189-83f8-4377-b1c6-88878de1fd6e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:04:28.633967 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a947a2e-a8d2-48c0-8c4e-71d40794d9f0 tempest-VolumesActionsTest-1608554520 tempest-VolumesActionsTest-1608554520-project] 10.222.0.25 "GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e" status: 404 len: 111 microversion: 2.1 time: 0.068994 Sep 23 04:04:28.634732 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2659/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:28 2022] GET /compute/v2.1/servers/e3357189-83f8-4377-b1c6-88878de1fd6e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:04:28.645957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292f8268-420f-4775-9d18-d8c6f3e41a3a", "tag": "5c8958d1-659e-490a-bc90-06164a013c56"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:28.664072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.665174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.665860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.706282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] Creating event network-changed:5c8958d1-659e-490a-bc90-06164a013c56 for instance 292f8268-420f-4775-9d18-d8c6f3e41a3a on n-h2-858495-2 Sep 23 04:04:28.720609 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d63dc20e-5bc7-4754-8352-eecff79cc052 req-cc5bd83a-4981-433d-80d5-2846cc10855e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083703 Sep 23 04:04:28.720786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:28.721084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2660/5220] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:28.729938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b4af6c7-d52c-4ebe-b7ed-2787cc9b2a09 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1510 microversion: 2.1 time: 0.454050 Sep 23 04:04:28.745385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2561/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:28 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:28.757229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:28.757979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:28.774399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.775651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.777029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:28.778283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:28.778760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:28.779202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.218929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.231792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4eea5c06-df80-4905-aae2-79f5938bb322 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1511 microversion: 2.1 time: 0.479030 Sep 23 04:04:29.235964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2661/5222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:28 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:29.260275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:29.266541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.267571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:29.306230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:29.307364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:29.314679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.315102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.315851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.318748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.319353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.319691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.319902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.320655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.321126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.321438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.321566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.322069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.546533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:29.687833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.696329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.697016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.697681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.752626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.770074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.772798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:29.774089 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-00d17c8e-4fd1-4153-9a04-97081e83e477 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.475578 Sep 23 04:04:29.775616 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2662/5223] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:29 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:29.782649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:29.783358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:29.792932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.793451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.794508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:29.795342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:29.795951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:29.796608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.043365 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e223a4b7-8c5a-4a4e-82e0-8f3b22a7ccf0 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.788021 Sep 23 04:04:30.048168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2562/5224] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 04:04:29 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:30.077787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:30.083761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:30.084775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-597880980', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:30.091297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.092230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.092852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.094548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.095009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.095434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.099796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:30.119765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e4a190c-d40b-44b1-ad69-cee59cace5b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.342040 Sep 23 04:04:30.149435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2663/5225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:29 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:30.254301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:30.357125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:30.368863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.369744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.370362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.630394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6272e162-b5e3-442a-9bb7-1a7a602a6bdc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-597880980" status: 200 len: 1513 microversion: 2.1 time: 0.557026 Sep 23 04:04:30.636995 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2563/5226] 10.222.0.25 () {58 vars in 1261 bytes} [Fri Sep 23 04:04:30 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-597880980 => generated 1513 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:30.662437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:30.668334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:30.669274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:30.699530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.700049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.700505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.701248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.701741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.708140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.800301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:30.800912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:30.802837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:30.820570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.821076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.821601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.822303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:30.822687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:30.823122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:30.938439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:31.095127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:31.103364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:31.104205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:31.104829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:31.511137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:31.524842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:31.527322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:31.530768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-354f78f7-138f-4ce6-8839-51330ad18703 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.734165 Sep 23 04:04:31.533001 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2564/5227] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:30 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:04:31.538497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:31.539108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:31.549291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:31.553870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:31.554416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:31.555267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:31.555733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:31.568232 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-085d588b-351c-4baa-b240-c662f4ec8b76 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.910333 Sep 23 04:04:31.578166 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2664/5228] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Sep 23 04:04:30 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:31.592528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:32.187758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34", "tag": "ebbf55bf-e53d-4efe-afa9-7d93c992fb6d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:32.221577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:32.222262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:32.222876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:32.275087 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] Creating event network-changed:ebbf55bf-e53d-4efe-afa9-7d93c992fb6d for instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 on n-h1-858495-2 Sep 23 04:04:32.287130 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-557f9885-3c3e-4181-8ee8-389905597be7 req-319e6a31-7618-4ebf-9352-96468e54c695 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.705906 Sep 23 04:04:32.291001 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2665/5229] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:32.302433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:32.312804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:32.313582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.servers [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Removing options 'limit' from query {{(pid=128724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:04:32.314662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:32.323123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:32.323923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:32.324765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:32.325816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:32.327243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:32.328615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:32.397524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:32.436023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:32.437967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:32.438786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:33.450594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e156ca5-13d0-4b60-8c04-b219a0ecc098 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.157420 Sep 23 04:04:33.452574 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2666/5230] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Sep 23 04:04:32 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:33.459806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:33.461291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:33.490682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:33.491726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:33.492553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:33.496983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:33.501482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:33.504383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:33.981450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.007209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec1149a7-a18e-4199-850a-2e522506d7c8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 2.468159 Sep 23 04:04:34.007856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2565/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:31 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:34.068213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:34.085919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.091255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:34.114949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.122689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.128795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.138514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.141487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.144572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.273037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:34.361966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be5c58aa-1d8a-419e-8a8e-ed6a85974cce tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.352872 Sep 23 04:04:34.383748 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2566/5232] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:04:34 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:34.389038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:34.398912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.406607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.servers [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Removing options 'limit' from query {{(pid=128723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:04:34.407868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:34.414354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.415207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.416047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.417025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.417830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.418525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.434454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.448560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.456647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.458830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-23d7dbb8-b197-405b-a3af-38171368912a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 1.005229 Sep 23 04:04:34.462950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2667/5233] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:33 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:34.477611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:34.554774 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4a12ec1-a92d-4254-ba95-f76865194a5d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.167123 Sep 23 04:04:34.569844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:34.576202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.582934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2567/5234] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Sep 23 04:04:34 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:34.584131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:34.595819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.596602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.597946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.598947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.605455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.606226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.686291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:34.822787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ac9436da-89f3-47e1-a2a8-3faba5c95abb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.245285 Sep 23 04:04:34.823487 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2668/5235] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 04:04:34 2022] GET /compute/v2.1/servers => generated 1010 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:34.837336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:34.844493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:34.849210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:34.885440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.886354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.887059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:34.888103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:34.889569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:34.893301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.030899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:35.031500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:35.053423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.058081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.059051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.060270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.060920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.061597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.208644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:35.373597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14580f94-6bb2-4950-a954-d006906f07a5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.539465 Sep 23 04:04:35.377331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2568/5236] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:04:34 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:35.392441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:35.402241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:35.402507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.servers [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Removing options 'limit' from query {{(pid=128723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:04:35.404148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:35.418034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.419913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.421399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.423113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.423989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.428927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.489274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:35.504985 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d5bd306-49ec-47cb-bc7d-c642379fdcd9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.477849 Sep 23 04:04:35.506829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2669/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:35 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:35.526330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:35.529872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:35.541414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e01e248-a1fa-4423-b495-71ab0a984a05 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.152656 Sep 23 04:04:35.544046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.546924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.550372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.551867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.552566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.554206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.554695 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2569/5238] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 23 04:04:35 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:35.578137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:35.591848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:35.593773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-597880980', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:35.605771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.607918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.610059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.615650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:35.616386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:35.617150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:35.958268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:36.084092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:36.102151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:36.105415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:36.110240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:36.114975 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5c8d3a7-5685-4111-9a47-9409d39989b1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.602929 Sep 23 04:04:36.117700 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2670/5239] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:35 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:36.155829 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-818b81ed-9018-4107-afc4-2944137bf9db tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-597880980" status: 200 len: 345 microversion: 2.1 time: 0.592804 Sep 23 04:04:36.157098 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2570/5240] 10.222.0.25 () {58 vars in 1240 bytes} [Fri Sep 23 04:04:35 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-597880980 => generated 345 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:36.173629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:36.224448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:36.230527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:36.233396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:36.370435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Going to try to stop instance {{(pid=128724) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:04:36.530580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:36.532627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:36.535608 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8dfcdc37-007b-41d0-92de-55e7c7f558b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "POST /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e/action" status: 202 len: 0 microversion: 2.1 time: 0.368971 Sep 23 04:04:36.547358 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2671/5241] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:04:36 2022] POST /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:04:36.553263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:36.560113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:36.561311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:36.562140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:36.564116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:36.570422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:36.571236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:36.574175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:36.603142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:36.603924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:36.607206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:36.608205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:36.611521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:36.615185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:37.226439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:37.242757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-980cf118-a947-499a-bd0e-e9497cf20db6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.716695 Sep 23 04:04:37.247125 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2571/5242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:36 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:37.261082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:37.261791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:37.275885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:37.276293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:37.276746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:37.287954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:37.288755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:37.289381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:37.506844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:37.518726 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bc315474-ddd7-4d39-91ed-67e5ea678ab8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.959489 Sep 23 04:04:37.519495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2672/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:36 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:37.744989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:37.766602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:37.769524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:37.773293 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6dba9b0-c4a3-4bf7-96c5-066773f5598d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.524268 Sep 23 04:04:37.792920 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2572/5244] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:37 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:38.268395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:38.269733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:38.276699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.281387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.288732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.289515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.290425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.291468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.544238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:38.545102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:38.553668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.557238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.557904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.560574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.561311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.565728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.713995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:38.725488 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-443c899b-736a-4326-9e70-7f46ce1a15f2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.458370 Sep 23 04:04:38.727951 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2673/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:38 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:38.808076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:38.809258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:38.833770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.834633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.837993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.838761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:38.839241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:38.839912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:38.898873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:38.933252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:38.945280 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7252db7-62be-4ae6-aa16-b3264c2cc6bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.405208 Sep 23 04:04:38.953139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2573/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:38 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:39.030232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "name": "network-vif-plugged", "status": "completed", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:39.055342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:39.059455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:39.062740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:39.110067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] Creating event network-vif-plugged:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:04:39.129788 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-991201e9-dd8a-4e80-90c3-ddca4057d35c req-355015af-7d72-45d5-b03e-f5fbcd01d6a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103152 Sep 23 04:04:39.133250 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2574/5247] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:04:39.195712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:39.216296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:39.224859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:39.231038 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20f1ea7d-029f-4207-b32c-6fb85e30fcbb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.426292 Sep 23 04:04:39.233264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2674/5248] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:38 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:39.762074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:39.763372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:39.782533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:39.804471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:39.807220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:39.814969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:39.816363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:39.818707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:39.977484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:39.979236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:39.992350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:39.994073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:39.999456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:40.001870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:40.002859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:40.004334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:40.243978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:40.267021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16cb35d5-5adc-48f4-8bc0-5b6bef12443a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.512798 Sep 23 04:04:40.285068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2575/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:39 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:40.296301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:40.297276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:40.306395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:40.307662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:40.308337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:40.309253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:40.310109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:40.311032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:40.359050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:40.407882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:40.427279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37cd9f68-cda0-4a62-b599-08bf17b749dd tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.453232 Sep 23 04:04:40.429625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2675/5250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:39 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:40.735181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:40.754265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:40.758748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:40.763567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-702ab806-90a1-471b-af02-712915779f1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.473347 Sep 23 04:04:40.769271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2576/5251] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:40 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:41.152087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292f8268-420f-4775-9d18-d8c6f3e41a3a", "name": "network-vif-plugged", "status": "completed", "tag": "5c8958d1-659e-490a-bc90-06164a013c56"}, {"server_uuid": "3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34", "name": "network-vif-plugged", "status": "completed", "tag": "ebbf55bf-e53d-4efe-afa9-7d93c992fb6d"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:41.177878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.178666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.179282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.204316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Creating event network-vif-plugged:5c8958d1-659e-490a-bc90-06164a013c56 for instance 292f8268-420f-4775-9d18-d8c6f3e41a3a on n-h2-858495-2 Sep 23 04:04:41.204810 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] Creating event network-vif-plugged:ebbf55bf-e53d-4efe-afa9-7d93c992fb6d for instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 on n-h1-858495-2 Sep 23 04:04:41.215279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-856af7cc-7e63-4fc1-a2cf-05171345523c req-e6143a8b-3ca9-4e6e-bed7-4ab55fd605bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067838 Sep 23 04:04:41.216403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2676/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:41.299977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:41.300603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:41.312740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.316263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.316758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.317563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.318036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.318467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.453259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:41.454344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:41.472831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.473683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.479747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.480728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.481217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.488695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.774042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:41.787137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-afe9e4da-d129-4b13-bd69-e9fafc55af43 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 0.495435 Sep 23 04:04:41.787756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2577/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:41 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:41.813284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:41.814323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:41.821824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.822738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.823415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.824386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:41.825087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:41.826020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:41.867499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:41.880795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8564ac6d-0d70-4834-9c5c-263d11a49051 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.428429 Sep 23 04:04:41.905161 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2677/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:41 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:42.304208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:42.322449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:42.336623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:42.339850 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d52796e-e9d3-4e3c-945d-65be9102cf67 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1808 microversion: 2.20 time: 0.530500 Sep 23 04:04:42.353617 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2578/5255] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:41 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1808 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:42.815690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:42.816372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:42.819697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:42.832436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:42.832935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:42.849547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:42.850488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:42.850986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:42.851441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:42.908342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:42.909466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:42.924686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:42.926501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:42.926970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:42.929330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:42.936115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:42.936596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:43.877576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:43.880758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:43.891812 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cccc76c8-9e24-42ce-9e5d-7a83066be53a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.987425 Sep 23 04:04:43.912964 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d398c48-9f0d-458a-acc9-b799b1f0a125 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1321 microversion: 2.1 time: 1.101033 Sep 23 04:04:43.914293 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2579/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:42 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:43.918729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2678/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:42 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1321 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:43.919963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:43.920779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:43.927236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:43.927944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:43.928547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:43.929612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:43.930230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:43.930814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:44.331513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:44.349765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:44.357633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:44.360083 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-04aefe2e-ad29-4bcf-820b-24c349ca0a9d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1795 microversion: 2.20 time: 0.444476 Sep 23 04:04:44.361120 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2580/5258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:04:43 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1795 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:04:44.920220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:44.920827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:44.922754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:44.934376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:44.937821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:44.938297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:44.939036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:44.939547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:44.939988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:44.941651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:44.942791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:44.952772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:44.955812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:44.956483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:44.958195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:44.959386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:44.960479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:45.565892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:45.574879 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c49e6174-2cba-4795-b9df-61f97e5df573 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.658741 Sep 23 04:04:45.575828 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2679/5259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:44 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:45.619599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:45.652763 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3e29752-6289-408b-b178-1b452aa2cd0b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1515 microversion: 2.1 time: 0.715249 Sep 23 04:04:45.654141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2581/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:44 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1515 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:45.682253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:45.686976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:45.694915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:45.695703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:45.696508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:45.697586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:45.698224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:45.698828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:45.754646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lazy-loading 'flavor' on Instance uuid 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:04:45.941585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30a6b7cd-678a-4c9f-98b3-4adb2c279cb0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action" status: 200 len: 32 microversion: 2.1 time: 0.265510 Sep 23 04:04:45.945035 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2680/5261] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:04:45 2022] POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:04:45.954523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:45.955723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:45.966208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:45.970170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:45.970845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:45.971492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:45.974799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:45.975311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:45.976553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:46.400723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:46.415334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02772fc0-bbbf-41c9-a25d-686947584d0a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.465063 Sep 23 04:04:46.416301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2582/5262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:45 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:46.600407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:46.601124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:46.615800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:46.619337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:46.620104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:46.622805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:46.625187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:46.627062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:47.245044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:47.272066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0dc817f9-e5e6-42db-8ab7-5e894cbd4993 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.676504 Sep 23 04:04:47.277496 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2681/5263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:46 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:47.439569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:47.439958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:47.452814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:47.453544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:47.454551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:47.459224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:47.460056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:47.460662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:47.800823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:47.815668 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5bbbd274-2dc0-48f5-95e2-e36fc18a70a7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.380770 Sep 23 04:04:47.833378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2583/5264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:47 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:48.303392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:48.304592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:48.319458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:48.323211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:48.324064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:48.330961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:48.331730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:48.332204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:48.332635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:48.813414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:48.823891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a05d781-a7a7-4030-af6c-fbcc2ed2f5ea tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.525002 Sep 23 04:04:48.841490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:48.842161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:48.848330 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2682/5265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:48 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:48.854845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:48.855605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:48.857210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:48.860146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:48.860792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:48.863306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:49.090244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:49.105796 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9b6050b-d49e-452b-8416-faef2fd58fa5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.265922 Sep 23 04:04:49.106678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2584/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:48 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:49.853754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:49.854949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:49.866995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:49.870530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:49.871176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:49.872076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:49.873946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:49.878989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:50.139749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:50.140362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:50.160813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:50.161444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:50.161633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:50.162087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:50.162803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:50.163263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:50.163696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:50.171861 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f73a181-82e3-4d72-9ca4-5a9fb0c7425d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.321882 Sep 23 04:04:50.176900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2683/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:49 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:50.710911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:50.719873 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb377cd6-17d7-44fc-819b-ba0fa70f3eb7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.583898 Sep 23 04:04:50.733057 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2585/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:50 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:04:51.199501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:51.200919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:51.212475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:51.221756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:51.224409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:51.226671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:51.229566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:51.232543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:51.759625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:51.760995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:51.772715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:51.773627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:51.776211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:51.777213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:51.777967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:51.779817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:52.136609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:52.161031 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d6b5c326-33ff-4341-acd1-a02aefdbd101 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.962082 Sep 23 04:04:52.162683 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2684/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:51 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:52.350293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:52.367010 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2642bcf4-3355-4490-b175-be59eb8c962f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.611222 Sep 23 04:04:52.382104 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2586/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:51 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:53.196383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:53.197067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:53.214690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:53.215968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:53.216873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:53.219566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:53.223199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:53.223939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:53.393175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:53.394550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:53.402953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:53.403816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:53.404522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:53.405524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:53.406203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:53.406890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:53.600430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:53.617484 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ebe785a3-a01c-4a54-8edc-a74b9b2e5435 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 0.430023 Sep 23 04:04:53.622619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2685/5271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:53 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:54.064980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:54.084979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cabaa5d3-0cf5-46cc-b926-68e71a73988a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.697266 Sep 23 04:04:54.086242 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2587/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:53 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:54.652052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:54.653302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:54.676049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:54.677159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:54.677885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:54.678818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:54.681621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:54.682080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:55.112596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:55.113221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:55.136746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:55.141088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:55.141574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:55.142876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:55.143337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:55.143768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:55.208842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:56.016878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:56.036953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0548d90-c18b-4f15-9d31-1180e2515eeb tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1520 microversion: 2.1 time: 1.389951 Sep 23 04:04:56.038024 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2686/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:54 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1520 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:56.199524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:56.212456 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97e15409-5e26-494b-b605-9456ef0d75cd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 1.105207 Sep 23 04:04:56.214726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2588/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:55 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:57.063016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:57.064060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:57.081421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.085143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.086195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.087777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.090848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.091853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.244639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:57.246614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:57.254059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.254952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.255670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.256829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.257655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.274213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.457737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:57.467170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d4d52d0-bf24-424e-a130-2c923008848d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1497 microversion: 2.1 time: 0.408492 Sep 23 04:04:57.467748 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2687/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:57 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:57.495484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:57.503021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:57.503884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:04:57.531622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.532110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.532577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.533304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.533782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.534206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.686802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:57.705579 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b71c6905-c461-43f0-8475-b13000cbcdbf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.465116 Sep 23 04:04:57.722372 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2589/5276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:57 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:57.772971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:04:57.848542 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3e635af-d6ba-429f-b4c9-35a676a43692 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.362912 Sep 23 04:04:57.849764 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2688/5277] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Sep 23 04:04:57 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:04:57.863416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:04:57.872482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:57.872991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:57.877508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:57.944774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Going to try to start instance {{(pid=128723) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:04:58.038767 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6501f436-700e-41d4-8688-b42cc21eec46 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "POST /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e/action" status: 202 len: 0 microversion: 2.1 time: 0.180316 Sep 23 04:04:58.046753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2590/5278] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:04:57 2022] POST /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:04:58.061802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:58.062851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:58.075402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:58.076851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:58.077580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:58.079090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:58.080580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:58.081328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:58.129564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:04:58.466531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:58.476909 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d19d06b9-2849-47f5-84bf-bd4fda443898 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1506 microversion: 2.1 time: 0.425809 Sep 23 04:04:58.480760 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2689/5279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:58 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:58.734828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:58.735948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:58.744543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:58.745205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:58.746107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:58.747201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:58.747899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:58.748741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:58.988888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:59.000904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30341c6d-b859-402a-862c-063a07ee1ad1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.272988 Sep 23 04:04:59.002342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2591/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:58 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:04:59.507488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:04:59.518583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:04:59.533848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:59.535169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:59.535800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:59.536705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:04:59.537335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:04:59.538015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:04:59.809632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:04:59.823579 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-795e5a1f-06c2-47e3-a93f-67e7a6c891bc tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1506 microversion: 2.1 time: 0.320721 Sep 23 04:04:59.831119 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2690/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:04:59 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:00.024675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:00.025622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:00.038025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:00.038571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:00.039275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:00.040074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:00.040542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:00.054142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:00.324703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:00.341143 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7af8aac8-c53e-42bf-aab1-63bfe83442fb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.317967 Sep 23 04:05:00.351766 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2592/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:00 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:00.854678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:00.855244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:00.866867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:00.867984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:00.877785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:00.878889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:00.879574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:00.880232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.366533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:01.367260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:01.371667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=60 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:01.420416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.428492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.428998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.429800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.430270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.430719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.684222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:01.707063 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a232b5f0-287d-4a32-8dc3-dfdadd977ac3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.331591 Sep 23 04:05:01.707774 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2593/5283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:01 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:01.775462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:01.792268 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaf1090b-0234-4846-b27a-b69394a5175a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1510 microversion: 2.1 time: 0.944597 Sep 23 04:05:01.793546 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2691/5284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:00 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1510 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:01.818300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:01.824445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:01.825119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.servers [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Removing options 'limit' from query {{(pid=128723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:05:01.826190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:01.827558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.828244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.828890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.830391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.831042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.831647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.833296 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9b5b137-e985-4749-9bfa-bb63450db598 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019986 Sep 23 04:05:01.847351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:01.848266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:01.853369 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2594/5285] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 23 04:05:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:05:01.855417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.856472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.857104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:01.858067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:01.858707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:01.859315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.295708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:02.319141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a95abc1-8562-4e94-a5dd-ea9fc70b5a0b tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1510 microversion: 2.1 time: 0.473611 Sep 23 04:05:02.340868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2692/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:01 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:02.342794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:02.343417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:02.357010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.360777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.366319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.368093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.369261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.372657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.740762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:02.741670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:02.760919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.761775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.762417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.763329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.763975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.764584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.824755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:02.833497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-050c2222-2600-4043-84b3-41f9121b78f8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1511 microversion: 2.1 time: 0.494809 Sep 23 04:05:02.845937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2595/5287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:02 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:02.861399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:02.862192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:02.880998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.881774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.882257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:02.883024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:02.884113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:02.884557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:03.334357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:03.352943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bcb72349-3ab4-4dfd-8658-cfc5e1082626 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1511 microversion: 2.1 time: 0.497671 Sep 23 04:05:03.354281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2596/5288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:02 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:03.381328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:03.385649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:03.394024 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fde284eb-c331-4b84-b910-106c45d7f5e4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.658941 Sep 23 04:05:03.394967 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2693/5289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:02 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:03.408140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:03.409301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:03.688155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:03.689816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:03.690505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:03.692064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:03.692727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:03.693595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:03.884450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:03.996529 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-374cf4b5-de9d-4628-a5ea-cb18164fe011 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.623978 Sep 23 04:05:03.998000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2597/5290] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Sep 23 04:05:03 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:04.010966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:04.011883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:04.026565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.027864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.028636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.029582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.030220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.030817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.419912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:04.420540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:04.440648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.441565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.442499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.443671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.444326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.444956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.474979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:04.486568 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73cae3e8-972b-49e3-bfa3-ed45a62e2cb1 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1510 microversion: 2.1 time: 0.479840 Sep 23 04:05:04.490174 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2694/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:04 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:04.514055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:04.514938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:04.529084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.530433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.534360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.535531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:04.537818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:04.539577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:04.930372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:04.940038 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e12feb0-7865-4109-b7be-fc44da2d83c4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.525317 Sep 23 04:05:04.944355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2598/5292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:04 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:05.013807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:05.026178 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a31ceae-cf03-4750-8f99-cc03febd6823 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1511 microversion: 2.1 time: 0.516433 Sep 23 04:05:05.027735 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2695/5293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:04 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:05.051287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:05.052081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:05.058746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.059674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.060308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.061437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.062067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.062657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.679346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:05.698933 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74cb166d-9ba2-4789-b929-769b109367b5 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1511 microversion: 2.1 time: 0.652024 Sep 23 04:05:05.717389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2599/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:05 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:05.725987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:05.737687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:05.738893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:05.754180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.755062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.755753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.756726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.757438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.758823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.819440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:05.888589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:05.905097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.907104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.907785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.967715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:05.968558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:05.985300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.986263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.986880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:05.987965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:05.988691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:05.989311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.239213 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-516515c4-420a-4cc3-8dd8-8e3b234d748d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.516832 Sep 23 04:05:06.242806 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2696/5295] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:05:05 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:06.272225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:06.277657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:06.295651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:06.297025 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cce494be-412b-4a83-9334-2aac44e3cfa6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.332930 Sep 23 04:05:06.300667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:06.301153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2600/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:05 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:06.449202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.450078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.451426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.454165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.478607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.481130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.597643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:06.692672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf563dee-2079-477a-88aa-5c4b5dc85d03 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.425267 Sep 23 04:05:06.694044 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2697/5297] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Sep 23 04:05:06 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:06.708307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:06.716732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:06.717714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:06.724490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.725208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.725859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.726840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.727475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.728078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.841935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:06.927503 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-359a69d5-2523-41d8-849a-85f2c1152be4 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.223223 Sep 23 04:05:06.929060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2601/5298] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Sep 23 04:05:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:06.941626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:06.949462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:06.951258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:06.963608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.967400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.970952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:06.974606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:06.975376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:06.976075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.115444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:07.181623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d563fe21-9810-45b5-893c-1e7950620a08 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.244428 Sep 23 04:05:07.182428 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2698/5299] 10.222.0.25 () {58 vars in 1196 bytes} [Fri Sep 23 04:05:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:07.196916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.202351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:07.203232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': '-597880980', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:07.211249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.211249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.211692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.213251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.215766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.216599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.306311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:07.325160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.325707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:07.332427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.332952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.333446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.334157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.334615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.335046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.370774 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85562923-e0b5-47fb-b1e2-9f152f4256b7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-597880980" status: 200 len: 345 microversion: 2.1 time: 0.179329 Sep 23 04:05:07.376121 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2602/5300] 10.222.0.25 () {58 vars in 1156 bytes} [Fri Sep 23 04:05:07 2022] GET /compute/v2.1/servers?name=-597880980 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:07.385604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.391892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:07.392656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:07.398100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.399037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.399037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.399851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.400305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.400731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.520555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:07.536664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:07.591739 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e609630d-14b9-4734-8d7d-1854397e444a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.209688 Sep 23 04:05:07.599272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2603/5301] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Sep 23 04:05:07 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:07.606352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.612668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:07.613605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-59788098', 'deleted': False, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e'} {{(pid=128723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:05:07.619791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.620278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.620716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.621477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.622114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.623406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.679009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:07.694777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17f2bf90-dc9e-41ce-8449-3e9f5b81a771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.373371 Sep 23 04:05:07.698717 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2699/5302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:07 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:07.719231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.multi_cell_list [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:05:07.780653 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28775fe4-cfe9-4964-9316-46053f21b3ff tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-59788098" status: 200 len: 345 microversion: 2.1 time: 0.179413 Sep 23 04:05:07.782737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2604/5303] 10.222.0.25 () {58 vars in 1226 bytes} [Fri Sep 23 04:05:07 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-59788098 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:07.794885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.795388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:07.802099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.802600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.803139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.803845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.804301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.804734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.843057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:05:07.966714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0083803c-bdc4-4b5d-9aa3-5ee88982f304 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 204 len: 0 microversion: 2.1 time: 0.175399 Sep 23 04:05:07.971600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2700/5304] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:05:07 2022] DELETE /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:07.979151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:07.979769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:07.987425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.988055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.988519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:07.989252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:07.989879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:07.990466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:08.147143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:08.155443 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-caba5668-561a-493b-9e81-70f9ebae134e tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1517 microversion: 2.1 time: 0.181089 Sep 23 04:05:08.156658 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2605/5305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:07 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:08.725478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:08.726411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:08.738567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:08.739341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:08.740706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:08.742180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:08.743362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:08.743985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:08.948340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:08.962511 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-710fb7bb-87cf-46ac-af88-8d6c102dff8c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.247370 Sep 23 04:05:08.963673 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2701/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:08 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:09.182080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:09.183373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:09.193180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:09.193870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:09.194452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:09.195344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:09.195800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:09.196422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:09.519251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:09.527445 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6583a931-ef2a-4a3f-9ded-fe913e5ba18f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1517 microversion: 2.1 time: 0.351354 Sep 23 04:05:09.530693 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2606/5307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:09 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:09.987960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:09.989889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:09.997669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:09.998647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:09.999815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:10.001315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:10.001989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:10.002560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:10.223112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:10.228086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:10.243682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5372d75-3ff4-48b6-a34e-540a50087c32 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.260202 Sep 23 04:05:10.245517 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2702/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:09 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:10.553107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:10.553669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:10.564760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:10.565909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:10.566521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:10.567261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:10.567726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:10.568168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:10.831189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:10.847678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-39dea3aa-d717-459c-9a93-4a6f40061b75 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1517 microversion: 2.1 time: 0.298143 Sep 23 04:05:10.848864 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2607/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:10 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:11.267911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:11.268542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:11.285746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:11.286254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:11.287743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:11.289663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:11.290143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:11.290585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:11.557598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d564127-ea7c-4a45-a964-25cf78670d75", "name": "network-vif-deleted", "tag": "d9535563-80a6-4e4b-8f67-6247a8e19560"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:11.568205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:11.568701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:11.569148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:11.621157 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] Creating event network-vif-deleted:d9535563-80a6-4e4b-8f67-6247a8e19560 for instance 6d564127-ea7c-4a45-a964-25cf78670d75 on n-h1-858495-2 Sep 23 04:05:11.644963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fe4f464a-d125-4ee7-876d-3a1dd5afe141 req-ab547291-9447-416f-bae5-c16fa00479b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090682 Sep 23 04:05:11.646355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2608/5310] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:05:11.664701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:11.673688 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-393f65c4-792c-425f-919e-5802b701b1d0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.410210 Sep 23 04:05:11.682556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2703/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:11 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:11.873876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:11.874653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:11.892171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:11.895209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:11.895698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:11.899481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:11.901184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:11.903114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:12.007889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:12.008810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:12.009278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:12.011903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lazy-loading 'fault' on Instance uuid 6d564127-ea7c-4a45-a964-25cf78670d75 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:05:12.181879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:12.191985 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b9acf84-535f-453e-8382-7ad36d523991 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 200 len: 1311 microversion: 2.1 time: 0.323857 Sep 23 04:05:12.212260 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2609/5312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:11 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 1311 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:12.707271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:12.708038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:12.715054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:12.715913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:12.716585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:12.717513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:12.718162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:12.718779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.035896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:13.051745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-414bdb85-481d-4688-88e1-13a91a33b8e8 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.348193 Sep 23 04:05:13.062140 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2704/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:12 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:13.220819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:13.221566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: 6d564127-ea7c-4a45-a964-25cf78670d75] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:13.230077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.230826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.231574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.232883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.233771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.234458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.255041 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] HTTP exception thrown: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Request method failure captured: Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 HTTP/1.1 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTAqb1x8IAY6R4ZbUyRRNlhXVCy5DZnLIJ7OwQzh09ogUr4GElMEgE_O7BmRCq3TlTsLzpw15r0-QCbcLM9xiNfeT2jaskjETT9Kcs5sRCu10x_tMHgrH1Ht68IWIEUJ_UGbywFqQV2MDezFvmgfgDyya0xK_CdlZt8s1zZFomz3-2k Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 979de0261edc45bebd9ebf2ce6c1a2c5 Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6d564127-ea7c-4a45-a964-25cf78670d75'} Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:13.257626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. Sep 23 04:05:13.261607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:13.263487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Returning 404 to user: Instance 6d564127-ea7c-4a45-a964-25cf78670d75 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:13.265435 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43c84202-269f-4a62-afd9-5e44a6513ec7 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75" status: 404 len: 111 microversion: 2.1 time: 0.049098 Sep 23 04:05:13.276279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:13.276860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:13.277681 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2610/5314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:13 2022] GET /compute/v2.1/servers/6d564127-ea7c-4a45-a964-25cf78670d75 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:05:13.284363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.285284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.286015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.287388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.288171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.288799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.335390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:05:13.486404 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9acffaba-8a1c-4b98-a5c6-4fc564179d1d tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 204 len: 0 microversion: 2.1 time: 0.214490 Sep 23 04:05:13.491414 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2705/5315] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:05:13 2022] DELETE /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:13.505283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:13.509690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:13.521179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.521899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.522477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:13.523322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:13.523941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:13.524507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:14.082602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:14.083364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:14.104679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:14.105387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:14.105992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:14.106859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:14.107478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:14.107950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:14.148526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:14.162185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb2f435d-b086-45d1-ad12-dcab7b650d61 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1517 microversion: 2.1 time: 0.668841 Sep 23 04:05:14.163083 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2611/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:13 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1517 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:14.564120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:14.582692 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec84efdb-9b05-4e12-82e9-b13ae1704cee tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.499396 Sep 23 04:05:14.583636 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2706/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:14 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:15.189163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:15.190209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:15.199665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:15.200442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:15.201164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:15.202296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:15.204252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:15.205690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:15.616079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:15.617724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:15.625024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:15.626208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:15.626892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:15.627845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:15.628566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:15.629243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:15.657796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:15.670184 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bcc0c349-6f87-4073-bcee-8fcd1a6d9e11 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1517 microversion: 2.1 time: 0.484844 Sep 23 04:05:15.673180 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2612/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:15 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:15.888061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:16.231554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:16.250884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ac324af5-f7e3-466e-ab4b-847272b867cf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.643184 Sep 23 04:05:16.284173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2707/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:15 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:16.706655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:16.708455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:16.732316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:16.733686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:16.734140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:16.738351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:16.740503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:16.743238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:16.794147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54fadb3-2b94-41de-ab5f-61e639abe7d9", "name": "network-vif-deleted", "tag": "f170490f-6051-4038-ab0d-00249d664d41"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:16.838442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:16.843177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:16.850514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:16.883243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] Creating event network-vif-deleted:f170490f-6051-4038-ab0d-00249d664d41 for instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 on n-h2-858495-2 Sep 23 04:05:16.892263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fec90b44-f25a-40e5-97a7-f3eed3395571 req-5f786dfd-1d77-4240-a8d9-8c98fb26080e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101655 Sep 23 04:05:16.893261 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2708/5320] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:16.937337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:16.949510 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b083861-2886-41ef-b23e-0367b82bd26a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 200 len: 1475 microversion: 2.1 time: 0.252317 Sep 23 04:05:16.949894 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2613/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:16 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:17.284361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:17.285625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:17.295256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:17.302780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:17.303501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:17.304094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:17.304958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:17.305595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:17.306200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:17.700178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:17.714498 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7b8d2de-ef51-4bc3-b043-fd1ef42cabe3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.433896 Sep 23 04:05:17.715641 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2709/5322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:17 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:17.973299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:17.974040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: a54fadb3-2b94-41de-ab5f-61e639abe7d9] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:17.976523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:17.984523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:17.985129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:17.985723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:17.986521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:17.986992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:17.987431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.020358 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] HTTP exception thrown: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Request method failure captured: Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 HTTP/1.1 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTAqb1x8IAY6R4ZbUyRRNlhXVCy5DZnLIJ7OwQzh09ogUr4GElMEgE_O7BmRCq3TlTsLzpw15r0-QCbcLM9xiNfeT2jaskjETT9Kcs5sRCu10x_tMHgrH1Ht68IWIEUJ_UGbywFqQV2MDezFvmgfgDyya0xK_CdlZt8s1zZFomz3-2k Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 979de0261edc45bebd9ebf2ce6c1a2c5 Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'a54fadb3-2b94-41de-ab5f-61e639abe7d9'} Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:18.022709 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. Sep 23 04:05:18.026392 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:18.029184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Returning 404 to user: Instance a54fadb3-2b94-41de-ab5f-61e639abe7d9 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:18.030244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ec3f21f-7b8d-4cd5-90f8-028043521ef3 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9" status: 404 len: 111 microversion: 2.1 time: 0.061931 Sep 23 04:05:18.030910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2614/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:17 2022] GET /compute/v2.1/servers/a54fadb3-2b94-41de-ab5f-61e639abe7d9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:05:18.042170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:18.043206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:18.052582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.058000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.059420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.060278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.060969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.062391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.100815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:05:18.209253 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fefc04f9-d1c9-48c2-918e-a14fbc02db1a tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 204 len: 0 microversion: 2.1 time: 0.173399 Sep 23 04:05:18.210765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2710/5324] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:05:18 2022] DELETE /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:18.219373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:18.220405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:18.228316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.228959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.230455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.232308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.233598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.234212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.741041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:18.741837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:18.765260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:18.768151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.768888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.769731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.770776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:18.771072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:18.771736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:18.772349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:18.787222 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83ab79ef-92cc-4bc1-9abf-9b8697ced3b8 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1516 microversion: 2.1 time: 0.572581 Sep 23 04:05:18.802306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2615/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:18 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1516 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:19.109497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:19.120873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75d57506-b6e5-4fe2-b2fc-e00131e1ad9e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.385384 Sep 23 04:05:19.138554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2711/5326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:18 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:19.815102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:19.815849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:19.832555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:19.835895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:19.837590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:19.839630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:19.844283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:19.844796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:20.145048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:20.145759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:20.153663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:20.154176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:20.155337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:20.156067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:20.157073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:20.157535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:20.314894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:20.329454 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5953560-3429-4101-9097-a7857f297866 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1516 microversion: 2.1 time: 0.517894 Sep 23 04:05:20.338540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2616/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:19 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:20.559506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:20.573752 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd2e87bb-c711-494b-9984-f62b5f190799 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1521 microversion: 2.1 time: 0.432913 Sep 23 04:05:20.574868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2712/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:20 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:21.200601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c672701e-507a-4345-926d-f43011d5ee9e", "name": "network-vif-deleted", "tag": "7475214c-827f-4788-844d-6b71196481fb"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:21.257968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:21.260058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:21.261548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:21.292150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] Creating event network-vif-deleted:7475214c-827f-4788-844d-6b71196481fb for instance c672701e-507a-4345-926d-f43011d5ee9e on n-h1-858495-2 Sep 23 04:05:21.304588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2047b85a-d25d-46ba-9524-d66b4b4e9daf req-3a0f88f3-9ee1-4a56-b6cb-59953a413a28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128444 Sep 23 04:05:21.307518 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2617/5329] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:21.356880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:21.357890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:21.376318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:21.380916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:21.381756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:21.382720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:21.384317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:21.385202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:21.570227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979de0261edc45bebd9ebf2ce6c1a2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18cd1e8cf95430e86de6920e5f6be6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:21.579875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ff6f35e-00c9-498c-ba3f-8518b9eb7c60 tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 200 len: 1305 microversion: 2.1 time: 0.228497 Sep 23 04:05:21.582387 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2713/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:21 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:21.600627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:21.601880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:21.614288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:21.615078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:21.615781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:21.618267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:21.618980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:21.619856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.146715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:22.159133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13d12efd-5c8b-4b64-ad9e-2a5e734c8214 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1501 microversion: 2.1 time: 0.564152 Sep 23 04:05:22.159889 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2618/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:21 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1501 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:22.189694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:22.190522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:22.210160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.210932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.212951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.217728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.219050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.220678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.606659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:22.607280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] [instance: c672701e-507a-4345-926d-f43011d5ee9e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:22.622576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.623069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.623508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.624235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.624704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.635369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.679267 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] HTTP exception thrown: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Request method failure captured: Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e HTTP/1.1 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTAqb1x8IAY6R4ZbUyRRNlhXVCy5DZnLIJ7OwQzh09ogUr4GElMEgE_O7BmRCq3TlTsLzpw15r0-QCbcLM9xiNfeT2jaskjETT9Kcs5sRCu10x_tMHgrH1Ht68IWIEUJ_UGbywFqQV2MDezFvmgfgDyya0xK_CdlZt8s1zZFomz3-2k Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d18cd1e8cf95430e86de6920e5f6be6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: d18cd1e8cf95430e86de6920e5f6be6e Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-592609722 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 979de0261edc45bebd9ebf2ce6c1a2c5 Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ListServerFiltersTestJSON-592609722-project Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c672701e-507a-4345-926d-f43011d5ee9e'} Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:22.681223 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] Returning 404 to user: Instance c672701e-507a-4345-926d-f43011d5ee9e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6587d010-9241-4810-9e1e-eb7167d4e97f tempest-ListServerFiltersTestJSON-592609722 tempest-ListServerFiltersTestJSON-592609722-project] 10.222.0.25 "GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e" status: 404 len: 111 microversion: 2.1 time: 0.081166 Sep 23 04:05:22.684423 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2619/5332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:22 2022] GET /compute/v2.1/servers/c672701e-507a-4345-926d-f43011d5ee9e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:05:22.817903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:22.828101 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ce47f1a8-85a2-465e-a431-11631a321d86 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1515 microversion: 2.1 time: 0.644395 Sep 23 04:05:22.831800 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2714/5333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:22 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1515 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:22.854175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:22.857268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 0206b9ad-45aa-4156-aa30-123e39a48817] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:22.863952 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/0206b9ad-45aa-4156-aa30-123e39a48817/action HTTP/1.1 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 14 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: {"rescue": {}} Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '0206b9ad-45aa-4156-aa30-123e39a48817', 'body': {'rescue': {}}} Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.872529 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. Sep 23 04:05:22.876376 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:22.878232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 404 to user: Instance 0206b9ad-45aa-4156-aa30-123e39a48817 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:22.879340 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-092999e4-9d4a-43e7-88c9-c7122b79e208 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/0206b9ad-45aa-4156-aa30-123e39a48817/action" status: 404 len: 111 microversion: 2.1 time: 0.029171 Sep 23 04:05:22.882145 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2620/5334] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:22 2022] POST /compute/v2.1/servers/0206b9ad-45aa-4156-aa30-123e39a48817/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:05:22.891805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:22.892904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:22.903123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.905156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.905893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.908494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:22.909229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:22.909952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:22.987834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:23.004311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0970b64f-4504-4648-8e45-862fc799e1b0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.114160 Sep 23 04:05:23.005375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2715/5335] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:22 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:05:23.013463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:23.014325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:23.026336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:23.026946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:23.028635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:23.030158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:23.032277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:23.032844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:23.365041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:23.382494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16642bf7-fcc5-4bde-bc13-2b215291f894 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1520 microversion: 2.1 time: 0.372947 Sep 23 04:05:23.383306 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2621/5336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:23 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:24.408539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:24.409929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:24.423797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:24.425602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:24.427923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:24.429701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:24.431138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:24.433624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:24.943276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:24.960930 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f65971f1-a87e-4ff1-97e3-56006c8b0bcb tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1500 microversion: 2.1 time: 0.557981 Sep 23 04:05:24.982016 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2716/5337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:24 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1500 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:24.989732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:24.992883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:25.014857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.018227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.019872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.020741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.023360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.024191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.074854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lazy-loading 'flavor' on Instance uuid 292f8268-420f-4775-9d18-d8c6f3e41a3a {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:05:25.107298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Cannot 'rescue' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state paused Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action HTTP/1.1 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 14 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: {"rescue": {}} Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'rescue' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state paused Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '292f8268-420f-4775-9d18-d8c6f3e41a3a', 'body': {'rescue': {}}} Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a in vm_state paused. Cannot rescue while the instance is in this state. Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state paused Sep 23 04:05:25.114214 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state paused Sep 23 04:05:25.117624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:25.121685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 409 to user: Cannot 'rescue' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state paused {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:25.122859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26e6f7bc-2bd6-491b-a10d-b261e4706638 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action" status: 409 len: 144 microversion: 2.1 time: 0.139680 Sep 23 04:05:25.124723 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2622/5338] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:24 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action => generated 144 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:05:25.134679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:25.136599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:25.149681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.150601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.151324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.152542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.153562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.154433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.271263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a5fd250-c1b5-4b5e-a880-383e4deabbc2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.142030 Sep 23 04:05:25.274934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2717/5339] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:25 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:05:25.281867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:25.282811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:25.307510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.308114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.308660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.309537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:25.310090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:25.310546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:25.864908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:25.877043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:25.881166 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fb85e65-c41f-49db-adf6-bd010d927a05 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1507 microversion: 2.1 time: 0.604535 Sep 23 04:05:25.882655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2623/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:25 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1507 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:26.013729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:26.014323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:26.035235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.037288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.041530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.042312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.042793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.043231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.143276 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4a7f9f3-1bc5-4f10-b811-ac10f477c55b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments/1d5e6db5-de3b-4df6-8b54-be176d7a5215" status: 200 len: 194 microversion: 2.20 time: 0.135375 Sep 23 04:05:26.146852 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2718/5341] 10.222.0.25 () {60 vars in 1454 bytes} [Fri Sep 23 04:05:26 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments/1d5e6db5-de3b-4df6-8b54-be176d7a5215 => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:26.293126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:26.295079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:26.308100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.309303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.309960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.311051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.311845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.313115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.492662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lazy-loading 'services' on Instance uuid 74f9860d-c80e-4fed-ba41-76b76d507172 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:05:26.616316 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98f8919e-f5b0-40e6-84a5-3166d429fac6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments/1d5e6db5-de3b-4df6-8b54-be176d7a5215" status: 202 len: 0 microversion: 2.20 time: 0.330070 Sep 23 04:05:26.617378 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2624/5342] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Sep 23 04:05:26 2022] DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments/1d5e6db5-de3b-4df6-8b54-be176d7a5215 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:26.627075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:26.629926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:26.645724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.646357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.647178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.649302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.649902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.651528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.737625 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5ea423a-1939-44c3-ac90-c9e96658e9f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114888 Sep 23 04:05:26.741163 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2719/5343] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:26 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:26.908702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:26.909440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:26.923110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.923775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.924222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:26.924957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:26.928921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:26.929515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:27.491186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:27.505602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7e27af37-180a-460a-8ec2-2c539edac053 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1515 microversion: 2.1 time: 0.597658 Sep 23 04:05:27.506852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2625/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:26 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1515 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:27.753336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:27.756596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:27.776676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:27.777966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:27.779741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:27.792936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:27.793695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:27.794452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:27.865996 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-310e45c4-fb9b-4a77-b270-fc68e79c9588 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112668 Sep 23 04:05:27.875992 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2720/5345] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:27 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:28.879989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:28.883232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:28.894577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:28.897334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:28.898041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:28.898982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:28.901193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:28.901918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:28.965389 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77cd1032-eddc-4f92-8925-8462ccf53af5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090384 Sep 23 04:05:28.966652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2626/5346] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:28 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:29.979312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:29.982408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:30.000630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.001576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.002234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:30.003227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.004117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.009797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:30.127778 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50cd2850-eb6a-4196-824a-e33feeead4ee tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152753 Sep 23 04:05:30.134530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2721/5347] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:29 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:30.356767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:30.359954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:30.376824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.377641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.378269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:30.379424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.381650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.382259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:30.411427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lazy-loading 'flavor' on Instance uuid 292f8268-420f-4775-9d18-d8c6f3e41a3a {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:05:30.526031 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb8532eb-5830-4e19-9de7-9c88c1d492b5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action" status: 200 len: 32 microversion: 2.1 time: 0.172774 Sep 23 04:05:30.527387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2627/5348] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:30 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:05:30.540017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:30.540832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:30.556140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.556597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.557252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:30.558133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:30.558784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:30.559492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:31.142485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:31.146470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:31.174938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:31.175573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:31.176036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:31.183517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:31.185990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:31.190785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:31.258969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a46ef6e-e217-4005-a3d2-c5d5e15169c8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122049 Sep 23 04:05:31.266420 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2628/5349] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:31 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:05:31.291994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:31.305176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d1eaecf-0a0a-4bb7-9ed3-50b7998ce0bf tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.771751 Sep 23 04:05:31.306036 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2722/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:30 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:32.276865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:32.280144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:32.296935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=70 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:32.299707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:32.300217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:32.300667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:32.303586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:32.304114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:32.304505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:32.334986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:32.335793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:32.362696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:32.363651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:32.376565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:32.382178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:32.382705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:32.385636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:32.441873 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dec43c51-16b4-4af9-bdad-101f9abe4359 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171684 Sep 23 04:05:32.442484 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2629/5351] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:32 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:05:33.459311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:33.463316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:33.489021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:33.490112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:33.492225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:33.493685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:33.498870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:33.500760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:33.501344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:33.503991 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53272a89-0d5a-4a65-8d69-f0ba21363223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 1.179761 Sep 23 04:05:33.505651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2723/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:32 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:33.584098 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8cccf21-032b-413d-b6bb-9e016f2a2dbf tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132809 Sep 23 04:05:33.590644 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2630/5353] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:33 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:05:34.539099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:34.540290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:34.549611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.552884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.554815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.558148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.558815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.561536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.598067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:34.600796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:34.622585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.626643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.628874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.632729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.633404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.636070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.696052 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8753cbd-1431-42a6-9450-24fc64968abb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102070 Sep 23 04:05:34.703915 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2631/5354] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:05:34 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:34.819274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:34.819789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:34.832894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.834717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.835182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.835919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:34.836385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:34.836825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:34.909532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:05:35.118357 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc22c05a-dc1f-434c-a4b5-fbdef13e0211 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 204 len: 0 microversion: 2.20 time: 0.303210 Sep 23 04:05:35.119745 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2632/5355] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:05:34 2022] DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:05:35.132605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:35.135465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:35.149765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:35.150267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:35.150871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:35.151599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:35.152066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:35.158622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:35.688422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:35.701582 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ecc3ccc-839a-418a-b1cf-2d481041b3ad tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 1.172492 Sep 23 04:05:35.708667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2724/5356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:34 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:36.731002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:36.732098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:36.751416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:36.752017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:36.752687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:36.753546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:36.754079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:36.755131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:37.315184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:37.330648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:37.337725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:37.342318 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29a0a5f8-d42e-4003-9013-6c6b9cb393a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 2.217270 Sep 23 04:05:37.355639 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2633/5357] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:35 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:38.028157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:38.040752 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c781d923-a985-46e5-aae1-35667e840309 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 1.313536 Sep 23 04:05:38.041471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2725/5358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:36 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:38.379526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:38.382717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:38.397218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:38.398117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:38.399629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:38.402211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:38.404733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:38.407538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:39.008016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:39.017552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:39.026494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:39.027683 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cc6fce70-e86a-469a-85e4-529734747beb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.657559 Sep 23 04:05:39.028613 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2634/5359] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:38 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:39.070586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:39.071712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:39.095316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:39.096614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:39.100535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:39.101678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:39.103208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:39.104107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:39.396282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:39.410744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-111d6d49-8e93-436a-978f-b54172955e0c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.344969 Sep 23 04:05:39.426017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2726/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:39 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:40.059930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:40.062077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:40.077089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:40.084974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:40.086631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:40.087720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:40.088404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:40.089035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:40.434709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:40.435333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:40.472173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:40.472681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:40.473132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:40.474125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:40.474330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:40.474758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:40.474887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:40.505664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:40.509164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:40.515301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97cb9432-9e7b-4cd6-bc34-6ba29c8f753f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1723 microversion: 2.20 time: 0.458202 Sep 23 04:05:40.516647 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2635/5361] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:40 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:40.814490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:40.832891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6dbd4a5-61d4-4fdf-a023-6a6927097ae9 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.402234 Sep 23 04:05:40.844123 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2727/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:40 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:41.545547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:41.547011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:41.555332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:41.556107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:41.556953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:41.557869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:41.558605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:41.559182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:41.588199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:41.694810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:41.711133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:41.715900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:41.720672 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7746a089-3f3d-4b43-b0b8-e35951f4ede5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1655 microversion: 2.20 time: 0.179858 Sep 23 04:05:41.722696 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2636/5363] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:41 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:41.862608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:41.863811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:41.871998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:41.872758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:41.873440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:41.876386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:41.877070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:41.879506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:42.236250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:42.247389 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4453e90f-afeb-423c-b83a-00f6d6510363 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.389742 Sep 23 04:05:42.264379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2728/5364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:41 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:42.752532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:42.753321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:42.774233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:42.777015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:42.777694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:42.781456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:42.782263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:42.783002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:42.946847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9860d-c80e-4fed-ba41-76b76d507172", "name": "network-vif-deleted", "tag": "9094ff3b-2960-4c04-9dd3-da9f5f24f8e8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:42.965778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:42.966582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:42.968516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:42.996327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] Creating event network-vif-deleted:9094ff3b-2960-4c04-9dd3-da9f5f24f8e8 for instance 74f9860d-c80e-4fed-ba41-76b76d507172 on n-h1-858495-2 Sep 23 04:05:43.009329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8034752f-dff7-40c1-9722-eae0904344b8 req-8f3d166b-561f-419e-a926-c2ca10640632 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066572 Sep 23 04:05:43.012792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2729/5365] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:43.017911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:43.026766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:43.033118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:43.034530 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d895403c-6ae7-4f38-9227-d12e186cf15e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 200 len: 1655 microversion: 2.20 time: 0.286638 Sep 23 04:05:43.038752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2637/5366] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:42 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 1655 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:43.277772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:43.279102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:43.292220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:43.294629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:43.295336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:43.298787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:43.299927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:43.300597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:44.068451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:44.068965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:44.096208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:44.096710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:44.097151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:44.097904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:44.098366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:44.098803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:44.129048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:44.137475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:05:44.138716 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a3a85e1f-e273-480c-9eba-c956bdf016c5 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.867723 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 HTTP/1.1 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '74f9860d-c80e-4fed-ba41-76b76d507172'} Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:44.139188 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:05:44.142801 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:44.143267 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2730/5367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:43 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:44.143343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:44.143343 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5f930e59-297f-47ba-8940-76469d7584d5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 404 len: 111 microversion: 2.20 time: 0.076406 Sep 23 04:05:44.151437 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2638/5368] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:44 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:05:44.151595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f3af8dc-84d4-4c93-a6ce-ed539db840a3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '.version_select at 0x7f0c8a485820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:44.177965 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f3af8dc-84d4-4c93-a6ce-ed539db840a3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:05:45.186409 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f3af8dc-84d4-4c93-a6ce-ed539db840a3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51128. Sep 23 04:05:45.225512 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f3af8dc-84d4-4c93-a6ce-ed539db840a3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375994308" status: 204 len: 0 microversion: 2.20 time: 1.079060 Sep 23 04:05:45.226790 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2731/5369] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 23 04:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375994308 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:05:45.238648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:45.240021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:45.255063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:45.255818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:45.256440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:45.257504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:45.260199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:45.263560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:45.344009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: .version_select at 0x7f0c8aa2e310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-607542513", "policies": ["affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:45.382509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.394543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.461336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.468877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.485605 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a203d840-4098-4950-8413-145c4ed02600 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.443468 Sep 23 04:05:45.486818 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2639/5370] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Sep 23 04:05:45 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:05:45.502005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: .version_select at 0x7f0c8a5959d0>, body: {"server_group": {"name": "tempest-server-group-555641838", "policies": ["affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:45.528351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.535056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.590760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.598686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.623432 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-071e841d-c4f0-49cb-a208-54273a6e57ed tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.128850 Sep 23 04:05:45.626048 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2640/5371] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 04:05:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:45.638361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: .version_select at 0x7f0c8a3b4820>, body: {"server_group": {"name": "tempest-server-group-555641838", "policies": ["affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:45.669961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.679123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.735360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:45.746301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:45.755571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:45.772977 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1670402-7e85-42fd-9066-aac2aeedd3e7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.138936 Sep 23 04:05:45.774023 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2641/5372] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 04:05:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:45.789131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a2b8037-d864-4dc4-b9a7-97b82664e124 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:45.838415 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a2b8037-d864-4dc4-b9a7-97b82664e124 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0713b634-9c13-4d80-9046-b3f7977673bb" status: 204 len: 0 microversion: 2.1 time: 0.056124 Sep 23 04:05:45.840186 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2642/5373] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:05:45 2022] DELETE /compute/v2.1/os-server-groups/0713b634-9c13-4d80-9046-b3f7977673bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:45.855072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3d725a2-bd4a-426c-80ac-18643298491e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:45.892733 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3d725a2-bd4a-426c-80ac-18643298491e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.048199 Sep 23 04:05:45.901295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2643/5374] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:05:45 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:05:45.908953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6da1b808-89fa-4433-a94e-5f22c03f4872 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:45.949027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6da1b808-89fa-4433-a94e-5f22c03f4872 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/6472ce55-2cce-479e-9f52-5e9eed12d54f" status: 204 len: 0 microversion: 2.1 time: 0.046031 Sep 23 04:05:45.950229 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2644/5375] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:05:45 2022] DELETE /compute/v2.1/os-server-groups/6472ce55-2cce-479e-9f52-5e9eed12d54f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:45.960321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf803dc9-cb87-4985-a94d-7ff260f182fa tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:45.982049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf803dc9-cb87-4985-a94d-7ff260f182fa tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026626 Sep 23 04:05:45.992732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2645/5376] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:05:45 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:46.000130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: .version_select at 0x7f0c8a38d790>, body: {"server_group": {"name": "tempest-server-group-1675117851", "policies": ["affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:46.024600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:46.032945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:46.093321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:46.107533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:46.140097 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9593c4e-a8c4-46ef-ad06-0e49ce9d6622 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.145949 Sep 23 04:05:46.140727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2646/5377] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 04:05:45 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:46.152498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-feda4c9b-8ebc-4983-9796-648377babe3d tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:46.204450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-feda4c9b-8ebc-4983-9796-648377babe3d tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/450a9cad-d9dc-4e45-ad6a-a37b91cf44d8" status: 204 len: 0 microversion: 2.1 time: 0.055618 Sep 23 04:05:46.206545 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2647/5378] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:05:46 2022] DELETE /compute/v2.1/os-server-groups/450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:46.215079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88cde8a3-8571-48f5-9d57-d30e9f9ddd35 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:46.233776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88cde8a3-8571-48f5-9d57-d30e9f9ddd35 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022900 Sep 23 04:05:46.242463 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2648/5379] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:05:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:05:46.247407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: .version_select at 0x7f0c8a38cc10>, body: {"server_group": {"name": "tempest-server-group-693523126", "policies": ["anti-affinity"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:46.271933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:46.279093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:46.341262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:46.348105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_groups'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:46.369748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dfeaae8c-36b9-4429-8217-9fa19397f665 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.125651 Sep 23 04:05:46.370695 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2649/5380] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Sep 23 04:05:46 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:46.384723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f59707d-a1f0-440c-935f-15c2bb95c19e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:46.425156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f59707d-a1f0-440c-935f-15c2bb95c19e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a4e3fc6d-066e-4861-9df8-54523334a74a" status: 204 len: 0 microversion: 2.1 time: 0.046304 Sep 23 04:05:46.428048 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2650/5381] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:05:46 2022] DELETE /compute/v2.1/os-server-groups/a4e3fc6d-066e-4861-9df8-54523334a74a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:05:46.442198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22a226f7-7609-4224-a40e-731d3b457f26 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:46.473649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:46.477135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22a226f7-7609-4224-a40e-731d3b457f26 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044770 Sep 23 04:05:46.481660 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2651/5382] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:05:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:46.493796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:46.504436 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba9faa9e-015c-42ad-ba5f-12dd94b4a8d7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 1.276067 Sep 23 04:05:46.505243 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2732/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:45 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:46.669336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1542789603", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "ef244e4d-4721-4c14-98ab-58b20a401f06"}]}, "os:scheduler_hints": {"group": "efbf7d06-f9a9-46c6-a809-421c6f706bf4"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:46.801299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] validate_networks() for [('ef244e4d-4721-4c14-98ab-58b20a401f06', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:05:47.530010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:47.531391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:47.542853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:47.544086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:47.546208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:47.553617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:47.554370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:47.558392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:47.624429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:48.504187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:48.520563 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d68d2647-0dab-4e25-bdd2-a9f0c436ffec tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.995790 Sep 23 04:05:48.538185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2733/5384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:47 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:48.551824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ac70841-ea26-40cf-90b8-2b64d2f6209a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: .version_select at 0x7f0c8a8dbca0>, body: {"keypair": {"name": "tempest-keypair-185370387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJuTn3H5b5PKapbgzucwKG57ZTWURlzOkoKmtwLM4Fh44aqw9X2z9cR5vwkcPaGsdJ2PfipvdVN4gmttYZ9xLvm8OX5M/T/LGYbYFtlMghqD32hZy8ezN9YA0zvOjCLWg=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:48.640662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4ac70841-ea26-40cf-90b8-2b64d2f6209a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:48.680454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4ac70841-ea26-40cf-90b8-2b64d2f6209a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for user 0965ea0e7b6b4e1e86d9c7052130478d and project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:48.744788 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ac70841-ea26-40cf-90b8-2b64d2f6209a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.204162 Sep 23 04:05:48.745432 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2734/5385] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 23 04:05:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:05:49.480840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:05:49.481301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:05:49.481851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:05:49.482259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:05:49.482679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:05:49.516537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:49.517037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:49.518376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:49.519141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:49.519612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:49.526245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:49.560796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:49.563084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:49.573333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:49.575382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:49.582762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:49.583548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:49.585527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:49.586513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:49.587591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:49.589448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:49.592470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:49.604382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:05:49.607083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:05:49.701201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:49.711915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:49.809298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:49.834114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Getting quotas for user b6e235ff59ed4e628fcd6eeb650c909d and project 0507d1f1629444bb8966f7a1eb8b75ce. Resources: {'server_group_members'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:49.901478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d95317e8-7baa-458a-9ede-95a82d80595f tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.236678 Sep 23 04:05:49.910620 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2652/5386] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:05:49.916740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fa1e29a-b6af-40d8-b130-706c23aff7ff tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:49.917771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5fa1e29a-b6af-40d8-b130-706c23aff7ff tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:50.159998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fa1e29a-b6af-40d8-b130-706c23aff7ff tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:50.169390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fa1e29a-b6af-40d8-b130-706c23aff7ff tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1213 microversion: 2.1 time: 0.257158 Sep 23 04:05:50.169995 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2653/5387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:49 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:50.348992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:50.360539 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e5ae9c26-6f98-49fe-aabe-a6d057727dc4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1501 microversion: 2.1 time: 0.803051 Sep 23 04:05:50.361141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2735/5388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:49 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1501 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:50.387680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3afdad4-1f19-48be-89dc-63b3a40505ef"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:50.391253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:50.404823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.406062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.409305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:50.410332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.429900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.443171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:50.521231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Cannot 'attach_volume' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state rescued Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/os-volume_attachments HTTP/1.1 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 74 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: {"volumeAttachment": {"volumeId": "a3afdad4-1f19-48be-89dc-63b3a40505ef"}} Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'attach_volume' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state rescued Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '292f8268-420f-4775-9d18-d8c6f3e41a3a', 'body': {'volumeAttachment': {'volumeId': 'a3afdad4-1f19-48be-89dc-63b3a40505ef'}}} Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 04:05:50.524171 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state rescued Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state rescued Sep 23 04:05:50.527620 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:05:50.533628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 409 to user: Cannot 'attach_volume' instance 292f8268-420f-4775-9d18-d8c6f3e41a3a while it is in vm_state rescued {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:05:50.539705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7df0411-4686-4ad5-9e1f-a700ec8d550d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.153839 Sep 23 04:05:50.541663 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2654/5389] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:05:50 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/os-volume_attachments => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:05:50.558825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:50.559513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:50.573716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.580051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.581330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:50.583961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.588637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.589343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:50.814775 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f06b0c16-7312-4a78-a311-71cf65e9e333 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.265716 Sep 23 04:05:50.823743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:50.824577 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2736/5390] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:05:50 2022] POST /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:05:50.824832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:50.839804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.859355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.874492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:50.875578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:50.876231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:50.876689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:51.206151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:51.207247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:51.215052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:51.216058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:51.221542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:51.222710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:51.224151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:51.224805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:51.450156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:51.481463 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c7717d3-d39b-43be-b935-85c59f49736a tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1217 microversion: 2.1 time: 0.288031 Sep 23 04:05:51.482816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2737/5391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:51 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:51.713074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-130004131", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "474c3e0a-9069-4379-9e43-e3c990d5e5d7"}], "security_groups": [{"name": "tempest-securitygroup--591981788"}], "key_name": "tempest-keypair-185370387", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:52.027365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:52.041323 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce4ff765-b40b-49ed-a13a-21b91c1f7361 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1509 microversion: 2.1 time: 1.218968 Sep 23 04:05:52.059678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2655/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:50 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1509 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:52.510930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:52.511700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:52.522016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:52.530426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:52.531620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:52.532827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:52.541536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:52.542214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:52.929312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:52.939861 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-547d66a0-e92c-4b6e-abb9-afb7c704647c tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1271 microversion: 2.1 time: 0.434752 Sep 23 04:05:52.940880 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2656/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:52 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1271 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:52.983979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] validate_networks() for [('474c3e0a-9069-4379-9e43-e3c990d5e5d7', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:05:53.067240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:53.068695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:53.079002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:53.084586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:53.085307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:53.086293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:53.087270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:53.087976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:54.572793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:54.593158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea64c1ce-dea5-4622-ac29-514c79b6bc7e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1509 microversion: 2.1 time: 1.529275 Sep 23 04:05:54.595868 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2657/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:53 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1509 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:54.603926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:54.604948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:54.613046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:54.613878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:54.614502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:54.615722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:54.616658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:54.618019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:55.364161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:55.376389 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91e7ad7c-430e-4584-87e3-661447308d3e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 0.778492 Sep 23 04:05:55.402287 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2658/5395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:54 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:55.428371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:05:55.428875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:05:55.429324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:05:55.430272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:05:55.430745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:05:55.444083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:55.444791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:55.445478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:55.446343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:55.447033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:55.447917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:55.484688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:05:55.495244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Getting quotas for user 0965ea0e7b6b4e1e86d9c7052130478d and project 689c81796d7a49e08c92dde8fb2a5082. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:05:55.522256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:05:55.525972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:05:55.608605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b9dcedf-888a-4462-9239-d215e8b91c6b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.901923 Sep 23 04:05:55.610684 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2738/5396] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 04:05:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 3905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:05:55.625142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:55.627068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:55.640160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:55.640781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:55.646867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:55.647554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:55.648276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:55.649155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:55.649880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:55.650575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:55.764913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:55.775008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:55.786577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:55.788953 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e726457c-c2f2-4fb2-ba0c-bf6a8c36126c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1280 microversion: 2.20 time: 0.171245 Sep 23 04:05:55.791889 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2659/5397] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:55 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:56.084596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:56.095714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-710c7dbb-08a8-438d-85ff-382e4d59a601 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1509 microversion: 2.1 time: 0.461437 Sep 23 04:05:56.116234 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2739/5398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:55 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:56.406443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:56.407091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:56.419025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:56.419519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:56.422402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:56.425106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:56.426727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:56.430371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:56.447962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf2adfa-5d49-4432-a54b-254e77091afe", "tag": "19f78b17-c033-410a-bbb8-a64b52cf0787"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:05:56.476697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:56.477213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:56.477668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:56.526429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] Creating event network-changed:19f78b17-c033-410a-bbb8-a64b52cf0787 for instance 5cf2adfa-5d49-4432-a54b-254e77091afe on n-h1-858495-2 Sep 23 04:05:56.533418 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c7e4b975-77c6-4ea1-b87e-8363d2fb4250 req-b4aee8c3-70ae-4662-a9cc-129c4fa337eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089058 Sep 23 04:05:56.534625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2740/5399] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:05:56.824861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:56.828548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:56.856543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:56.859164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:56.859841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:56.861952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:56.863882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:56.871857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:56.903920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:56.932158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84961c76-f526-4edf-b5c5-01216c46c3f8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 0.529756 Sep 23 04:05:56.934044 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2660/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:56 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:57.126394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:57.127288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:57.147684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:57.148470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:57.149541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:57.150453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:57.151968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:57.156869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:57.495409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:57.504279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:57.510811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:57.512203 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9d0b9e5-e4c6-4fab-9b17-720eeb484003 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1284 microversion: 2.20 time: 0.694186 Sep 23 04:05:57.516747 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2741/5401] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:56 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1284 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:05:57.974276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:57.974943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:58.003390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:58.003909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:58.004344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:58.005088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:58.005602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:58.006037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:58.089024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:58.112148 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9047f6cd-edbd-4019-bc81-4ec0493ae96f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1509 microversion: 2.1 time: 0.994540 Sep 23 04:05:58.129747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2661/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:57 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1509 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:58.545561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:58.546423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:58.566808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:58.570694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:58.570694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:58.572306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:58.577722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:58.578286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:58.664053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:58.706074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2da96dcb-b2f7-43e6-bc96-87f54704678e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 0.745540 Sep 23 04:05:58.708097 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2742/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:57 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:05:58.829289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:58.839183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:58.840627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:58.842347 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5cee767-9f23-4259-9534-a11d99c6e6f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1340 microversion: 2.20 time: 0.300927 Sep 23 04:05:58.843134 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2662/5404] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:58 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1340 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:05:59.141223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:59.142386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:59.168686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.169101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.170204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:59.172742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.173510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.174362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:59.736334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:59.736960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:59.739347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:05:59.758707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.759239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.761842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:59.762783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.763478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.764865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:59.871314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:05:59.891657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbca2ffa-5037-499a-9409-43e498dac015 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1515 microversion: 2.1 time: 0.757393 Sep 23 04:05:59.894523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2743/5405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:59 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1515 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:05:59.907370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:05:59.937496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:05:59.968546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.969063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.969580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:05:59.974857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:05:59.978183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:05:59.979766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:00.781912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:00.806000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:00.808766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:00.815446 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7933e145-841b-4cf9-8abc-4b47e0529db6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1338 microversion: 2.20 time: 0.919495 Sep 23 04:06:00.820238 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2744/5406] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:05:59 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1338 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:00.987569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:00.999065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d72d420e-e768-4cfa-820e-378262f7e074 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 1.268612 Sep 23 04:06:01.002591 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2663/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:05:59 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:06:01.853276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:01.856202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:01.874537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:01.877002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:01.878742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:01.880706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:01.882631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:01.884259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:02.014120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:02.026611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:02.027223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:02.037810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:02.039260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:02.040384 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8c5c75f-cf01-4926-8c76-fef9dfc1a690 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1338 microversion: 2.20 time: 0.191458 Sep 23 04:06:02.040999 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2745/5408] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:01 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:02.043719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:02.044212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:02.044720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:02.045968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:02.046428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:02.046860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:02.523442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:02.557204 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-435f8d09-ac91-437d-98d3-86d75a29e8a1 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 0.534340 Sep 23 04:06:02.560476 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2664/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:02 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:06:02.759250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd51dd30-8913-42be-a35f-79e00c0c5050 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: .version_select at 0x7f0c8aa701f0>, body: {"keypair": {"name": "tempest-keypair-292213742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd6nR0DwYv80RZL0CKl4NtBPFbLCaYLovjuN62sshLGO/Vj93qb9kzhOQNq1kQeOI7TvvUoEONHKIA7JU9brrBUzp86uTMXMOEsYJhMRzj3luaPAR4DTHNPCbw7HSXbHw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:02.795986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cd51dd30-8913-42be-a35f-79e00c0c5050 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for project ca6518d2053a41bfb4559e063928f91c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:06:02.813202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-cd51dd30-8913-42be-a35f-79e00c0c5050 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for user 6f00c88acca24c0fa6497dba45552fc9 and project ca6518d2053a41bfb4559e063928f91c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:06:02.860065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd51dd30-8913-42be-a35f-79e00c0c5050 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104964 Sep 23 04:06:02.862876 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2746/5410] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:06:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:02.930800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2adfa-5d49-4432-a54b-254e77091afe", "name": "network-vif-plugged", "status": "completed", "tag": "19f78b17-c033-410a-bbb8-a64b52cf0787"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:02.947965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:02.948635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:02.949214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:02.970858 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] Creating event network-vif-plugged:19f78b17-c033-410a-bbb8-a64b52cf0787 for instance 5cf2adfa-5d49-4432-a54b-254e77091afe on n-h1-858495-2 Sep 23 04:06:02.977642 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-33c57057-5d9d-4b7a-bce2-daf9e565f67c req-001a2fa6-4915-4e01-832d-b6b359502689 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052486 Sep 23 04:06:02.979771 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2665/5411] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:06:03.066950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:03.067655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:03.075531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:03.076154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:03.085793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:03.086680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:03.087241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:03.087748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:03.587660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:03.588536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:03.605997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:03.606791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:03.609147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:03.610256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:03.610919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:03.612026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:03.847016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:03.866974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:03.870356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:03.872125 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7ab3557-881a-481c-bb07-bada50b506a4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.809934 Sep 23 04:06:03.876492 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2747/5412] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:03 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:04.167959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:04.201508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5533e62b-4f0e-40e3-ad7d-c13217c4cfac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1313 microversion: 2.1 time: 0.605532 Sep 23 04:06:04.202563 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2666/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:03 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:04.849744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:04.878872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:04.881872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:04.887542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:04.936913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:04.938346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:04.955785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:04.956628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:04.957470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:04.958844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:04.959818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:04.960799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:04.982777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] Creating event network-changed:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h2-858495-2 Sep 23 04:06:04.997172 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-47b13882-1a5a-402b-96bd-d654d8c0fcb2 req-dc5c5a94-2719-48ad-9385-c44c3088f90f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151476 Sep 23 04:06:05.016543 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2748/5414] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:05.227828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:05.228651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:05.239242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:05.239755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:05.240224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:05.243801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:05.244300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:05.246420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:05.399654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:05.408421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:05.416848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:05.418610 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97c3e134-dd6e-4b1e-b3a3-3dcef4796d98 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.521889 Sep 23 04:06:05.419952 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2667/5415] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:04 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:06:05.474033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:05.717535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:05.748425 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ab70ff4-b562-4179-88fd-1f8faf6aa908 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1497 microversion: 2.1 time: 0.522575 Sep 23 04:06:05.749737 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2749/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:05 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1497 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:06:05.775445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:05.786272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=58 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:05.798039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_groups [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Querying cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) for 1 instances {{(pid=128723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:06:05.799395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:05.800531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:05.806101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:05.835462 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d06dce2-0f3d-441f-bd50-15987715a3f0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4" status: 200 len: 221 microversion: 2.1 time: 0.067017 Sep 23 04:06:05.836630 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2668/5417] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 04:06:05 2022] GET /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4 => generated 221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:05.853199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:05.853942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:05.862269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:05.864283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:05.864884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:05.865764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:05.866629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:05.868299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:05.909959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:06:06.021161 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-32311851-49b2-4dfd-9ea4-98d578c3151e tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 204 len: 0 microversion: 2.1 time: 0.176533 Sep 23 04:06:06.026854 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2750/5418] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:06:05 2022] DELETE /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:06:06.035980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:06.036606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:06.071837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:06.072516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:06.073691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:06.074585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:06.075760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:06.076647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:06.430331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:06.442231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b6c53b9-07ca-470d-a5cc-9407744e92b0 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1503 microversion: 2.1 time: 0.409675 Sep 23 04:06:06.463365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:06.464440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:06.471073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2669/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:06 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:06.477315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:06.478169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:06.478826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:06.479753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:06.480430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:06.481199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:06.505096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:06.794271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:06.811414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:06.813247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:06.814081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7015ddd-842e-437e-8070-e887451f32f0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.359185 Sep 23 04:06:06.814655 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2751/5420] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:06 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:07.471490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:07.472851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:07.483096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:07.483771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:07.484395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:07.485259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:07.485915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:07.490166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:07.510528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-798778605", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a9249ac-d298-4349-b85e-7c8f5cabc93d"}], "security_groups": [{"name": "tempest-securitygroup--1770364888"}], "key_name": "tempest-keypair-292213742", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:07.520300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:07.686368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] validate_networks() for [('8a9249ac-d298-4349-b85e-7c8f5cabc93d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:06:07.779163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:07.796301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a91f2bb-be4c-46f7-8488-3e5dbcab79ac tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1503 microversion: 2.1 time: 0.331910 Sep 23 04:06:07.797281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2670/5421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:07 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:06:07.841786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:07.842593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:07.853863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:07.854366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:07.854809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:07.855722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:07.856355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:07.857979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:08.096789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:08.112036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:08.114130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:08.115372 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b069ef09-2b12-4186-b788-40e037de8141 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.279320 Sep 23 04:06:08.130686 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2671/5422] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:07 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:06:08.336029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:06:08.337083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:06:08.337713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:06:08.339654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:06:08.342214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:06:08.378419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:08.379712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:08.381237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:08.382626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:08.383421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:08.384622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:08.424087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:06:08.432540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Getting quotas for user 6f00c88acca24c0fa6497dba45552fc9 and project ca6518d2053a41bfb4559e063928f91c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:06:08.460605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:06:08.464452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:06:08.537062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4b79e24-3c18-467a-a166-f284dcd267fe tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.030398 Sep 23 04:06:08.545473 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2752/5423] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:06:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:06:08.550693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1eed00c1-658b-4848-a340-fa7f01b75d70 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:08.551397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1eed00c1-658b-4848-a340-fa7f01b75d70 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:08.794069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf2adfa-5d49-4432-a54b-254e77091afe", "name": "network-vif-deleted", "tag": "19f78b17-c033-410a-bbb8-a64b52cf0787"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:08.818960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:08.820033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:08.820939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:08.841291 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] Creating event network-vif-deleted:19f78b17-c033-410a-bbb8-a64b52cf0787 for instance 5cf2adfa-5d49-4432-a54b-254e77091afe on n-h1-858495-2 Sep 23 04:06:08.851370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-208b7c97-61c6-42f2-9e8a-e9150f3c8427 req-05434121-02ec-417e-8dd6-ba2d51df4d4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061781 Sep 23 04:06:08.854038 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2753/5424] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:08.864189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:08.873663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:08.889676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:08.891877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:08.892763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:08.893753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:08.894395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:08.894975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:09.225938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1eed00c1-658b-4848-a340-fa7f01b75d70 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:09.236507 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1eed00c1-658b-4848-a340-fa7f01b75d70 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1244 microversion: 2.1 time: 0.690451 Sep 23 04:06:09.237452 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2672/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:08 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1244 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:06:09.242274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:09.242887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:09.261944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:09.262449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:09.262897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:09.263652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:09.264119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:09.264553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:09.333322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e235ff59ed4e628fcd6eeb650c909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d1f1629444bb8966f7a1eb8b75ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:09.348389 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b9d7f65-cacd-4bf8-bcb1-d46a246b59b4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 200 len: 1298 microversion: 2.1 time: 0.491341 Sep 23 04:06:09.349870 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2754/5426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:08 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 1298 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:09.922306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:09.941482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:09.959011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:09.965697 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-469588b3-658a-4142-9e9d-5ff42b8fecd6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.724799 Sep 23 04:06:09.967588 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2673/5427] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:09 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:10.259971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:10.261313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:10.282062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:10.285436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:10.286189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:10.287189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:10.290388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:10.293178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:10.372715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:10.373895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:10.382728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:10.384418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:10.388335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:10.389437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:10.390092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:10.390721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:10.482483 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe HTTP/1.1 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '5cf2adfa-5d49-4432-a54b-254e77091afe'} Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:10.485919 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:10.491653 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:10.492647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:10.493007 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4cf0bbf-bd19-47bd-818a-5e518aa38ddd tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 404 len: 111 microversion: 2.1 time: 0.124449 Sep 23 04:06:10.495077 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2674/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:10 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:06:10.527321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:10.565568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_groups [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Querying cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) for 1 instances {{(pid=128723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:06:10.567552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:10.568044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:10.568482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:10.701468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:10.717620 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7497af3b-fc3e-4fd9-afde-bbbdf9f8e57f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1304 microversion: 2.1 time: 0.462003 Sep 23 04:06:10.719961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2755/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:10 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1304 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:10.993149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:10.994840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:11.013550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.019772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.020239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.021007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.021494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.021933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.055006 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2505a3b4-ed9e-47ef-aeee-af8a5f9cfba4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.542282 Sep 23 04:06:11.056335 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2675/5430] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Sep 23 04:06:10 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:11.070769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.080726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:11.096112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.compute.server_groups [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Querying cell 7f22f53f-b9cc-4e97-a884-e2597a729053(cell1) for 1 instances {{(pid=128723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:06:11.096831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.097297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.097810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.110028 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd549728-5186-4c91-90a1-71be33592046 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4" status: 200 len: 183 microversion: 2.1 time: 0.045038 Sep 23 04:06:11.110886 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2676/5431] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 04:06:11 2022] GET /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4 => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:06:11.124493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.128443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:11.140366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.142099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.144811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.145787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.146825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.147441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.176216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe HTTP/1.1 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '5cf2adfa-5d49-4432-a54b-254e77091afe'} Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:06:11.178857 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.182325 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.185955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.187749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36ad7f1a-9c8e-4443-b6dd-5932e8556fc7 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 404 len: 111 microversion: 2.1 time: 0.069121 Sep 23 04:06:11.188815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2677/5432] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:06:11.198662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.199533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] [instance: 5cf2adfa-5d49-4432-a54b-254e77091afe] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:11.210519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.211213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.211860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.213191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.213883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.215001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.235004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe HTTP/1.1 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '5cf2adfa-5d49-4432-a54b-254e77091afe'} Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.238548 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. Sep 23 04:06:11.242345 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.244237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance 5cf2adfa-5d49-4432-a54b-254e77091afe could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.245131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-70066402-111f-485b-bba2-ab24a823a815 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe" status: 404 len: 111 microversion: 2.1 time: 0.052649 Sep 23 04:06:11.246298 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2678/5433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:11 2022] GET /compute/v2.1/servers/5cf2adfa-5d49-4432-a54b-254e77091afe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:06:11.256126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308fd2c7-ed03-497d-90af-02daddf964a4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.265528 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-308fd2c7-ed03-497d-90af-02daddf964a4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308fd2c7-ed03-497d-90af-02daddf964a4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-server-groups/a4e3fc6d-066e-4861-9df8-54523334a74a HTTP/1.1 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'a4e3fc6d-066e-4861-9df8-54523334a74a'} Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.267575 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. Sep 23 04:06:11.272514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.274829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-308fd2c7-ed03-497d-90af-02daddf964a4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance group a4e3fc6d-066e-4861-9df8-54523334a74a could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.276062 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-308fd2c7-ed03-497d-90af-02daddf964a4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a4e3fc6d-066e-4861-9df8-54523334a74a" status: 404 len: 117 microversion: 2.1 time: 0.025432 Sep 23 04:06:11.277196 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2679/5434] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/os-server-groups/a4e3fc6d-066e-4861-9df8-54523334a74a => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:06:11.286261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4180873c-fd89-4554-89d5-306078539490 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.293951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-4180873c-fd89-4554-89d5-306078539490 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4180873c-fd89-4554-89d5-306078539490 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-server-groups/450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 HTTP/1.1 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '450a9cad-d9dc-4e45-ad6a-a37b91cf44d8'} Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.296374 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. Sep 23 04:06:11.300777 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.302084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4180873c-fd89-4554-89d5-306078539490 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance group 450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.303183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4180873c-fd89-4554-89d5-306078539490 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/450a9cad-d9dc-4e45-ad6a-a37b91cf44d8" status: 404 len: 117 microversion: 2.1 time: 0.021276 Sep 23 04:06:11.304504 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2680/5435] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/os-server-groups/450a9cad-d9dc-4e45-ad6a-a37b91cf44d8 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:06:11.316067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40638c04-12ba-4a8b-bf30-b1afef1a0754 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.323477 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-40638c04-12ba-4a8b-bf30-b1afef1a0754 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40638c04-12ba-4a8b-bf30-b1afef1a0754 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-server-groups/6472ce55-2cce-479e-9f52-5e9eed12d54f HTTP/1.1 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6472ce55-2cce-479e-9f52-5e9eed12d54f'} Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.325643 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. Sep 23 04:06:11.328964 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.330568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40638c04-12ba-4a8b-bf30-b1afef1a0754 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance group 6472ce55-2cce-479e-9f52-5e9eed12d54f could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.331453 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40638c04-12ba-4a8b-bf30-b1afef1a0754 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/6472ce55-2cce-479e-9f52-5e9eed12d54f" status: 404 len: 117 microversion: 2.1 time: 0.022852 Sep 23 04:06:11.332088 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2681/5436] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/os-server-groups/6472ce55-2cce-479e-9f52-5e9eed12d54f => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:06:11.342815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7929afaf-daa9-491a-b3fd-0c5d7651a5c8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.357569 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-7929afaf-daa9-491a-b3fd-0c5d7651a5c8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] HTTP exception thrown: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7929afaf-daa9-491a-b3fd-0c5d7651a5c8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Request method failure captured: Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/os-server-groups/0713b634-9c13-4d80-9046-b3f7977673bb HTTP/1.1 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTCYUHZPZaonkECtEg0cWxWOaUWsCDl_mGsTQFHAIC3epyVurw0hQ2m1pNE9QHAHnvhvAuRmNXf_tD772ev0ZxlIigYSYUY_mxY8fUYZYsti6Ik5ruryy36wvwuvUvm5W3tgKoSXVWAPzu-PxQQJxr4a_F7xfYKLuRufjctfn-adDUw Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0507d1f1629444bb8966f7a1eb8b75ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0507d1f1629444bb8966f7a1eb8b75ce Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerGroupTestJSON-213906724 Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: b6e235ff59ed4e628fcd6eeb650c909d Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerGroupTestJSON-213906724-project Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '0713b634-9c13-4d80-9046-b3f7977673bb'} Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.359437 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7929afaf-daa9-491a-b3fd-0c5d7651a5c8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Returning 404 to user: Instance group 0713b634-9c13-4d80-9046-b3f7977673bb could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:06:11.363607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7929afaf-daa9-491a-b3fd-0c5d7651a5c8 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0713b634-9c13-4d80-9046-b3f7977673bb" status: 404 len: 117 microversion: 2.1 time: 0.023859 Sep 23 04:06:11.364980 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2682/5437] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/os-server-groups/0713b634-9c13-4d80-9046-b3f7977673bb => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:06:11.371108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e9908b2d-f160-4aa4-b2b5-882499d70ce4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.417910 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e9908b2d-f160-4aa4-b2b5-882499d70ce4 tempest-ServerGroupTestJSON-213906724 tempest-ServerGroupTestJSON-213906724-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4" status: 204 len: 0 microversion: 2.1 time: 0.051676 Sep 23 04:06:11.418607 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2683/5438] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Sep 23 04:06:11 2022] DELETE /compute/v2.1/os-server-groups/efbf7d06-f9a9-46c6-a809-421c6f706bf4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:06:11.528885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:11.537092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:11.538592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:11.539955 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8b7e9f5-eb3c-46df-8f08-dff793cb4806 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.551706 Sep 23 04:06:11.541064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2756/5439] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:10 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:06:11.744545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:11.745464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:11.754370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.755157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.755764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.756650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:11.757288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:11.757910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:11.987909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:11.998495 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49f13dd0-418c-4417-a383-0b461d72998f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1302 microversion: 2.1 time: 0.257983 Sep 23 04:06:11.999765 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2684/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:11 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:12.087444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "name": "network-vif-plugged", "status": "completed", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:12.114281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:12.116328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:12.117538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:12.146435 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] Creating event network-vif-plugged:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h2-858495-2 Sep 23 04:06:12.156313 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1d8c5cd8-6509-4179-beed-82ee8a7de76f req-a2913235-620e-4644-a98b-64f8d9aae7b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075426 Sep 23 04:06:12.161644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2757/5441] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:12.567520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:12.568143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:12.576143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:12.576727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:12.577083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:12.577831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:12.578413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:12.578727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:13.024450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:13.026597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:13.039498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:13.058852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:13.061418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:13.064082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:13.064829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:13.067235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:13.128925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:13.162446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:13.166881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:13.168307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35bd5df0-21fc-42ea-833d-b3837882363f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.604831 Sep 23 04:06:13.172877 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2685/5442] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:12 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:13.550795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:13.560638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbdc8c35-f704-4c62-a2a3-f85d57c0bef2 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.540911 Sep 23 04:06:13.561458 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2758/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:13 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:14.198748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:14.200409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:14.210684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:14.211752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:14.212430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:14.214165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:14.214916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:14.215603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:14.585178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:14.586603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:14.596030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:14.596791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:14.597698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:14.598625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:14.599192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:14.599724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:14.927812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:14.940324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:14.942122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:14.948802 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4dab1578-25b5-430b-b6bf-9916d481254f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1405 microversion: 2.20 time: 0.754353 Sep 23 04:06:14.949413 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2686/5444] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:14 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1405 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:14.984040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:15.019080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:15.021002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:15.021642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:15.038586 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] Creating event network-changed:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:06:15.047193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8a4e3827-c021-4d2f-9c18-4165ee39fda9 req-211f17df-51eb-47ec-88f9-60e713529615 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074023 Sep 23 04:06:15.048840 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2687/5445] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:15.196366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:15.211116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09c20752-d61f-4201-be5e-ce505a4e1337 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.630660 Sep 23 04:06:15.225379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2759/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:14 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:15.982573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:15.983296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:15.993217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:15.994595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:15.995387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:15.996331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:15.996974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:15.997704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:16.249256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:16.253004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:16.266012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:16.271257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:16.271934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:16.273057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:16.273751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:16.280054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:16.487345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:16.497713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:16.499372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:16.500897 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5a81e6f-6cb9-46a8-942f-d4215507f33a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1597 microversion: 2.20 time: 0.527124 Sep 23 04:06:16.501566 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2688/5447] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:15 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1597 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:16.526246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:16.526749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:16.534125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:16.534666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:16.535112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:16.536025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:16.536639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:16.537261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:16.750973 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc5b9a6d-c780-4e00-89a1-0c0e0e86e210 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.228700 Sep 23 04:06:16.752812 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2689/5448] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 23 04:06:16 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:06:16.937463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:16.948219 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e9bac8c-f45f-4a72-9cb8-7711f7da0da7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.710782 Sep 23 04:06:16.961553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2760/5449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:16 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:17.978159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:17.979835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:17.987786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:17.988569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:17.989178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:17.990084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:17.990703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:17.991563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:18.453379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:18.468367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43a9e327-d845-41b6-bc5d-bf2187ed18ba tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.498280 Sep 23 04:06:18.469433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2690/5450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:17 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:18.973176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:18.985452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:18.987551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=20 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:18.991728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:19.017415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:19.021768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:19.024246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:19.059272 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] Creating event network-changed:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h2-858495-2 Sep 23 04:06:19.076330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-986e7104-62f4-4e16-bbb5-3dfc3d3966b4 req-7ec9c488-70c9-4359-9b67-84d7ea3f4174 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106354 Sep 23 04:06:19.078180 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2761/5451] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:19.494409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:19.495024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:19.499491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:19.508377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:19.512141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:19.513451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:19.518347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:19.519036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:19.522284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:20.217176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:20.235044 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcd79e1c-249c-4e00-904a-65b50afcd2f6 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.746115 Sep 23 04:06:20.235651 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2691/5452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:19 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:21.265655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:21.269042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:21.309131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:21.311932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:21.314215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:21.315168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:21.316351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:21.317011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:21.422411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "name": "network-vif-plugged", "status": "completed", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:21.433824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:21.434598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:21.435229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:21.450903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] Creating event network-vif-plugged:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:06:21.457809 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-998d2063-3b2f-4626-80fc-a3ee6ecc5577 req-6ea01dd2-b47b-47db-acb7-91e9471fe3ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040086 Sep 23 04:06:21.459274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2692/5453] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:06:22.177952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:22.195620 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e36c7b2-5e3d-40b0-8ac5-aa42c47efd6e tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1370 microversion: 2.1 time: 0.938856 Sep 23 04:06:22.203849 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2762/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:21 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1370 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:23.240393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:23.245175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:23.268083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:23.268734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:23.269316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:23.271404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:23.272128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:23.273975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:23.532967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:23.547778 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-598975a3-ebaf-40a4-ab1e-ca5711bc1218 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1564 microversion: 2.1 time: 0.319018 Sep 23 04:06:23.548840 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2693/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:06:23 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1564 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:06:23.573117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:23.574526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:23.584068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:23.584931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:23.585665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:23.586825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:23.587427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:23.588052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:23.723664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4307d3e0-dfbc-4bb5-bf53-9bf713e78223 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155461 Sep 23 04:06:23.724849 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2763/5456] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:06:23 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:06:25.271105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1218869573", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:25.359335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:06:25.359770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:06:25.360259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:06:25.360679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:06:25.361102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:06:25.384679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:25.385231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:25.386535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:25.387523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:25.389990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:25.390603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:25.422869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Getting quotas for project a1b1f27345e54b8b9e56d4d677f059e7. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:06:25.453933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Getting quotas for user 1323136bf71840f38176a59a31d7e60e and project a1b1f27345e54b8b9e56d4d677f059e7. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:06:25.488141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:25.491404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:06:25.494031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:06:25.505005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:25.505666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:25.506350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:25.530735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] Creating event network-changed:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:06:25.537821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c4e44c00-0f60-499e-910c-aec332b045e8 req-6e9db632-d72c-44fa-a05e-4c4824a720d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056054 Sep 23 04:06:25.543438 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2764/5457] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:06:25.587369 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26ccc1ae-3c65-4f38-859b-cad9a42b6281 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.513837 Sep 23 04:06:25.588672 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2694/5458] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 04:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:06:25.601693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:25.602400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:25.737674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:25.746754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:25.748285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:25.749499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9fe5086b-5978-4776-8c4f-e58cf7006bd3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca" status: 200 len: 1278 microversion: 2.47 time: 0.152310 Sep 23 04:06:25.757789 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2765/5459] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:25 2022] GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:25.847747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1027097446", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": "none"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:25.913064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:06:25.914326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:06:25.914813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:06:25.915729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:06:25.916326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:06:25.930204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:25.931217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:25.931815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:25.932724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:25.933433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:25.934553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:25.961324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Getting quotas for project a1b1f27345e54b8b9e56d4d677f059e7. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:06:25.972182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Getting quotas for user 1323136bf71840f38176a59a31d7e60e and project a1b1f27345e54b8b9e56d4d677f059e7. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:06:25.986475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:06:25.988921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:06:26.050715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c351093-55d2-4cd7-b227-5e3a2bba257f tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.207455 Sep 23 04:06:26.052216 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2695/5460] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 23 04:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:06:26.063904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f33a3df-d031-4b15-a2f3-68f371805a96 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:26.066520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f33a3df-d031-4b15-a2f3-68f371805a96 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:26.155233 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f33a3df-d031-4b15-a2f3-68f371805a96 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "PUT /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 992 microversion: 2.47 time: 0.095144 Sep 23 04:06:26.164650 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2766/5461] 10.222.0.25 () {62 vars in 1297 bytes} [Fri Sep 23 04:06:26 2022] PUT /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 992 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:06:26.181779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:26.184244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:26.266968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:26.279788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:26.285253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:26.288750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0748a7f-3a40-440e-98a2-ec6e176ace5d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1278 microversion: 2.47 time: 0.113837 Sep 23 04:06:26.298624 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2696/5462] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:26 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:27.320223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:27.321016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:27.338107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:27.339489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:27.341703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:27.343662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:27.349714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:27.353693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:27.755677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:27.770032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:27.771923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:27.773310 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e88f0466-2a04-4a3e-8ac9-f72824cfd959 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1330 microversion: 2.47 time: 0.459188 Sep 23 04:06:27.776557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2767/5463] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:27 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1330 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:28.815204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:28.815835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:28.833702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:28.834218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:28.837175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:28.837980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:28.838467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:28.839935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:29.095627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:29.106347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:29.110934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:29.119435 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-78e7e9ed-12bc-428b-90b2-0810d86ef7d9 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1338 microversion: 2.47 time: 0.311342 Sep 23 04:06:29.122005 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2697/5464] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:28 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1338 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:30.161168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:30.162664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:30.171730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:30.173022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:30.173650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:30.175121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:30.175852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:30.178220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:30.289524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:30.298369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:30.299810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:30.300933 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3331f691-84d2-4c75-969f-5245d682f26c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1336 microversion: 2.47 time: 0.144049 Sep 23 04:06:30.301736 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2768/5465] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:30 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:31.328289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:31.328990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:31.348973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:31.349744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:31.350374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:31.351245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:31.351860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:31.352445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:31.471178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:31.480027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:31.482115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:31.483272 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7781b20c-a391-4eb6-ae74-f2ff624aff0e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1336 microversion: 2.47 time: 0.158994 Sep 23 04:06:31.491109 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2698/5466] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:31 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:32.520886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:32.523667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:32.542883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:32.553975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:32.554659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:32.561179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:32.562461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:32.563021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:32.719063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:32.741256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:32.743428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:32.745159 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b310bef8-ad9c-476c-85c2-9facba3ef7b3 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1357 microversion: 2.47 time: 0.230475 Sep 23 04:06:32.746310 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2769/5467] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:32 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:32.786989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:06:32.798483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:32.821485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:32.822179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:32.823386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:32.824354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:32.825875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:32.827088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:32.951401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:06:32.952080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:06:32.952727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:06:32.953397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:06:32.953976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:06:32.986889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:33.045591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:33.059967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:33.060147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:33.061080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:33.061906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:33.062592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:33.063748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:33.123039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0153f184-61c1-4880-b698-62a62a552e33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "POST /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef/action" status: 202 len: 1079 microversion: 2.47 time: 0.344563 Sep 23 04:06:33.140540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2699/5468] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 04:06:32 2022] POST /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef/action => generated 1079 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:06:33.149862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:33.150494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:33.163468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:33.166295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:33.167479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:33.168448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:33.170160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:33.171476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:33.311147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:33.324036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:33.327862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:33.329473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f35bbc7b-66b0-4827-9ae2-476a1501196e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.185331 Sep 23 04:06:33.330185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2770/5469] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:33 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:06:34.373181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:34.375739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:34.396839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:34.399744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:34.400430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:34.405850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:34.407715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:34.408289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:34.631147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:34.644991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:34.651176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:34.654600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-703e66eb-efbd-43c3-a114-52fea6b88ef8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.302052 Sep 23 04:06:34.682327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2700/5470] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:34 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:35.695909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:35.697111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:35.705546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:35.711686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:35.712293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:35.713926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:35.715302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:35.718176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:35.746619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:35.916316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:35.929636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:35.934771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:35.936054 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea7bddda-e418-4cac-b6ba-be2d183e51a8 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.252702 Sep 23 04:06:35.936671 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2771/5471] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:35 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:36.966556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:36.967242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:36.973943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:36.978263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:36.985242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:36.986276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:36.987035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:36.988129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:36.989223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:36.989967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:37.098962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:37.118070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:37.121766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:37.125179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-abdc14b5-4e6a-4a2d-8939-07ee4fc2cb56 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.164911 Sep 23 04:06:37.126795 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2701/5472] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:36 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:38.151987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:38.153903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:38.161940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:38.162718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:38.163329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:38.164246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:38.164855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:38.165463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:38.172669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=91 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:38.359626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:38.374428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:38.378128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:38.381261 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-27121280-576c-4019-8524-147a0a62050a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.232286 Sep 23 04:06:38.384050 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2772/5473] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:38 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:39.435280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:39.436841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:39.452026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:39.452893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:39.453722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:39.454606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:39.455262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:39.456181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:39.573104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:39.589926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:39.597575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:39.599206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56cb0056-95c6-4fcc-bf17-4bc5346fd058 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.176130 Sep 23 04:06:39.600274 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2702/5474] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:39 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:40.625278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:40.625935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:40.639911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:40.640420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:40.640869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:40.642381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:40.642870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:40.643309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:40.751781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:40.778367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:40.780577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:40.783039 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fffbca8b-9f9c-46b1-961f-07cf86275da1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.162710 Sep 23 04:06:40.784865 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2773/5475] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:40 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:41.811263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:41.811888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:41.821393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:41.827969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:41.834700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:41.836802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:41.839094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:41.842152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:41.842822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:41.956828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:41.967626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:41.969571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:41.971875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2d2bc3b-9f70-4460-9d6d-ddcea9b0281a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.165119 Sep 23 04:06:41.974012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2703/5476] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:41 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:43.002282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:43.003596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:43.052825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:43.055643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:43.059664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:43.061727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:43.065896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:43.066357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:43.187748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:43.198502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:43.201415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:43.202899 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a2f168c-6248-4045-b2e3-7d15a702bcab tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.206890 Sep 23 04:06:43.203695 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2774/5477] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:42 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:44.230971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:44.241663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:44.260261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:44.260776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:44.261278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:44.262551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:44.263017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:44.263464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:44.476236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:44.486865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:44.489053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:44.491084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab543b04-6c05-4edd-b8b7-14b40475b1a1 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.264947 Sep 23 04:06:44.506222 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2704/5478] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:44 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:45.528176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:45.529640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:45.543016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:45.545525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:45.546218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:45.547210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:45.547907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:45.548542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:45.655404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:45.682089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:45.704411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:45.706355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36aaf00c-f0d8-4db8-acb4-374600fb9132 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.187925 Sep 23 04:06:45.707131 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2775/5479] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:45 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:46.732700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:46.733341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:46.740752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:46.741288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:46.741759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:46.742655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:46.743106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:46.743619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:46.869282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:46.885609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:46.888445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:46.891050 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a40c46c-b208-40ab-8ba7-3d84d471038e tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.161867 Sep 23 04:06:46.892251 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2705/5480] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:46 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:47.917997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:47.919143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:47.929202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:47.929738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:47.930187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:47.930924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:47.931381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:47.931818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:48.255516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:48.274692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:48.276439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:48.280266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0ceb7f7-74f1-4f0e-a258-0dc595143fcb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.366925 Sep 23 04:06:48.284611 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2776/5481] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:47 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:49.315117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:49.315734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:49.330711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:49.331508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:49.338721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:49.339981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:49.340481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:49.341561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:49.463623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:49.491695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:49.501691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:49.503311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09e59237-f1f2-4539-bd46-6f7382ed154a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.192234 Sep 23 04:06:49.504460 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2706/5482] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:49 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:50.540000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:50.540616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:50.549796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=40 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:06:50.556853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:50.557456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:50.557939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:50.559929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:50.560639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:50.566567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:50.776113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:50.869930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:50.872313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:50.873325 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f87dd24b-297c-4f22-ba47-b30509344a6a tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.340142 Sep 23 04:06:50.889523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2777/5483] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:50 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:51.903578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:51.905155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:51.945378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:51.945750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:51.946221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:51.949554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:51.950154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:51.950608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:52.080604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:52.097617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:52.100884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:52.104092 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28622f6b-cf5f-4bd9-9a66-fb8c57b6824d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.208251 Sep 23 04:06:52.108642 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2707/5484] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:51 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:53.141062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:53.145615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:53.171452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:53.180514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:53.182008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:53.183736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:53.184764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:53.185222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:53.334381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:53.350262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:53.355352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:53.357034 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-149e8b5a-cb3d-4e1a-af3a-c95ad38ebc33 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.227286 Sep 23 04:06:53.362317 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2778/5485] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:53 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:54.406010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:54.407191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:54.422547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:54.424246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:54.424857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:54.426469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:54.428075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:54.432025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:54.627288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:54.647201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:54.647201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:54.648207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b0cce43-3c7d-4a6e-ba5e-4c1bdfb26993 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.247359 Sep 23 04:06:54.651502 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2708/5486] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:54 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:55.678010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:55.678879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:55.688186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:55.689079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:55.689708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:55.690587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:55.691283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:55.691955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:55.788337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:55.807200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:55.809808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:55.811227 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90a91da3-0857-4bd0-8d2c-b5cd9eb40d0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.137968 Sep 23 04:06:55.812824 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2779/5487] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:55 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:56.839919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:56.841334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:56.848972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:56.850262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:56.850965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:56.852056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:56.852748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:56.853527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:57.285704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:57.304940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:57.308037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:57.309900 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1549ca2b-2977-4faa-8996-647e89dfd0bd tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.474512 Sep 23 04:06:57.311481 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2709/5488] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:56 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:58.337095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:58.338386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:58.346523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:58.347258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:58.347856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:58.348726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:58.349383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:58.349965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:58.508763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:58.519997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:58.530022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:58.533331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2d8e7b4-9999-4e37-804d-5e9d92b3adf2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.199967 Sep 23 04:06:58.534922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2780/5489] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:58 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:06:59.563434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:06:59.564076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:06:59.571706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:59.572495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:59.573750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:59.574487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:06:59.575114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:06:59.575714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:06:59.703591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:59.730349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:59.732463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:06:59.735239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68ca7b43-7ecc-4d10-9703-9277aa4542b2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.176359 Sep 23 04:06:59.741595 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2710/5490] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:06:59 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:00.767298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:00.768599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:00.775272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:00.777193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:00.777705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:00.778634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:00.779159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:00.779654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:00.850133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:00.859772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:00.861227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:00.862731 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56ae7d42-d95a-40f1-a9d1-ea00311eb0cb tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.099436 Sep 23 04:07:00.863542 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2781/5491] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:00 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:01.889531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:01.891231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:01.900339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:01.902175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:01.902971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:01.904016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:01.905482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:01.906568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:02.127572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1441ac9-9342-4e0b-bd8d-2627d8e6df1e"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:02.131103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:02.143564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:02.144325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:02.145029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:02.146251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:02.147683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:02.148492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:02.184269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:02.205282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:02.210551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:02.211793 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-03083c8d-24a2-4a97-ab51-6d018f480f5b tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.327493 Sep 23 04:07:02.219782 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2711/5492] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:01 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:02.485497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4f4361c-c9e8-4829-94ca-8194d7cbaba3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362177 Sep 23 04:07:02.486668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2782/5493] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:07:02 2022] POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:07:03.238726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:03.239346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:03.254834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:03.255348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:03.257297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:03.258078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:03.259716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:03.262846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:03.276890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:03.509387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:03.519408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:03.520889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:03.522154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8694ef27-ed0f-42c6-bef0-eda7845e14d2 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.287434 Sep 23 04:07:03.522742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2712/5494] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:03 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:04.559343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:04.560058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:04.568379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:04.570170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:04.570731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:04.571824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:04.572695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:04.573132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:04.668363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:04.682865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:04.690998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:04.692300 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e3c7cdf-9f28-49f1-9099-05f8b06378fc tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1366 microversion: 2.47 time: 0.143563 Sep 23 04:07:04.693513 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2783/5495] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:04 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:05.722866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:05.730848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:05.750961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:05.756572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:05.757408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:05.758744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:05.762200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:05.763162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:05.886862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:05.897530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:05.908017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:05.909312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-27b1ced5-058a-45af-91bf-4869b5d2f0d0 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1372 microversion: 2.47 time: 0.191049 Sep 23 04:07:05.915690 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2713/5496] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:05 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:06.936670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:06.939024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:06.961907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:06.962759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:06.963665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:06.964932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:06.965510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:06.965952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:07.161951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:07.180533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:07.196441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:07.197778 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-625e6ef2-eca8-4149-a047-b9c78074c073 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1372 microversion: 2.47 time: 0.265645 Sep 23 04:07:07.200999 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2784/5497] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:06 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:08.227312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:08.227917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:08.249073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:08.249863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:08.250314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:08.251046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:08.251561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:08.251941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:08.391562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:08.402347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:08.403816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:08.405024 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1baf7954-9950-4791-af74-6fba53adc319 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1357 microversion: 2.47 time: 0.181745 Sep 23 04:07:08.417764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2714/5498] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:08 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:08.430091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:08.435964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:08.438855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Searching by: {'deleted': False, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:07:08.453284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:08.456575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:08.458015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:08.460374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:08.461969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:08.462621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:08.624961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:08.675907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:07:09.047683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:09.055947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:09.056562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:09.057799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:09.071335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:09.073211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:09.152995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee328fdf-aaca-4e56-beaa-10cdbc0a688c tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.726795 Sep 23 04:07:09.154157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2785/5499] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Sep 23 04:07:08 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:09.187211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:09.187890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:09.203115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:09.204041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:09.205829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:09.207505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:09.210849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:09.211939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:09.284898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:07:09.422365 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f524aa2-1f1b-448f-b45f-82cbd65b59ec tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 204 len: 0 microversion: 2.47 time: 0.239271 Sep 23 04:07:09.423726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2715/5500] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:07:09 2022] DELETE /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:07:09.448654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:09.450898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:09.474820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:09.475438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:09.476544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:09.480180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:09.481959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:09.482685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:09.985969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:10.007819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:10.009277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:10.017455 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e1ff23e-0d7d-4bf6-bfd9-8f461d7aec91 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1363 microversion: 2.47 time: 0.582881 Sep 23 04:07:10.017455 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2786/5501] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:09 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1363 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:11.038046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:11.039629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:11.052440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:11.053948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:11.054716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:11.056397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:11.057754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:11.074874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:11.254543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:11.266342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:11.269037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:11.270776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ac120e0-811d-4535-85fa-c258695fcc0d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 200 len: 1363 microversion: 2.47 time: 0.237736 Sep 23 04:07:11.293876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2716/5502] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:11 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:12.299348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:12.299986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: 53c45e71-74e7-4a9d-ac00-1a7872ee5bef] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:12.309514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.309999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.310618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.311322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.311775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.312210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.327314 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] HTTP exception thrown: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Request method failure captured: Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef HTTP/1.1 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTDAncAOjTEjDDuDwS7an7yGjz6ET4IL2MWivoBxgKaiMt5MtxtIF6IvnR3StmP2qeiYRFCjyVUEdPYAk-VsW_x9ieRh-tsaFA8mwOutTgKwqlNjPu13NJzAHacv_YAMRd2TXpO3D83eW7T307sVpiWkjkkOKgii5rnjGDSvVYxY0iQ Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a1b1f27345e54b8b9e56d4d677f059e7 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerShowV247Test-804902311 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerShowV247Test-804902311 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a1b1f27345e54b8b9e56d4d677f059e7 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerShowV247Test-804902311 Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerShowV247Test-804902311-project Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1323136bf71840f38176a59a31d7e60e Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerShowV247Test-804902311-project Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '53c45e71-74e7-4a9d-ac00-1a7872ee5bef'} Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:12.329191 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Returning 404 to user: Instance 53c45e71-74e7-4a9d-ac00-1a7872ee5bef could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:07:12.334625 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0627db52-d0b0-41a6-bca9-defae4938b88 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef" status: 404 len: 111 microversion: 2.47 time: 0.035764 Sep 23 04:07:12.335368 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2787/5503] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:12 2022] GET /compute/v2.1/servers/53c45e71-74e7-4a9d-ac00-1a7872ee5bef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:07:12.340549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:12.341132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:12.348978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:12.371505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.372777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.374905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.377617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.378113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.378580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.431062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:07:12.557866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4153f1ee-2198-4e12-bbef-4dcb3547ed62 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca" status: 204 len: 0 microversion: 2.47 time: 0.219101 Sep 23 04:07:12.558948 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2717/5504] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:07:12 2022] DELETE /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:07:12.568804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:12.569598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:12.589868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.590807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.591498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.592496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:12.593047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:12.593580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:12.718704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:12.727482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:12.728974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:12.730585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90cefae8-62e3-44ee-84d1-9874241e0441 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca" status: 200 len: 1363 microversion: 2.47 time: 0.166973 Sep 23 04:07:12.731444 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2788/5505] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:12 2022] GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:13.757304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:13.758677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:13.767025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:13.767554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:13.768369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:13.769443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:13.770045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:13.770680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:13.848297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:13.859392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:13.861140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1323136bf71840f38176a59a31d7e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1f27345e54b8b9e56d4d677f059e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:13.862614 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31f58d82-6d9b-4957-b816-34c449782c6d tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca" status: 200 len: 1363 microversion: 2.47 time: 0.109829 Sep 23 04:07:13.863228 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2718/5506] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:13 2022] GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca => generated 1363 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:14.889843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:14.890461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] [instance: f7685fbe-06be-4c02-bcf1-b1ba31f107ca] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:14.902129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:14.902914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:14.903599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:14.904662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:14.905399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:14.909761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:14.926061 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] HTTP exception thrown: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Request method failure captured: Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca HTTP/1.1 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTDAncAOjTEjDDuDwS7an7yGjz6ET4IL2MWivoBxgKaiMt5MtxtIF6IvnR3StmP2qeiYRFCjyVUEdPYAk-VsW_x9ieRh-tsaFA8mwOutTgKwqlNjPu13NJzAHacv_YAMRd2TXpO3D83eW7T307sVpiWkjkkOKgii5rnjGDSvVYxY0iQ Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: a1b1f27345e54b8b9e56d4d677f059e7 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerShowV247Test-804902311 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a1b1f27345e54b8b9e56d4d677f059e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerShowV247Test-804902311 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: a1b1f27345e54b8b9e56d4d677f059e7 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerShowV247Test-804902311 Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerShowV247Test-804902311-project Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 1323136bf71840f38176a59a31d7e60e Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerShowV247Test-804902311-project Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f7685fbe-06be-4c02-bcf1-b1ba31f107ca'} Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:14.928077 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. Sep 23 04:07:14.931707 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:07:14.933701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] Returning 404 to user: Instance f7685fbe-06be-4c02-bcf1-b1ba31f107ca could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:07:14.934876 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69fae3ce-bd42-4c5e-9c80-ab615359e803 tempest-ServerShowV247Test-804902311 tempest-ServerShowV247Test-804902311-project] 10.222.0.25 "GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca" status: 404 len: 111 microversion: 2.47 time: 0.048925 Sep 23 04:07:14.935714 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2789/5507] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:14 2022] GET /compute/v2.1/servers/f7685fbe-06be-4c02-bcf1-b1ba31f107ca => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:07:17.036003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:17.039684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:17.052081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:17.057832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:17.058556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:17.059486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:17.060318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:17.061520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:17.097465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lazy-loading 'flavor' on Instance uuid 31ac6786-72ae-4b3a-9810-076c51024b14 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:07:17.346507 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/action" status: 200 len: 32 microversion: 2.1 time: 0.316548 Sep 23 04:07:17.348342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2719/5508] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:07:17 2022] POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/action => generated 32 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:07:17.362433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:17.363221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:17.384607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:17.390011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:17.390807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:17.392149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:17.392828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:17.393441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:17.919727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:17.920814 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ac99cdf-bfb5-4b7e-b4a9-cad0341f5f0f tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001588 Sep 23 04:07:17.921164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2720/5509] 10.222.0.25 () {56 vars in 886 bytes} [Fri Sep 23 04:07:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:07:18.004330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:18.022863 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73558b53-5648-4312-a509-f4b74eb7f99b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.663140 Sep 23 04:07:18.026207 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2790/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:17 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:19.053760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:19.055167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:19.078695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:19.080952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:19.083150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:19.086369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:19.086865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:19.089496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:19.523447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:19.544334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9caea845-a58a-4c36-a16d-0bac22ca3771 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.497660 Sep 23 04:07:19.563099 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2721/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:19 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:20.300083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:20.300888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:20.518957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78b6aa86-a909-405b-aa78-12cb418b5743 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] Calling method '.version_select at 0x7f0c8a8db790>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:20.576784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:20.578520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:20.588368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:20.589224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:20.589964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:20.590983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:20.591738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:20.592334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:20.602811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=30 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:20.609995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78b6aa86-a909-405b-aa78-12cb418b5743 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.315352 Sep 23 04:07:20.610584 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2791/5512] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 04:07:20 2022] GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd/defaults => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:20.623165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cca3ec7-9473-470b-875c-751bef284533 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] Calling method '.version_select at 0x7f0c8aa26160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:20.885709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:20.910837 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe697037-3c0b-41cf-8572-f06ddb9c320d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.337437 Sep 23 04:07:20.913457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2722/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:20 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:21.113274 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cca3ec7-9473-470b-875c-751bef284533 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd" status: 200 len: 371 microversion: 2.1 time: 0.493772 Sep 23 04:07:21.114222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2792/5514] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 04:07:20 2022] GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd => generated 371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:21.129770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d1efa9a-8d4c-4c7a-854c-f7ca23c8bc9f tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] Calling method '.version_select at 0x7f0c93490280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:21.393922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d1efa9a-8d4c-4c7a-854c-f7ca23c8bc9f tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.267914 Sep 23 04:07:21.395448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2723/5515] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 04:07:21 2022] GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd/defaults => generated 371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:21.411474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c803afc6-269b-4efb-8efc-788663aa9776 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] Calling method '.version_select at 0x7f0c8aa26550>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:21.602954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c803afc6-269b-4efb-8efc-788663aa9776 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd" status: 200 len: 371 microversion: 2.1 time: 0.196379 Sep 23 04:07:21.610821 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2793/5516] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 04:07:21 2022] GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd => generated 371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:21.620401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28b3b6ff-4341-4e8b-92b6-0cc5ce26d691 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] Calling method '.version_select at 0x7f0c933985e0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:21.936009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:21.937549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:21.950856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:21.951441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:21.951963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:21.952088 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28b3b6ff-4341-4e8b-92b6-0cc5ce26d691 tempest-QuotasTestJSON-600330097 tempest-QuotasTestJSON-600330097-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd?user_id=564dc708c2c84e118fddf6c5ae0e0522" status: 200 len: 371 microversion: 2.1 time: 0.339786 Sep 23 04:07:21.960388 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2724/5517] 10.222.0.25 () {58 vars in 1323 bytes} [Fri Sep 23 04:07:21 2022] GET /compute/v2.1/os-quota-sets/ffe3635bc471499fbd3b6f792cd8cbdd?user_id=564dc708c2c84e118fddf6c5ae0e0522 => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:21.960610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:21.960610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:21.960610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:22.149062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:22.162913 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-703149d8-3dca-4f77-b0a7-58f41ccbf342 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.231397 Sep 23 04:07:22.163840 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2794/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:21 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:23.187814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:23.188488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:23.200317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:23.200840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:23.201254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:23.202009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:23.202709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:23.217564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:23.548366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:23.562231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4035104-e6ab-4e0a-a2ed-53b60b5d54c1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.378487 Sep 23 04:07:23.567668 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2725/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:23 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:23.832730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:23.833232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:23.843756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:23.848781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:23.849905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:23.851023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:23.852428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:23.854194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:23.918741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4276b91d-8959-4658-addc-8e3e41e37e5b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/ips" status: 200 len: 151 microversion: 2.20 time: 0.660527 Sep 23 04:07:23.934484 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2795/5520] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Sep 23 04:07:23 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/ips => generated 151 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:07:24.595198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:24.596531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:24.609545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:24.610304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:24.610970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:24.611905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:24.615260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:24.616090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:24.651978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:25.192518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:25.206319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d5895f5-899a-4386-bfa7-a32925699574 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.614489 Sep 23 04:07:25.225292 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2726/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:24 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:26.232869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:26.233635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:26.242165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:26.243288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:26.243935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:26.244861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:26.246063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:26.246693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:26.474302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:26.484437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8d685d5-72d3-4065-b6e7-d1e8d6351b99 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.255472 Sep 23 04:07:26.487111 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2796/5522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:26 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:27.172231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:27.172924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:27.185573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.186167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.188610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:27.189734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.198235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.221543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:27.283349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lazy-loading 'flavor' on Instance uuid 6a9f0be9-daf4-46b1-9822-5bd9df558282 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:07:27.514794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:27.515520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:27.529853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.530370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.532985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:27.533854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.534327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.534777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:27.691130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b61f2c20-87ce-4091-aae4-9de9a13e4b44 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/action" status: 202 len: 0 microversion: 2.20 time: 0.524830 Sep 23 04:07:27.691784 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2727/5523] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 04:07:27 2022] POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:07:27.720685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:27.721901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:27.735268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.735987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.736725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:27.737848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:27.738476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:27.739955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:28.135899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:28.154660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:28.157081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:28.158390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ffede81-6aa5-4261-ac0d-9c6dc9c5a6a0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.461613 Sep 23 04:07:28.166582 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2728/5524] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:27 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:07:28.231398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:28.252421 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ca77fce-1bad-4296-a5de-1f3434ab65e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.735388 Sep 23 04:07:28.253686 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2797/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:27 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:07:29.194627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:29.195341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:29.208366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:29.208499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:29.209233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:29.212796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:29.213918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:29.214627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:29.283500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:29.284238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:29.303212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:29.304654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:29.305375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:29.306901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:29.307586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:29.308362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:29.622114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:29.632365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:29.638947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:29.640959 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d91b63e5-8490-4f53-8213-b71c89bea91e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.452610 Sep 23 04:07:29.662028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2729/5526] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:29 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:29.892410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:29.900869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d9d1b62-f5ee-4056-8ddd-f87af8130475 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.628648 Sep 23 04:07:29.919730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2798/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:29 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:30.671149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:30.672421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:30.681385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:30.682320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:30.682928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:30.683882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:30.684705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:30.685301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:30.932885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:30.933549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:30.951701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:30.952861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:30.953325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:30.954096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:30.954997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:30.955437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:31.119856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:31.161028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:31.165173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:31.169421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-913eac0c-948b-4610-842e-976350b4b0ea tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.503177 Sep 23 04:07:31.177596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2730/5528] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:30 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:31.250562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:31.264311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4179b09f-8dca-4a11-80fb-9e669cda990b tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.341470 Sep 23 04:07:31.269726 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2799/5529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:30 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:07:32.196091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:32.197457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:32.204400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:32.224513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:32.225264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:32.231320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:32.232610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:32.235615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:32.237643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:32.297088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:32.297938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:32.300211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:32.328331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:32.329239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:32.330029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:32.333941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:32.337376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:32.338811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:32.919252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:32.924697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:32.933442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:32.935986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:32.938682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85ed87cd-3481-4f7a-843c-4c93f548a081 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.746793 Sep 23 04:07:32.941891 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2731/5530] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:32 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:07:32.964698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-332f0be2-175c-4393-a6d6-25d5d6026968 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.664389 Sep 23 04:07:32.965598 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2800/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:32 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:07:33.973921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:33.975227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:33.990939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:33.993961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:33.999642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:34.000975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:34.008258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:34.009407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:34.012174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:34.014140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:34.014853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:34.024703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:34.026674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:34.028929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:34.029735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:34.030951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:34.788537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:34.802241 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a8c87874-0154-4da0-8eb6-1a88037ce534 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.804935 Sep 23 04:07:34.810343 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2801/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:33 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:07:34.914571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:34.926746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:34.933395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:34.934858 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1f029c4-1b62-4104-8482-bdb274162483 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.966403 Sep 23 04:07:34.935968 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2732/5533] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:33 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:35.843593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:35.845315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:35.864733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:35.865149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:35.865635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:35.866379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:35.871348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:35.872168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:35.966897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:35.967663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:35.989113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:35.990348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:35.991016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:35.991956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:35.992650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:35.993323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:36.384611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:36.400273 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f75f9d36-e0e2-411a-9f09-2ca9346d142d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1734 microversion: 2.1 time: 0.564302 Sep 23 04:07:36.416158 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2802/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:35 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1734 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:36.623139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:36.643765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:36.651542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:36.661385 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-892884fe-97c3-4bf1-9991-ed6014950ac1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.691637 Sep 23 04:07:36.661385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2733/5535] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:35 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:07:37.428059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:37.428688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:37.440106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:37.452700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:37.454965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:37.457486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:37.459497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:37.460520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:37.697028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:37.707478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:37.735992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:37.736491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:37.737145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:37.738056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:37.738697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:37.739561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:37.846922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:37.863027 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa34e4ed-73fe-4271-978b-29694d585ae1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1714 microversion: 2.1 time: 0.434939 Sep 23 04:07:37.863816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2803/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:37 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1714 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:38.058105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:38.070243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:38.072921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:38.078675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b05a4d1-b614-49e7-89bd-a8612054a31d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.391600 Sep 23 04:07:38.079790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2734/5537] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:37 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:38.116989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:38.117535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:38.126409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.126909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.127356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.128071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.128530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.128960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.220069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da103f4c-c911-4acf-88ba-718964fbbcb2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: .version_select at 0x7f0c8b6480d0>, body: {"keypair": {"name": "tempest-keypair-253126218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEjSHwzzw7sF+RuAiZyYX4B9gppZvLlkCTIH4wKLOpdxMfqXknUIRY6kVes2EaHTfKWI2ap30kyOHqUP4gORhzlQ1Fzfb51JHwND48S7BCbXYjJWEOW/gm4j7bxMHuw9w=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:38.269695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-da103f4c-c911-4acf-88ba-718964fbbcb2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for project 0bfd88f113124be8892a9c850eb992e2. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:07:38.286936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-da103f4c-c911-4acf-88ba-718964fbbcb2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for user 14fc1741357b4427a9fa52488a7e99dc and project 0bfd88f113124be8892a9c850eb992e2. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:07:38.337026 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Cannot 'detach_volume' instance 31ac6786-72ae-4b3a-9810-076c51024b14 while it is in vm_state rescued Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments/b1441ac9-9342-4e0b-bd8d-2627d8e6df1e HTTP/1.1 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'detach_volume' instance 31ac6786-72ae-4b3a-9810-076c51024b14 while it is in vm_state rescued Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '31ac6786-72ae-4b3a-9810-076c51024b14', 'id': 'b1441ac9-9342-4e0b-bd8d-2627d8e6df1e'} Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 31ac6786-72ae-4b3a-9810-076c51024b14 while it is in vm_state rescued Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:07:38.339572 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 31ac6786-72ae-4b3a-9810-076c51024b14 while it is in vm_state rescued Sep 23 04:07:38.344040 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:07:38.346196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 409 to user: Cannot 'detach_volume' instance 31ac6786-72ae-4b3a-9810-076c51024b14 while it is in vm_state rescued {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:07:38.347298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4600234d-4b61-4765-a872-a0ef8ab21ba7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments/b1441ac9-9342-4e0b-bd8d-2627d8e6df1e" status: 409 len: 152 microversion: 2.1 time: 0.234957 Sep 23 04:07:38.350961 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2735/5538] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:07:38 2022] DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments/b1441ac9-9342-4e0b-bd8d-2627d8e6df1e => generated 152 bytes in 239 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:07:38.352645 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da103f4c-c911-4acf-88ba-718964fbbcb2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.402188 Sep 23 04:07:38.354599 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2804/5539] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:07:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:07:38.362679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:38.363452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:38.379492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.381508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.383084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.385605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.388703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.389500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.540004 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f07e989f-737d-42c5-a8d1-528a3008db77 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/action" status: 202 len: 0 microversion: 2.1 time: 0.183828 Sep 23 04:07:38.545313 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2736/5540] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:07:38 2022] POST /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:07:38.558004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:38.560553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:38.595067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.596579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.598936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.599991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:38.601868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:38.604809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:38.915430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:38.919046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:38.964069 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09b2aafe-b4ee-42cd-b899-e46427e1745c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1722 microversion: 2.1 time: 0.412777 Sep 23 04:07:38.966082 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2805/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:38 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:39.111307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:39.113332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:39.131680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:39.132185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:39.132714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:39.133509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:39.134355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:39.134792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:39.420047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:39.437210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:39.439030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:39.440359 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6985a510-3899-4f91-88b5-a68605644a1e tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.335037 Sep 23 04:07:39.443870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2737/5542] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:39 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:07:39.992364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:39.993030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:40.004789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:40.005760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:40.009161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:40.010179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:40.012445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:40.019728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:40.478712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:40.479337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:40.495046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:40.495834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:40.496468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:40.497703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:40.498355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:40.498974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:40.987062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:41.005210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8acfdcc7-7a89-4ed3-9666-8b25d7f6754d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1722 microversion: 2.1 time: 1.016816 Sep 23 04:07:41.026440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2806/5543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:39 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1722 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:41.362742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:41.393147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:41.401470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:41.413644 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1baa12a-9985-419d-b4d9-f4ba86f9db54 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.932489 Sep 23 04:07:41.414877 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2738/5544] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:40 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:07:41.972883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-50896555", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9cbc138-68e0-4aed-be63-6698f9c17d51"}], "security_groups": [{"name": "tempest-securitygroup--448076891"}], "key_name": "tempest-keypair-253126218", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:42.035617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:42.037720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:42.063368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:42.064376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:42.065881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:42.067541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:42.069525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:42.071682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:42.339185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] validate_networks() for [('a9cbc138-68e0-4aed-be63-6698f9c17d51', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:07:42.563133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:42.573776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5141e063-8473-4678-b670-d2bc41fcb0ab tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1728 microversion: 2.1 time: 0.544131 Sep 23 04:07:42.591636 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2739/5545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:42 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1728 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:42.597189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:42.597515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:42.599562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:42.604522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:42.605378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:42.606215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:42.607157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:42.607853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:42.608506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:42.615210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:42.991202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:43.035668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:43.037152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:43.040363 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c472dc2-b872-4e2c-ad76-7895a4e94718 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.447582 Sep 23 04:07:43.040942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2740/5546] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:42 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:43.046377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:43.047149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:43.076585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:43.077184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:43.077809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:43.078615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:43.079271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:43.079815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:43.403285 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd49c756-b5b7-40ef-8010-2798993c82f7 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.360893 Sep 23 04:07:43.404509 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2741/5547] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:07:43 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-interface => generated 285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:44.034962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:07:44.035503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:07:44.036026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:07:44.037588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:07:44.038191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:07:44.057490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:44.058177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:44.058867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:44.060465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:44.061613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:44.062457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:44.072716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:44.073622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:44.090999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:44.091764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:44.092099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for project 0bfd88f113124be8892a9c850eb992e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:07:44.092748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:44.094174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:44.095758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:44.097687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:44.099629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for user 14fc1741357b4427a9fa52488a7e99dc and project 0bfd88f113124be8892a9c850eb992e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:07:44.120745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:07:44.123420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:07:44.218481 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd170727-fd9d-4cfb-9193-03d132a11cff tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.250722 Sep 23 04:07:44.219384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2807/5548] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:07:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:07:44.231150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab635b02-1897-48d1-8038-bbf7503e628a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:44.234113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab635b02-1897-48d1-8038-bbf7503e628a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:44.372783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab635b02-1897-48d1-8038-bbf7503e628a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:44.386192 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab635b02-1897-48d1-8038-bbf7503e628a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1235 microversion: 2.1 time: 0.158820 Sep 23 04:07:44.392287 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2808/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:44 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1235 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:07:44.536214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:44.550228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:44.551703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:44.572136 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1d3cdf2-9afe-491e-9f4c-087b406f5660 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1742 microversion: 2.20 time: 0.492991 Sep 23 04:07:44.573370 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2742/5550] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:44 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1742 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:45.409231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:45.409918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:45.439785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:45.440303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:45.440759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:45.441516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:45.441982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:45.442421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:45.604585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:45.612470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:45.614798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:45.615986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-74d2c021-1906-4cb2-9cc9-833101d72160 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1287 microversion: 2.1 time: 0.211744 Sep 23 04:07:45.616583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2809/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:45 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1287 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:45.624173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:45.625268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:45.625990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:45.626990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:45.627670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:45.628375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:45.911123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:45.919902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:45.921662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:45.922880 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-90eecdf1-fc4e-4384-b37f-fe754750afba tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1742 microversion: 2.20 time: 0.322920 Sep 23 04:07:45.924120 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2743/5552] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:45 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1742 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:46.061501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:46.084432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.085330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.086694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:46.107433 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] Creating event network-changed:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:07:46.117190 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-806f1082-bcb7-417f-8a5a-fb954da7e58a req-c13076f9-31fa-4c7c-ac1e-65c012d00d78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058834 Sep 23 04:07:46.119143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2810/5553] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:46.539397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "name": "network-vif-plugged", "status": "completed", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:46.561162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.561812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.562636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:46.614620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] Creating event network-vif-plugged:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h2-858495-2 Sep 23 04:07:46.633767 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-17fd98e2-bed9-405e-8285-f5d4e5af2eda req-3a393ddf-dd53-4892-9724-b794f13b4835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097485 Sep 23 04:07:46.635418 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2744/5554] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:46.644846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:46.646907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:46.665729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.666265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.666719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:46.667908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.668385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.668815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:46.787525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:46.799711 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1dd7a992-11b5-4b02-918c-e70706dd779b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1293 microversion: 2.1 time: 0.159166 Sep 23 04:07:46.800251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2811/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:46 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:46.952819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:46.953647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:46.968938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.972148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.974981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:46.976133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:46.977305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:46.980080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:47.720382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:47.730234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:47.731777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:47.733033 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2341766-11e8-4c7c-87ae-969f2c18ce14 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1742 microversion: 2.20 time: 0.785433 Sep 23 04:07:47.735957 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2745/5556] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:46 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1742 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:47.837918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:47.838661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:47.862019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:47.862529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:47.862982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:47.863711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:47.864447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:47.865543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:48.019849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:48.029813 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ce7b880f-d0cb-4a0b-9fd1-cef201d13587 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1293 microversion: 2.1 time: 0.209857 Sep 23 04:07:48.031164 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2812/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:47 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:48.167725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:48.185567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:48.186307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:48.186941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:48.211689 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] Creating event network-changed:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:07:48.222142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cbf1447d-03a0-48b1-8404-7b00ae657aa2 req-72226cc6-5e11-4748-8e57-19be4aa31400 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057721 Sep 23 04:07:48.224701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2746/5558] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:48.759370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:48.759992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:48.771705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:48.772208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:48.772656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:48.779856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:48.780506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:48.780964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:49.058424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:49.059152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:49.075505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:49.076018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:49.076469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:49.077193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:49.077685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:49.078123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:49.258799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:49.278727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:49.281192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:49.283180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88aa53f5-5464-40be-8f6f-9b6c4556da63 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1742 microversion: 2.20 time: 0.528354 Sep 23 04:07:49.284039 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2813/5559] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:48 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1742 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:49.687248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:49.698146 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96fa1765-4e1f-4f40-9a4b-6e3fa8dc5418 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.644026 Sep 23 04:07:49.719198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2747/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:49 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:50.187068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6741243b-b27c-4e67-a424-085ca4b2692e", "tag": "8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:50.212578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:50.213066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:50.213551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:50.236554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] Creating event network-changed:8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061 for instance 6741243b-b27c-4e67-a424-085ca4b2692e on n-h2-858495-2 Sep 23 04:07:50.244696 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2335c504-f845-4fd3-a82d-13d34bc3ca26 req-ce5740d6-106b-4f2b-84dc-20db93a7f421 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064514 Sep 23 04:07:50.245702 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2814/5561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:50.313095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:50.314382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:50.323117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:50.324107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:50.324795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:50.325806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:50.326501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:50.327142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:50.725679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:50.728298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:50.739944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:50.742299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:50.743267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:50.743920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:50.747662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:50.749142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:50.749874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:50.932774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:50.949545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:50.958120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:50.960122 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65ca3d4f-36f3-4f8b-9cb9-12fd006402f2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.652496 Sep 23 04:07:50.978321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2748/5562] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:50 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:51.582437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:51.596422 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c83f87f8-a454-48ef-b60e-60d3577cfcac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.874892 Sep 23 04:07:51.634026 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2815/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:50 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:51.993976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:51.995315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:52.003056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:52.005489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:52.008110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:52.009235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:52.009979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:52.010634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:52.322939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:52.358569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:52.360806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:52.362343 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea660689-18af-43ce-8e46-7ad355fd826a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.373776 Sep 23 04:07:52.364802 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2749/5564] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:51 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:52.629833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:52.631215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:52.640639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:52.641534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:52.642202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:52.643144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:52.643847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:52.644503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:52.910461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:52.919581 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9a5c3e6-d9f9-48ed-b78d-aadcc089fd4c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.293769 Sep 23 04:07:52.924383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2816/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:52 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:53.394360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:53.405417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:53.427832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:53.430549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:53.431527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:53.432560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:53.433667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:53.434387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:53.782190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:53.792206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:53.793789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:53.795030 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94c4c52c-b39f-4ec1-b9e5-029921aff39c tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.408230 Sep 23 04:07:53.805457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2750/5566] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:53 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:53.952938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:53.953690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:53.967873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:53.968382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:53.968830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:53.971686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:53.972394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:53.974176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:54.079601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:54.365027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:54.380151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:07:54.392831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0886d906-2d64-4014-afb1-ae655b542a57 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.444235 Sep 23 04:07:54.395855 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2817/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:53 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:54.825293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:54.826186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:54.840789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:54.845979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:54.846489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:54.847268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:54.847755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:54.854647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:55.308102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:55.324215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:55.330072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:55.334128 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-217b5997-ec6b-4d0b-a594-e16aaf7c79bb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.513031 Sep 23 04:07:55.339634 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2751/5568] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:54 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:55.422381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:55.423006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:55.451262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:55.453545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:55.454181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:55.455086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:55.457177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:55.458802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:55.710935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:55.723106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-729c7305-5569-46bd-b94e-27e7a20a4d09 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.305445 Sep 23 04:07:55.740027 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2818/5569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:55 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:56.372204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:56.373431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:56.390736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:56.394088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:56.394874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:56.396988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:56.397659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:56.400385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:56.758335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:56.763570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:56.786420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:56.788273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:56.800464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:56.801124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:56.807676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:56.808184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:56.808635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:56.817596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:56.830437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:56.836460 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf6da587-8598-4693-890b-f7a28081aa08 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.468209 Sep 23 04:07:56.839887 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2752/5570] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:56 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:57.309295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:57.320423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c5324f3-bd25-47cf-933a-d0c1c45384d7 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.573053 Sep 23 04:07:57.327199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2819/5571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:56 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:57.873228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:57.874397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:57.890650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:57.891439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:57.892039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:57.892917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:57.893633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:57.894223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:58.354811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:58.355543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:58.369417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:58.370295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:58.371671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:58.373288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:58.374010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:58.374653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:58.421211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:58.438915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:58.440617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:58.441917 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a10833b2-6a69-40be-9ce6-bec4f3eb891b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.577429 Sep 23 04:07:58.453676 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2753/5572] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:57 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:07:59.152290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:07:59.162655 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a85e2305-799d-4790-bc4e-97eb0c190fed tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.814601 Sep 23 04:07:59.163248 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2820/5573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:07:58 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:07:59.279950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6741243b-b27c-4e67-a424-085ca4b2692e", "name": "network-vif-plugged", "status": "completed", "tag": "8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:07:59.304883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:59.305714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:59.306328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:59.346994 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] Creating event network-vif-plugged:8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061 for instance 6741243b-b27c-4e67-a424-085ca4b2692e on n-h2-858495-2 Sep 23 04:07:59.372512 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-be8b9415-a749-4284-8744-77fb8a0ad34b req-f181caab-0279-46a4-bf99-841de0f01707 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096133 Sep 23 04:07:59.380261 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2754/5574] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:07:59.476488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:07:59.477805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:07:59.489022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:59.491972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:59.494058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:07:59.497103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:07:59.499788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:07:59.502716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:00.187870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:00.189044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:00.203668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:00.204178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:00.204617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:00.211516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:00.212261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:00.215897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:00.246185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:00.261268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:00.263085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:00.269150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0bd71a4-7382-42d6-8f59-77058efedc2f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.796929 Sep 23 04:08:00.275416 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2821/5575] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:07:59 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:00.774145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:00.783263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ad59963-d80c-4a9a-aac0-d65f5203c181 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.599647 Sep 23 04:08:00.790573 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2755/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:00 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:01.305451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:01.306075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:01.325282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:01.325829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:01.348951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:01.349833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:01.350334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:01.350801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:01.814756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:01.815568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:01.824584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:01.825619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:01.826287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:01.827326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:01.831126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:01.831770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:02.134457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:02.146962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:02.148658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:02.150270 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ce6758e-c00d-438a-87a7-82acceba62c1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.849220 Sep 23 04:08:02.151434 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2822/5577] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:01 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:02.441869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:02.463356 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7255ef8e-9fb0-4398-a5a6-3659a894dad1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1360 microversion: 2.1 time: 0.652620 Sep 23 04:08:02.469615 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2756/5578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:01 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1360 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:03.180448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:03.181508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:03.209852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:03.211140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:03.211559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:03.214585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:03.215677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:03.216223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:03.493060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:03.493978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:03.512784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:03.518484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:03.521462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:03.523714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:03.526872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:03.528647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:03.660266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:03.676929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:03.682140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:03.684898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a6a595d-bf55-40ef-8eae-f3fb23980b1d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.511307 Sep 23 04:08:03.701299 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2823/5579] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:03 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:04.095869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:04.116331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d34648c4-d5ec-411f-bb0e-59e559a0e2fa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1545 microversion: 2.1 time: 0.617469 Sep 23 04:08:04.125657 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2757/5580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:03 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1545 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:08:04.142678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:04.143784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:04.160091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:04.164475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:04.168289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:04.170713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:04.172820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:04.176630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:04.509566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-722fc5f8-415e-4836-94ba-5a0e029ab495 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.371168 Sep 23 04:08:04.512173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2824/5581] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:08:04 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-interface => generated 284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:04.719621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:04.720252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:04.746299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:04.746738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:04.756653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:04.761776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:04.763453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:04.764582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:05.683398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:05.702820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:05.706400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:05.711450 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8ca7a63-5d4b-405c-8076-bb5de54e7ba0 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.994585 Sep 23 04:08:05.714807 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2758/5582] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:04 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:06.742424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:06.744199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:06.756439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:06.767089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:06.769049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:06.770478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:06.775163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:06.775896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:07.080502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:07.088383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:07.098958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:07.122848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:07.124929 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8a78050-c17b-42f9-9f03-98c4b89834ec tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.387764 Sep 23 04:08:07.137705 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2825/5583] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:06 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:07.693128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6741243b-b27c-4e67-a424-085ca4b2692e", "tag": "8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:07.719448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:07.722727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:07.723487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:07.750683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:07.753740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] Creating event network-changed:8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061 for instance 6741243b-b27c-4e67-a424-085ca4b2692e on n-h2-858495-2 Sep 23 04:08:07.763270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8331c16d-6f43-4b4d-bd3c-0d7646712f28 req-8e7b6c29-f1b3-4404-a638-c42a5d48c651 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073978 Sep 23 04:08:07.766560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2759/5584] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:08.161233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:08.162176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:08.172115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:08.172609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:08.173055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:08.173813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:08.178435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:08.181156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:08.793224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:08.805099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:08.806600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:08.807819 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7e185c9-98e6-406d-9250-147346fc6be9 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.651631 Sep 23 04:08:08.826624 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2826/5585] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:08 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:09.839611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:09.840421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:09.874362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:09.874971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:09.875430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:09.876389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:09.877013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:09.877609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:10.463849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:10.478788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:10.480271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:10.481567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-093b31ea-6c79-4838-a7eb-71e130176b19 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.647993 Sep 23 04:08:10.502483 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2760/5586] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:09 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:11.531354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:11.533009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:11.560431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:11.560977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:11.564312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:11.565210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:11.568740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:11.570823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:12.186453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:12.211488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:12.216319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:12.221776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2d32b10-005a-4961-a73a-e315ee4135a8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.693434 Sep 23 04:08:12.223451 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2827/5587] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:11 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:13.251432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:13.251829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:13.255598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=42 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:13.270649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:13.271987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:13.273315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:13.277658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:13.278361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:13.278988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:13.747624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:13.765666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:13.767622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:13.768904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-940e7f79-6636-4db5-8bf1-3ad8823d1a37 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.522222 Sep 23 04:08:13.774272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2761/5588] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:13 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:14.804070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:14.805467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:14.848943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:14.849927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:14.851885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:14.852908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:14.854898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:14.855975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:15.320647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:15.412345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:15.412345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:15.412345 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b0f6423-9b45-4599-bc99-243e004e131b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1737 microversion: 2.20 time: 0.605260 Sep 23 04:08:15.425537 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2828/5589] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:14 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1737 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:16.439216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:16.440616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:16.457102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:16.461095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:16.461847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:16.465039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:16.465901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:16.467852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:16.612956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:16.613888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:16.627723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:16.628418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:16.629045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:16.637191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:16.638387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:16.639017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:16.805453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lazy-loading 'services' on Instance uuid 31ac6786-72ae-4b3a-9810-076c51024b14 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:08:16.920101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:16.937094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:16.947686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:16.952247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba159785-7ca1-4194-a6d2-1f42ce3b82d3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1719 microversion: 2.20 time: 0.519094 Sep 23 04:08:16.954067 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2762/5590] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:16 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1719 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:16.980131 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b55f96ab-16a4-4d60-a5a4-ec0334482e50 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments/b1441ac9-9342-4e0b-bd8d-2627d8e6df1e" status: 202 len: 0 microversion: 2.1 time: 0.371121 Sep 23 04:08:16.981455 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2829/5591] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:08:16 2022] DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments/b1441ac9-9342-4e0b-bd8d-2627d8e6df1e => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:08:16.992085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:16.995135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:17.006843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:17.008918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:17.009916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:17.011148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:17.012628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:17.013517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:17.084295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c30c4b1-4a20-4227-949e-b99d03b6e5a1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098703 Sep 23 04:08:17.096726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2763/5592] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:16 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:17.983559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:17.984265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:17.995114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:17.995618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:17.996064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:17.996790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:17.997250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:17.997716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:18.108946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:18.111326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:18.131763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:18.133042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:18.133042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:18.133447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:18.133910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:18.134342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:18.263094 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8eaa0d5-c727-4dc3-bd79-2ba790efbe7c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158350 Sep 23 04:08:18.267557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2764/5593] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:18 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:08:18.278225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:18.298016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:18.299492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:18.300754 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a2f51a2b-ce88-4076-9b16-2d87a89c6962 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1719 microversion: 2.20 time: 0.322526 Sep 23 04:08:18.312176 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2830/5594] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:17 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1719 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:18.912863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "name": "network-vif-unplugged", "status": "completed", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:18.948387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:18.948890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:18.949376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:18.976710 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] Creating event network-vif-unplugged:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h2-858495-2 Sep 23 04:08:18.998019 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c998f145-142a-41bc-97bd-06a224299990 req-efda8d86-a4d1-4cd0-b2c9-05f9e4798e0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087314 Sep 23 04:08:19.001707 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2765/5595] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:19.290152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:19.293599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:19.311264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:19.312425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:19.313063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:19.314015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:19.314643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:19.315239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:19.348002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:19.348477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:19.380681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:19.381779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:19.382679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:19.383415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:19.383881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:19.384321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:19.410464 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc0683d7-5e66-4a49-aa2e-e95c52c75156 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111953 Sep 23 04:08:19.413456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2831/5596] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:19 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:20.043928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:20.053551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:20.060373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:20.064876 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3d00e52-c1cf-4ab7-8215-ed542c3c8cc3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1719 microversion: 2.20 time: 0.725511 Sep 23 04:08:20.068829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2766/5597] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:19 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1719 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:08:20.423790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:20.426711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:20.450288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:20.450808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:20.452447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:20.455123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:20.487756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:20.488561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:20.598037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1bb39c7-fc6b-45df-9680-d5dd56bd4461 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179057 Sep 23 04:08:20.600887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2832/5598] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:20 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:08:21.096217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:21.096999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:21.111880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.113598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.129136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.130215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.133863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.134443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.616428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:21.619817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:21.622002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:21.630577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:21.645788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.647212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.648975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:21.649762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.650502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:21.650841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.651392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.651808 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-53d129df-5156-4857-a763-01ec352f493a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1662 microversion: 2.20 time: 0.560158 Sep 23 04:08:21.652257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.652443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2767/5599] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:21 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1662 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:21.702156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038b44eb-63a0-4572-af03-16d79871a2bd"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:21.711554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:21.735829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.741766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.742265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.750885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:21.753656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:21.754327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:21.755598 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6884ac1-88d3-42e9-8819-cd6f236b2288 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146717 Sep 23 04:08:21.756706 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2833/5600] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:21 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:22.398527 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-844f0878-2258-4596-a035-b715f5f888fe tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.714784 Sep 23 04:08:22.406109 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2768/5601] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Sep 23 04:08:21 2022] POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments => generated 188 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:08:22.673547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:22.674872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:22.700454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:22.700961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:22.701426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:22.709589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:22.714516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:22.716694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:22.768297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:22.774506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:22.801133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:22.802161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:22.803443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:22.806297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:22.812885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:22.813814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:22.928589 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf4d5e00-b03e-42f9-b8a3-a080c9ed316c tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159138 Sep 23 04:08:22.929932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2769/5602] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:22 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:08:23.351667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55062f6e-de81-4662-a511-3adf15cfd57b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments/038b44eb-63a0-4572-af03-16d79871a2bd" status: 202 len: 0 microversion: 2.20 time: 0.683109 Sep 23 04:08:23.352350 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2834/5603] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Sep 23 04:08:22 2022] DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments/038b44eb-63a0-4572-af03-16d79871a2bd => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:08:23.456413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:23.458017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:23.477412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.486142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.486800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:23.487722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.488619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.489243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:23.552370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:08:23.686979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9398e949-a342-406c-bb88-74b6fd087a48 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/action" status: 202 len: 0 microversion: 2.20 time: 0.235000 Sep 23 04:08:23.687625 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2770/5604] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 23 04:08:23 2022] POST /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:08:23.699413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:23.700205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:23.723201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.724444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.726304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:23.733017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.734617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.736815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:23.942106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:23.944606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:23.953568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.954318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.954934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:23.955829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:23.956520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:23.957194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:24.028718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06b6f120-b98c-4c53-9477-a1bf493f3a1d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090722 Sep 23 04:08:24.034068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2771/5605] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:23 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:08:24.431960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:24.444884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:24.447672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:24.456261 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-828d408a-d4dd-4819-8613-e9b97dbf67af tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1670 microversion: 2.20 time: 0.757828 Sep 23 04:08:24.474196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2835/5606] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:23 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1670 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:25.046495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:25.051240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:25.070128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:25.075772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:25.076463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:25.081866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:25.082748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:25.083383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:25.163326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3cda3dc-d9be-4e3f-889e-905900d0d242 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119512 Sep 23 04:08:25.165670 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2772/5607] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:25 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:25.482872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:25.483470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:25.496995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:25.498976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:25.499935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:25.503705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:25.504460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:25.505244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:25.864756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:25.874760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:25.876213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:25.877430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a382780d-4301-43d1-92c0-5a0cad11deeb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1670 microversion: 2.20 time: 0.399167 Sep 23 04:08:25.885804 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2836/5608] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:25 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1670 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:26.184011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:26.187164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.200714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.201489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.202239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.203025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.203502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.203945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.245782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:26.263914 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f81e07d7-41e4-4aa6-88c6-57cf5bea1031 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090292 Sep 23 04:08:26.264475 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2773/5609] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:08:26 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:08:26.387132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:26.389697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.397652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.399009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.399683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.400619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.401270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.401919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.451541 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Cannot 'reboot' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action HTTP/1.1 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 28 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: {"reboot": {"type": "HARD"}} Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: exception: Cannot 'reboot' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34', 'body': {'reboot': {'type': 'HARD'}}} Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:08:26.455209 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.459452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.463963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 409 to user: Cannot 'reboot' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:08:26.465536 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-626e0822-2528-4f18-af1f-e9feb56417e1 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action" status: 409 len: 145 microversion: 2.1 time: 0.082714 Sep 23 04:08:26.467531 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2837/5610] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:08:26 2022] POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action => generated 145 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:08:26.479137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:26.483330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.492197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.492920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.493599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.494475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.495096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.496015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.532915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Cannot 'rebuild' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action HTTP/1.1 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 65 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: exception: Cannot 'rebuild' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34', 'body': {'rebuild': {'imageRef': 'e4f75334-b417-4681-8bb0-50f45fb07fda'}}} Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:08:26.541391 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued Sep 23 04:08:26.545609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:08:26.547768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 409 to user: Cannot 'rebuild' instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 while it is in vm_state rescued {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:08:26.549167 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08993602-f424-4b50-91d2-db92bf1f9355 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action" status: 409 len: 146 microversion: 2.1 time: 0.074966 Sep 23 04:08:26.550123 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2774/5611] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:08:26 2022] POST /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34/action => generated 146 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:08:26.562080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:26.563194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.576548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.578967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.580167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.581550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.582286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.583986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.628093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:08:26.685942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:26.798802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef0e9de9-5e3e-457d-a045-987270e91c93 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 204 len: 0 microversion: 2.1 time: 0.241512 Sep 23 04:08:26.802513 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2838/5612] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:08:26 2022] DELETE /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:08:26.810207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:26.810995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.820068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.820806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.821437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.822634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.823295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.823927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.917516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:26.918492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:26.942983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:27.199974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:27.219436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:27.220903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:27.222491 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d825c43a-b069-4b22-bbe0-9a754898d86b tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.310712 Sep 23 04:08:27.223064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2839/5613] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:26 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:27.290716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:27.305569 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2f3ed8b7-e47f-40ec-b654-3a91735760a4 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1688 microversion: 2.1 time: 0.500688 Sep 23 04:08:27.309103 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2775/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:26 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1688 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:28.253900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:28.256385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:28.283011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:28.283520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:28.283969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:28.284703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:28.285173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:28.285987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:28.343391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:28.350639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:28.373750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:28.374670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:28.375656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:28.376759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:28.377590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:28.378610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:28.633844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:28.654922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:28.657909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:28.660329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d81d6fd-74a5-4852-8976-0332246f152d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.412141 Sep 23 04:08:28.662298 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2840/5615] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:28 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:28.748126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:28.757306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c5fe3104-7be4-4f7a-b770-8db5b1dc7d25 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1688 microversion: 2.1 time: 0.428700 Sep 23 04:08:28.765557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2776/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:28 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1688 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:29.688281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:29.689379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:29.698936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:29.699680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:29.700687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:29.702329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:29.703037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:29.704456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:29.781718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:29.782434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:29.796339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:29.798453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:29.799101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:29.800062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:29.802185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:29.818012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:29.944115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:29.959554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:29.962193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:29.967741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a551fe21-d285-42cc-90e3-d665261e159a tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.283135 Sep 23 04:08:29.969152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2841/5617] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:29 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:30.158983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:30.171518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-57fa5f06-ddb1-411c-b563-f4fbf3ec7436 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1688 microversion: 2.1 time: 0.395170 Sep 23 04:08:30.174717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2777/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:29 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1688 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:30.996801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:30.997510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:31.006804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:31.007296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:31.018065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:31.019127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:31.019794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:31.020814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:31.199089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:31.199707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:31.212076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:31.212819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:31.213458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:31.214360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:31.214975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:31.226114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:31.280029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:31.300537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:31.304677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:31.306115 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-239aeda8-d078-43e3-9aeb-326c0fc748e8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.314181 Sep 23 04:08:31.313394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2842/5619] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:30 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:31.533241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:31.546346 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-badbd10d-978a-4fda-82a1-effd4b037c33 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1688 microversion: 2.1 time: 0.350997 Sep 23 04:08:31.551301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2778/5620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:31 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1688 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:08:32.334044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:32.335359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:32.343322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:32.344047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:32.344485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:32.345394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:32.349951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:32.350480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:32.578035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:32.579591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:32.589390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:32.590152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:32.590757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:32.591807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:32.592436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:32.593160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:32.856887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:32.875202 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61f9264a-45df-428f-8af0-ae7db9503b28 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1620 microversion: 2.1 time: 0.300269 Sep 23 04:08:32.876003 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2779/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:32 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1620 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:32.968081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:32.980799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:32.984934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:32.992183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7bc411ab-ecdf-4f52-9ab7-313bba1d682f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.660101 Sep 23 04:08:33.005401 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2843/5622] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:32 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:33.355118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:33.375967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:33.379625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:33.380224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:33.418698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] Creating event network-changed:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h1-858495-2 Sep 23 04:08:33.424584 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cc1c9d94-77ef-4812-bfa2-6fd8f9c67d68 req-fdde7a5f-cfb5-4963-9bc9-6f5409b9484d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076784 Sep 23 04:08:33.426058 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2780/5623] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:33.904101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:33.906041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:33.913920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:33.914639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:33.915241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:33.916138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:33.916746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:33.917329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:34.019825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:34.020357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:34.031870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:34.032574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:34.033020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:34.033775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:34.034410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:34.035140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:34.056119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:34.071724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5326019-ebb7-48e9-a8dc-a22349736d87 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 200 len: 1620 microversion: 2.1 time: 0.172396 Sep 23 04:08:34.073813 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2844/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:33 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 1620 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:34.602960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:34.618054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:34.619537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:34.620768 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29e5d82f-eff5-405b-b08d-02136202b6ef tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.607004 Sep 23 04:08:34.638036 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2781/5625] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:34 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:35.101604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:35.102896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 31ac6786-72ae-4b3a-9810-076c51024b14] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:35.123728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:35.124863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:35.146882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:35.150270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:35.155079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:35.156598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:35.192286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 HTTP/1.1 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '31ac6786-72ae-4b3a-9810-076c51024b14'} Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:35.195582 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. Sep 23 04:08:35.200288 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:35.202655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 404 to user: Instance 31ac6786-72ae-4b3a-9810-076c51024b14 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:08:35.203749 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-34ad454d-fd21-4e55-ba7a-67fc5eb58114 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14" status: 404 len: 111 microversion: 2.1 time: 0.106740 Sep 23 04:08:35.204914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2845/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:35 2022] GET /compute/v2.1/servers/31ac6786-72ae-4b3a-9810-076c51024b14 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:08:35.213240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc39ce55-3254-44d8-998b-1552d5a3db06 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '.version_select at 0x7f0c8a3b4670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:35.258369 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc39ce55-3254-44d8-998b-1552d5a3db06 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292213742" status: 202 len: 0 microversion: 2.1 time: 0.049135 Sep 23 04:08:35.259183 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2782/5627] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 04:08:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292213742 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:08:35.577915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ac6786-72ae-4b3a-9810-076c51024b14", "name": "network-vif-deleted", "tag": "60259564-cee4-43d5-81ef-ce42cfb50e4e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:35.599566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:35.600606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:35.601269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:35.619150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] Creating event network-vif-deleted:60259564-cee4-43d5-81ef-ce42cfb50e4e for instance 31ac6786-72ae-4b3a-9810-076c51024b14 on n-h1-858495-2 Sep 23 04:08:35.625183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-25333778-de8a-4db2-89e3-9df4c8df941f req-2234b048-c0e4-460d-9d27-442c93abc333 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054894 Sep 23 04:08:35.628688 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2846/5628] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:35.659047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:35.660069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:35.673762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:35.674775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:35.675834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:35.678170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:35.680207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:35.682285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:35.874444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:35.885808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:35.887383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:35.888511 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ca54123-47bb-4599-abdf-b27b56c8b131 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.235050 Sep 23 04:08:35.889104 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2783/5629] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:35 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:36.916704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:36.918477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:36.934221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:36.934625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:36.935179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:36.936098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:36.936636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:36.937164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:37.450084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:37.484330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:37.490404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:37.495648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-784ff577-1644-4451-bbc7-b7963e790ad4 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.581724 Sep 23 04:08:37.496954 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2847/5630] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:36 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:38.527823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:38.528638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:38.548137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:38.549630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:38.551499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:38.560955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:38.564157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:38.568537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:39.524479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:39.537096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:39.542492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:39.546282 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-547dab74-e4a7-4990-b1ca-cd4c4b13c5dd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 1.023283 Sep 23 04:08:39.547017 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2784/5631] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:38 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:40.600103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:40.604900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:40.622353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:40.623043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:40.623695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:40.626150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:40.626883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:40.628159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:41.020153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:41.040030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:41.044999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:41.048525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bdaa47d-431f-4627-89c2-a6736914b5b8 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.461294 Sep 23 04:08:41.049151 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2848/5632] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:40 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:42.077682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:42.079387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:42.109437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:42.527345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:42.541678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:42.549808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:42.554612 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3f5786e3-2620-4c50-b779-a3951affdfc1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.481241 Sep 23 04:08:42.558027 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2785/5633] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:42 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:43.586972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:43.588132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:43.602450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:43.605173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:43.605692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:43.606563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:43.609211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:43.609907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:44.131932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:44.156582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:44.160030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:44.161869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaecf2c5-f915-4e8e-a112-fd6b96db5c4d tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.581656 Sep 23 04:08:44.166894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2849/5634] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:43 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:45.193247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:45.193996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:45.204785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:45.227532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:45.228136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:45.244023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:45.246930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:45.251479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:45.254219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:45.737609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:45.756368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:45.776763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:45.781933 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17194a37-6935-4b64-84c0-3350b75ea720 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.594871 Sep 23 04:08:45.785714 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2786/5635] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:45 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:46.818530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:46.819742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:46.839143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:46.841975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:46.842619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:46.843559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:46.846199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:46.849302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:48.289970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:48.357251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:48.374175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:48.384147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-12e76ada-0bc9-4dea-bbab-13a67f66ede1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 1.570037 Sep 23 04:08:48.385973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2850/5636] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:46 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:49.415551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:49.417047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:49.433852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:49.435918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:49.437106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:49.457989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:49.460272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:49.461597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:50.192163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:50.218123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:50.224604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:50.227032 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8898e5f1-2363-403c-8d18-9e1167543b65 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.815669 Sep 23 04:08:50.231478 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2787/5637] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:49 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:51.029519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:51.030064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:51.046178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.046720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.048820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.049634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.050112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.050547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.184883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:08:51.259828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:51.260456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:51.272710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.273215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.276440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.277208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.277708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.278147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.588170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-35a9f24d-0bb9-4847-8cde-5837620bbf60 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 204 len: 0 microversion: 2.1 time: 0.561796 Sep 23 04:08:51.592565 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2851/5638] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:08:51 2022] DELETE /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:08:51.600944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:51.601761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:51.609282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.610071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.610808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.611851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:51.613015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:51.616057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:51.694792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:51.715263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:51.728982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:51.736186 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7085ad7-494c-4625-a8e9-cf5954864842 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.478688 Sep 23 04:08:51.757672 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2788/5639] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:51 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:52.092526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:52.107204 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13abcd34-4bc6-48ad-b447-04582dadd147 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1507 microversion: 2.1 time: 0.510971 Sep 23 04:08:52.135349 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2852/5640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:51 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:52.773087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:52.773745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:52.781130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:52.781670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:52.782112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:52.782829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:52.783456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:52.783896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:53.014567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:53.028416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:53.030384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:53.034011 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a864463-da58-4e80-ac31-5a64f41dbfcb tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.264413 Sep 23 04:08:53.035197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2789/5641] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:52 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:53.143858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:53.150089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:53.153471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:53.176242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:53.182114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:53.182743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:53.183701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:53.184289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:53.185023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:53.523895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:53.537695 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90594476-f8a3-4542-b239-32a2a5a205f0 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1507 microversion: 2.1 time: 0.397612 Sep 23 04:08:53.540105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2853/5642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:53 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:54.063719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:54.065162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:54.081333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:54.081858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:54.082301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:54.085342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:54.085877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:54.086317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:54.307979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:54.319523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:54.321022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:54.322887 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06a998a3-9087-4627-9fd7-ba3f627d90be tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.264285 Sep 23 04:08:54.324389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2790/5643] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:54 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:54.567719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:54.568338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:54.580175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:54.583024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:54.583672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:54.585087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:54.585898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:54.588618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:54.597323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:54.919863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:54.933501 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4e687f6d-8ded-4fbb-bdf5-499670fc8151 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 200 len: 1507 microversion: 2.1 time: 0.370661 Sep 23 04:08:54.935542 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2854/5644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:54 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:55.106352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34", "name": "network-vif-deleted", "tag": "ebbf55bf-e53d-4efe-afa9-7d93c992fb6d"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:55.138116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:55.138327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:55.138966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:55.158813 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] Creating event network-vif-deleted:ebbf55bf-e53d-4efe-afa9-7d93c992fb6d for instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 on n-h1-858495-2 Sep 23 04:08:55.181831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b98d5cb1-1858-4f19-83be-6851df5f3d14 req-98b0f077-a648-4e9f-9dee-07533ce6c33a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077728 Sep 23 04:08:55.188010 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2791/5645] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:08:55.356177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:55.356999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:55.393844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:55.397687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:55.397687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:55.403286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:55.404030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:55.421789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:55.714569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-206693223", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:08:55.806265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] validate_networks() for None {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:08:55.815460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:55.831813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:55.833855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:55.835176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2841c886-4b28-49e6-a33f-75ff49c4e0ce tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.484666 Sep 23 04:08:55.840260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2855/5646] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:55 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:55.958479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:55.959267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:55.974077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:55.974676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:55.975340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:55.976236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:55.976868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:55.977487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:55.993665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 HTTP/1.1 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34'} Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:55.996002 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. Sep 23 04:08:56.001340 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:08:56.003019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 404 to user: Instance 3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:08:56.004088 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c539d745-19fa-4739-b397-86243912ab83 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34" status: 404 len: 111 microversion: 2.1 time: 0.050451 Sep 23 04:08:56.008227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2856/5647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:55 2022] GET /compute/v2.1/servers/3d76ca4d-eb1a-4a9f-b3c1-f2ec6a41bf34 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:08:56.013545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:56.014324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:56.023956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.024686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.025294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.026243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.026869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.027476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.067148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:08:56.173222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f33a145-e581-4fb3-98a0-ef91f2ab0235 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "DELETE /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 204 len: 0 microversion: 2.1 time: 0.163220 Sep 23 04:08:56.174049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2857/5648] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:08:56 2022] DELETE /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:08:56.194186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:56.194923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:56.205475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.205995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.206978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.208279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.209291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.210076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.583100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:56.598127 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6b304f69-5a22-4c6c-bd0a-5fb1d8913e4a tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.419124 Sep 23 04:08:56.599618 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2858/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:56 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:56.626770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:08:56.627339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:08:56.627850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:08:56.628274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:08:56.628699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:08:56.638512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.639028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.639482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.640223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.640692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.641134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.647497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=96 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:08:56.660195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Getting quotas for project fe36518138ff4bcfa99826681742ff4b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:08:56.665635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Getting quotas for user 2ff32234f4a54ab8901d6a26a8e2b3f6 and project fe36518138ff4bcfa99826681742ff4b. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:08:56.681968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:08:56.684436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:08:56.731992 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e55fcf1c-2755-49eb-9b97-3f2f442e144e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026297 Sep 23 04:08:56.732988 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2792/5650] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:08:56.744858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f8e8296-7749-4bcb-9a15-7c6f7f043b15 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:56.745612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f8e8296-7749-4bcb-9a15-7c6f7f043b15 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:56.830296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f8e8296-7749-4bcb-9a15-7c6f7f043b15 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:56.843519 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f8e8296-7749-4bcb-9a15-7c6f7f043b15 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1214 microversion: 2.1 time: 0.102426 Sep 23 04:08:56.845079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2859/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:56 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:56.871688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:56.872657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:56.882690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.883448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.884073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:56.885321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:56.886056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:56.886784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:57.390416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:57.409249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:57.411600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:57.413163 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3cd118e4-d138-47bb-a5a4-538c5278cf57 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.546614 Sep 23 04:08:57.415179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2793/5652] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:56 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:57.622670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:57.631263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:57.655166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:57.657851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:57.658512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:57.659564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:57.660182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:57.660865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:57.872072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:57.872869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:57.882775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:57.883640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:57.884433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:57.885465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:57.886185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:57.886843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:58.015829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:58.017239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:58.049192 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c7c3bc8-be88-4532-a703-f11eb040a667 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1266 microversion: 2.1 time: 0.183822 Sep 23 04:08:58.049746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-24c3a9ae-ccc7-49a3-8150-9b4de12e5afd tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.427334 Sep 23 04:08:58.050524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2860/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:57 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:58.067202 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2794/5654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:57 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:08:58.440415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:58.441045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:58.447807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:58.448592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:58.449206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:58.449942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:58.450568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:58.451005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:58.765776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:58.783973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:58.787269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:58.790395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2666f23f-9565-428f-a929-76c5226ca1a1 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.354206 Sep 23 04:08:58.791210 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2861/5655] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:58 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:08:59.076248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:59.080169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:59.081239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:59.083657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:59.092757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.093527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.094070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:59.094758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.095283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.095728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:59.096918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.097797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.098806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:59.100001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.100777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.103140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:59.334711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:59.349196 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6696d981-6dff-4445-b6be-04f4ed9dc684 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1272 microversion: 2.1 time: 0.274973 Sep 23 04:08:59.361535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2862/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:59 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:59.407070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:08:59.416982 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8789e0df-ed40-4028-84e1-e993ac1d64ce tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1521 microversion: 2.1 time: 0.346679 Sep 23 04:08:59.418093 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2795/5657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:08:59 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:08:59.817300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:08:59.818214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:08:59.829400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.829902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.830470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:08:59.831039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:08:59.838092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:08:59.838751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.112712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "name": "network-vif-plugged", "status": "completed", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:00.133411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.134153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.134769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.161150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] Creating event network-vif-plugged:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h1-858495-2 Sep 23 04:09:00.173775 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1768b80b-2724-405c-8ba3-5936349258b2 req-28d67cb2-a0d9-4ba8-9d55-7bc7e3fc02bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336742 Sep 23 04:09:00.179684 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2796/5658] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:09:00.255082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:00.271143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:00.274104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:00.278792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-782c6dac-82ac-4eda-b2cb-fe21fc9b900f tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.462214 Sep 23 04:09:00.280472 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2863/5659] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:08:59 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:00.337135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292f8268-420f-4775-9d18-d8c6f3e41a3a", "name": "network-vif-deleted", "tag": "5c8958d1-659e-490a-bc90-06164a013c56"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:00.358941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.359695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.369691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.375097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:00.376158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:00.388120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.389141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.389848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.392482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.394158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.395783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.401034 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] Creating event network-vif-deleted:5c8958d1-659e-490a-bc90-06164a013c56 for instance 292f8268-420f-4775-9d18-d8c6f3e41a3a on n-h2-858495-2 Sep 23 04:09:00.415685 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-523794a2-2d85-4da0-a05b-389064ae3848 req-2e5b56f8-babb-41ca-aff8-887fb0879ef9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083217 Sep 23 04:09:00.416333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2797/5660] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:00.453697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:00.455576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:00.471550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.472322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.474125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.475623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:00.477048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:00.477689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:00.522434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:00.556144 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f5c1012-16e1-4503-96d5-b99e8706d6f0 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1272 microversion: 2.1 time: 0.181151 Sep 23 04:09:00.558159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2864/5661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:00 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:00.615287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f00c88acca24c0fa6497dba45552fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6518d2053a41bfb4559e063928f91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:00.627473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45386b95-cc4f-45ac-ac7a-42592d235f5d tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 200 len: 1307 microversion: 2.1 time: 0.184156 Sep 23 04:09:00.629614 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2798/5662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:00 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:01.308265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:01.308931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:01.323713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.327791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.328609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.329708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.330395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.331459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.585374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:01.585374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:01.598072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.603809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.604569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.605574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.606207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.606807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.690526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:01.700573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:01.702456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:01.704596 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3fd87e94-0376-4eca-bed8-042eb7fd96c2 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.400749 Sep 23 04:09:01.708497 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2865/5663] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:01 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:01.715438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:01.719681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] [instance: 292f8268-420f-4775-9d18-d8c6f3e41a3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:01.735755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.743390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.745641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.746663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:01.748587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:01.749204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:01.792508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] HTTP exception thrown: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Request method failure captured: Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a HTTP/1.1 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTA9gN4uwUUQAj8r-PQ82h_0FCWRbykAOSOK48Mam-DuLp2KGcQEAA89bzJzU17eL8OpFmGTck27aTBPRkyac8v21CswUg_9C2Z6rN97BNjZ73uERJOabCl0xuv8iomWrbLBPMOTkLMSZSsSdFfGY0F1iEZXce2pcD8dJYgEqD-aAaw Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca6518d2053a41bfb4559e063928f91c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: ca6518d2053a41bfb4559e063928f91c Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1283552133 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6f00c88acca24c0fa6497dba45552fc9 Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1283552133-project Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '292f8268-420f-4775-9d18-d8c6f3e41a3a'} Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:01.794856 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] Returning 404 to user: Instance 292f8268-420f-4775-9d18-d8c6f3e41a3a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dde05b7f-f6d5-4323-9c72-6b618561feb3 tempest-ServerRescueNegativeTestJSON-1283552133 tempest-ServerRescueNegativeTestJSON-1283552133-project] 10.222.0.25 "GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a" status: 404 len: 111 microversion: 2.1 time: 0.084922 Sep 23 04:09:01.799362 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2866/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:01 2022] GET /compute/v2.1/servers/292f8268-420f-4775-9d18-d8c6f3e41a3a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:09:01.880976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:01.890647 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c699e2c5-0ce0-40f3-93a3-5231b0262184 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.313857 Sep 23 04:09:01.891680 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2799/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:01 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:02.737331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:02.738117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:02.751194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:02.751954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:02.752827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:02.753742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:02.754894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:02.755492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:02.917006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:02.917666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:02.942329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:02.943080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:02.944913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:02.946912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:02.950402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:02.951076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:03.117806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:03.129680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:03.135189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:03.146323 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-665c0a93-4c6c-48d2-af87-b266a3451126 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1728 microversion: 2.20 time: 0.415380 Sep 23 04:09:03.148105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2867/5666] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:02 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1728 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:03.172383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabd5255-6b96-4596-a6aa-a498ce6eb742", "tag": "f78bdf52-2d95-49c5-8f9a-364302598ee3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:03.205769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:03.206284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:03.206729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:03.232290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:03.236169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] Creating event network-changed:f78bdf52-2d95-49c5-8f9a-364302598ee3 for instance cabd5255-6b96-4596-a6aa-a498ce6eb742 on n-h1-858495-2 Sep 23 04:09:03.248014 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3b56dd06-5781-4ba1-b649-ec7715eda8b7 req-0402e506-a8cb-4a44-ad0e-217686d6732f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079272 Sep 23 04:09:03.251025 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2868/5667] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:03.259971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50dbc706-1e9b-4d57-a9b4-1fdefa487b8d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.347661 Sep 23 04:09:03.262796 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2800/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:02 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:04.188784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:04.190510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:04.211995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:04.211995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:04.211995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:04.212429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:04.218090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:04.218775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:04.286825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:04.288168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:04.299740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:04.301241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:04.302684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:04.303668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:04.304572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:04.305388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:04.558996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:04.559599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:04.567423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:04.569664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:04.571144 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-112108bd-dbc2-44fe-a0b1-79a6207fa2ae tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1715 microversion: 2.20 time: 0.393365 Sep 23 04:09:04.585376 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2869/5669] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:04 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1715 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:04.585558 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6aa7aae9-4ba0-41e2-9104-6e37129e2b5a tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.290890 Sep 23 04:09:04.585558 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2801/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:04 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:05.595998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:05.597134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:05.604836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:05.605613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:05.606205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:05.607093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:05.607716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:05.608295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:05.779249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:05.792118 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2adc6290-da7d-47d1-83f7-e9b6959018b9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.199955 Sep 23 04:09:05.809168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2870/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:05 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:06.820369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:06.821001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:06.839927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:06.842059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:06.845233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:06.846342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:06.847705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:06.849010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:06.849690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:06.850281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:07.120468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:07.143135 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0c07911-1286-421b-8e63-22a5e44476fb tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.330549 Sep 23 04:09:07.145235 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2802/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:06 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:08.168181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:08.168798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:08.172925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:08.183041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:08.183746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:08.187689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:08.188833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:08.189508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:08.190107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:08.383796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:08.397822 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-707d37e6-a28f-45af-aa61-9f98308e82d9 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.233513 Sep 23 04:09:08.411929 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2871/5673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:08 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:09.218081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:09.218621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:09.231579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:09.232090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:09.232774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:09.233524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:09.234154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:09.234945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:09.279961 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54268e0d-d937-40e5-a784-a94164c2cdfb tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/ips" status: 200 len: 144 microversion: 2.1 time: 0.065760 Sep 23 04:09:09.283595 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2803/5674] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:09:09 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/ips => generated 144 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:09.423887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:09.424513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:09.434209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:09.435014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:09.435972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:09.438782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:09.439603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:09.440952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:09.463367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:09.507589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd5255-6b96-4596-a6aa-a498ce6eb742", "name": "network-vif-plugged", "status": "completed", "tag": "f78bdf52-2d95-49c5-8f9a-364302598ee3"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:09.521122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:09.521923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:09.522662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:09.537963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] Creating event network-vif-plugged:f78bdf52-2d95-49c5-8f9a-364302598ee3 for instance cabd5255-6b96-4596-a6aa-a498ce6eb742 on n-h1-858495-2 Sep 23 04:09:09.544342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b6b88d3f-f083-4b4c-8338-e21740cff876 req-7e3b677d-2412-48f8-88e3-84fcaf9f4fdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041986 Sep 23 04:09:09.545948 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2804/5675] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:09.683578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:09.691811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-99e7e651-e236-4d69-a4ca-556794a5dc80 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.272577 Sep 23 04:09:09.692387 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2872/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:09 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:10.719422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:10.720316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:10.734632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:10.735244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:10.735861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:10.736664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:10.739358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:10.741735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:11.031569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:11.048749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-363c1434-f772-4219-91a8-f7e7b47f0484 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1314 microversion: 2.1 time: 0.336128 Sep 23 04:09:11.049971 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2805/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:10 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:12.073148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:12.073923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:12.082886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.083452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.084190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.085044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.085726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.086449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.235228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:12.246058 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b7a95673-9a8f-48e3-86b5-8413288dac7f tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1464 microversion: 2.1 time: 0.177236 Sep 23 04:09:12.265059 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2873/5678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:12 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1464 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:12.309118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-090d0e7a-bace-4223-8cc2-5769469856f4 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b371a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:12.331563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:12.332076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:12.340564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.341077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.341795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.343863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.344958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.345608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.399516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:09:12.403084 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-090d0e7a-bace-4223-8cc2-5769469856f4 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/26f75857-769f-4886-859f-aad6f1f958ed" status: 200 len: 349 microversion: 2.1 time: 0.097044 Sep 23 04:09:12.404371 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2806/5679] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:09:12 2022] GET /compute/v2.1/os-volumes/26f75857-769f-4886-859f-aad6f1f958ed => generated 349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:12.556242 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38249830-d57e-41d0-88bf-14b570659979 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 204 len: 0 microversion: 2.1 time: 0.229565 Sep 23 04:09:12.560406 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2874/5680] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:09:12 2022] DELETE /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:09:12.566332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:12.567237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:12.575324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.576180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.576876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.577894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.578839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.579558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.716046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fee65f6-cdb0-4b12-b574-666934010d23"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:12.718829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:12.727130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.728038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.728734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.729557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:12.730312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:12.731061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:12.838744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:12.847909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df1863e4-0e2a-463b-b36e-c5a890dfe02e tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1470 microversion: 2.1 time: 0.286079 Sep 23 04:09:12.848621 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2807/5681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:12 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:13.115198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-94266380-f762-4ac9-bfd5-83e4f742c7d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403735 Sep 23 04:09:13.116830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2875/5682] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:09:12 2022] POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:09:13.906944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:13.981864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:14.015108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:14.018810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:14.020151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:14.022326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:14.026489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:14.027594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:14.333630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:14.344248 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3974b1f2-0e72-4c27-b647-94189b399c3d tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1470 microversion: 2.1 time: 0.472420 Sep 23 04:09:14.345217 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2808/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:13 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:14.754948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd5255-6b96-4596-a6aa-a498ce6eb742", "name": "network-vif-deleted", "tag": "f78bdf52-2d95-49c5-8f9a-364302598ee3"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:14.790432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:14.791033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:14.791582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:14.824138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] Creating event network-vif-deleted:f78bdf52-2d95-49c5-8f9a-364302598ee3 for instance cabd5255-6b96-4596-a6aa-a498ce6eb742 on n-h1-858495-2 Sep 23 04:09:14.829617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e5575b5d-b377-4cbc-ae0f-0ecd030e0e76 req-3c123d63-430f-40cb-a882-f2a7abd908e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079142 Sep 23 04:09:14.830618 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2876/5684] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:15.151489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b9006f8-5a42-47a9-b418-77503512ecb9 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8a79c8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:15.228522 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b9006f8-5a42-47a9-b418-77503512ecb9 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3863dc54-2d1c-4086-9455-7572b9ba9e1e" status: 200 len: 351 microversion: 2.1 time: 0.080466 Sep 23 04:09:15.229112 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2809/5685] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:09:15 2022] GET /compute/v2.1/os-volumes/3863dc54-2d1c-4086-9455-7572b9ba9e1e => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:09:15.370341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:15.371246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:15.381699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:15.384339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:15.384821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:15.385757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:15.386056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:15.386499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:15.483183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:15.483183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:15.486595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:15.487441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lazy-loading 'fault' on Instance uuid cabd5255-6b96-4596-a6aa-a498ce6eb742 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:09:15.569249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff32234f4a54ab8901d6a26a8e2b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36518138ff4bcfa99826681742ff4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:15.578926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f32fa84-401b-42dc-9b8d-9070664f503b tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 200 len: 1304 microversion: 2.1 time: 0.211870 Sep 23 04:09:15.580458 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2877/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:15 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:16.614214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:16.620064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] [instance: cabd5255-6b96-4596-a6aa-a498ce6eb742] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:16.629966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:16.657550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:16.659424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:16.661143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:16.662122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:16.662778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:16.663460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:16.694531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] HTTP exception thrown: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Request method failure captured: Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 HTTP/1.1 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTFU-i2Lm1eIYgM7UJiEa4drM58OUbNxJPvaIHIOKmp0HvYlVIDPEey97DfRsCOoPA3aRl-Zd9LgtrZJIzQj-atI2zZ3ZkshwG3G4SAWbKzQpuUkzPqIaAy6Etr-A6kw93SaGeF9qpDT9RNzUInVpV43P7xQ2sNNEseld8ikP54Yrm8 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: fe36518138ff4bcfa99826681742ff4b Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesNegativeTest-756017756 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fe36518138ff4bcfa99826681742ff4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fe36518138ff4bcfa99826681742ff4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fe36518138ff4bcfa99826681742ff4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fe36518138ff4bcfa99826681742ff4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesNegativeTest-756017756 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: fe36518138ff4bcfa99826681742ff4b Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesNegativeTest-756017756 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesNegativeTest-756017756-project Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 2ff32234f4a54ab8901d6a26a8e2b3f6 Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesNegativeTest-756017756-project Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cabd5255-6b96-4596-a6aa-a498ce6eb742'} Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:16.704537 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. Sep 23 04:09:16.710112 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:16.712135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] Returning 404 to user: Instance cabd5255-6b96-4596-a6aa-a498ce6eb742 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:16.727638 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9a877da-102b-47c8-8017-4d5072c8cd34 tempest-VolumesNegativeTest-756017756 tempest-VolumesNegativeTest-756017756-project] 10.222.0.25 "GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742" status: 404 len: 111 microversion: 2.1 time: 0.122328 Sep 23 04:09:16.730947 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2810/5687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:16 2022] GET /compute/v2.1/servers/cabd5255-6b96-4596-a6aa-a498ce6eb742 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:09:17.013991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5c18595f-d6aa-4d5a-b84a-f39b8782c065 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b64e280>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:17.113460 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5c18595f-d6aa-4d5a-b84a-f39b8782c065 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4c9f0b8e-6d35-42c4-8e73-e558ee0fb9e4" status: 200 len: 351 microversion: 2.1 time: 0.106922 Sep 23 04:09:17.115047 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2878/5688] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes/4c9f0b8e-6d35-42c4-8e73-e558ee0fb9e4 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:17.127353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-66c9994e-a171-4cda-ab1b-1ad4af0000f0 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8a807dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:17.271154 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-66c9994e-a171-4cda-ab1b-1ad4af0000f0 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.145627 Sep 23 04:09:17.286602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aad324dd-ca0c-4708-a304-94282e840b54 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c933f2f70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:17.287541 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2811/5689] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:17.400927 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aad324dd-ca0c-4708-a304-94282e840b54 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.118443 Sep 23 04:09:17.401527 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2879/5690] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:17.416662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a8dd3b5-c7e5-4aac-a379-24d4babce552 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b142820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:17.542737 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a8dd3b5-c7e5-4aac-a379-24d4babce552 tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.130078 Sep 23 04:09:17.543423 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2812/5691] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:17.563312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d73f22ad-d12b-4a13-be1a-eaf50535de6d tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b45df70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:17.702341 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d73f22ad-d12b-4a13-be1a-eaf50535de6d tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146584 Sep 23 04:09:17.703107 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2880/5692] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:17.720824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d326ffb-6a93-44de-b59f-612a253d657d tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8a7e2dc0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:18.042488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d326ffb-6a93-44de-b59f-612a253d657d tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.327635 Sep 23 04:09:18.050838 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2813/5693] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 23 04:09:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:09:18.061675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e3f28e5-1482-4a9b-9d25-9ad14514403e tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b4035e0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:18.240873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e3f28e5-1482-4a9b-9d25-9ad14514403e tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.184260 Sep 23 04:09:18.242020 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2881/5694] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 04:09:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:18.257604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b502e2ed-b30d-48a5-aa80-d4ceee64e9dd tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b169430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:18.443270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b502e2ed-b30d-48a5-aa80-d4ceee64e9dd tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189744 Sep 23 04:09:18.443866 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2814/5695] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Sep 23 04:09:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:18.459036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06b06d57-52f1-4586-acd1-a9274792723c tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] Calling method '.version_select at 0x7f0c8b5f4b80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:18.618585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06b06d57-52f1-4586-acd1-a9274792723c tempest-VolumesTestJSON-826297686 tempest-VolumesTestJSON-826297686-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164458 Sep 23 04:09:18.619583 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2882/5696] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 23 04:09:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:27.229779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:27.237283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=79 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:27.238620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:27.242822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:27.243554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:27.244701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:27.304730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:09:27.366200 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da0ab7de-57f2-4743-80cc-7b8aea1a90c2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action" status: 202 len: 0 microversion: 2.1 time: 0.139987 Sep 23 04:09:27.368853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2815/5697] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:09:27 2022] POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:09:27.380308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:27.382603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:27.390828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:27.394052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:09:27.408710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:27.410428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:27.411358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:27.412335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:27.413626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:27.414654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:27.665411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:27.678903 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b7f9de4-8db6-49d8-bd52-01ca47f04d1a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.305931 Sep 23 04:09:27.682657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2883/5698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:27 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:28.715819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:28.716758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:28.742010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:28.744857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:28.745849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:28.748705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:28.761474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:28.762305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:29.163467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:29.177940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62e0d7d4-7345-4cb6-bcc0-29241493890a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.469648 Sep 23 04:09:29.181335 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2816/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:28 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:30.220338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:30.220980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:30.229941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:30.230456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:30.231548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:30.232432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:30.233584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:30.234188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:30.459924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:30.477065 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ca592f1-df74-4c12-a689-777fa5f61e15 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.274599 Sep 23 04:09:30.478191 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2884/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:30 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:31.503726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:31.508838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:31.519431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:31.520538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:31.521187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:31.523357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:31.524495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:31.525211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:31.826512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:31.839621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83be4639-5d52-4422-a8f7-8c1f6874f390 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.341254 Sep 23 04:09:31.840750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2817/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:31 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:32.866662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:32.867294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:32.875282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:32.875783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:32.876231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:32.876947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:32.878009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:32.878447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:33.066054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:33.080382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42ee916e-effd-41da-9464-6f2816a12572 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.219440 Sep 23 04:09:33.083342 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2885/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:32 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:34.108252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:34.109553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:34.122379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:34.123075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:34.124269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:34.125468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:34.126734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:34.127214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:34.403653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:34.419198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9ed3138d-cb4b-44d4-931f-3c8864edbda8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.315251 Sep 23 04:09:34.423869 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2818/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:34 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:35.447624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:35.455430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:35.477848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:35.478349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:35.478795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:35.490207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:35.490705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:35.491157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:35.741023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:35.766644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e798a12-005f-4542-b4d1-da517c34b88c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.323378 Sep 23 04:09:35.767580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2886/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:35 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:36.795825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:36.797041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:36.809893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:36.813807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:36.814601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:36.816086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:36.816768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:36.819104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.098916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:37.150233 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba0e12f6-42e5-46a0-9f76-7291ec0ddfd3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1719 microversion: 2.1 time: 0.358180 Sep 23 04:09:37.151312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2819/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:36 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1719 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:37.404702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:37.407683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:37.428182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.428702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.429150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.429925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.430417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.430821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.512412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd61f445-adf7-4fb0-965c-aa589bb53670 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112864 Sep 23 04:09:37.513556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2887/5706] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 23 04:09:37 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:37.651138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:37.651723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:37.666273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.668614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.671427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.672603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.674076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.678694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.724881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:09:37.909253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4ed5d87-a70c-4d3f-9558-36091d72cbb5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 204 len: 0 microversion: 2.20 time: 0.260744 Sep 23 04:09:37.910830 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2820/5707] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:09:37 2022] DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:09:37.929223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:37.930064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:37.944553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.947025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.947578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:37.949077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:37.951671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:37.953906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:38.176902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:38.177653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:38.195325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:38.196160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:38.196574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:38.197288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:38.197829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:38.198192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:38.326787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:38.337965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:38.339435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:38.340628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f95f5cfb-748c-4903-ae14-0fc480b729e5 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.422214 Sep 23 04:09:38.342536 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2888/5708] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:37 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:38.558183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:38.573877 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-049f8642-05d1-48e5-af2e-bbc6b4b061df tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1696 microversion: 2.1 time: 0.402640 Sep 23 04:09:38.575517 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2821/5709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:38 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1696 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:38.600011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:38.609330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:38.609860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:38.610314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:38.670911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Going to try to start instance {{(pid=128724) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:09:38.769769 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c16d3871-d106-447c-b28a-ad3bb60bc0b5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action" status: 202 len: 0 microversion: 2.1 time: 0.171883 Sep 23 04:09:38.772051 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2889/5710] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:09:38 2022] POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:09:38.779952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:38.780210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:38.789072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:38.791220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:38.792335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:38.794757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:38.797833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:38.800662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:39.381264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:39.382197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:39.394314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:39.401682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:39.402261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:39.404347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:39.408936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:39.409596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:39.510581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:39.520960 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b120f767-9520-4780-9f9c-926794b4c19e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1705 microversion: 2.1 time: 0.745919 Sep 23 04:09:39.521603 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2822/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:38 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1705 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:39.739705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:39.750737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:39.761130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:39.763106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90ab7fc5-5ef6-4f64-88da-d538809f3eb6 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.396242 Sep 23 04:09:39.766928 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2890/5712] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:39 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:40.552551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:40.554096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:40.566166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:40.569744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:40.570406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:40.571299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:40.573094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:40.574657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:40.800918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:40.801937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:40.823962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:40.828853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:40.829420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:40.830941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:40.833567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:40.839514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:40.904611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:40.919167 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f31b4701-b86b-4bcf-bbb7-bd9e66d39777 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1705 microversion: 2.1 time: 0.373654 Sep 23 04:09:40.925280 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2823/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:40 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1705 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:09:41.106196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:41.125869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:41.125869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:41.125869 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a570a4b-5070-49f5-932c-9b17beea5b73 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1721 microversion: 2.20 time: 0.330938 Sep 23 04:09:41.129667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2891/5714] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:40 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:09:41.948012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:41.948665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:41.963214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:41.966982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:41.967659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:41.970239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:41.971317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:41.972811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:42.155049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:42.155677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:42.182858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:42.186932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:42.187716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:42.188637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:42.191392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:42.193776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:42.445622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:42.456533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:42.464455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0965ea0e7b6b4e1e86d9c7052130478d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c81796d7a49e08c92dde8fb2a5082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:42.469093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1cce0ee-8bab-4e63-817c-359356a5cc03 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 200 len: 1654 microversion: 2.20 time: 0.320804 Sep 23 04:09:42.473644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2892/5715] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:42 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 1654 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:09:42.497760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:09:42.509417 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a580658-c223-4dda-94ab-083ef8a5a3ea tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1709 microversion: 2.1 time: 0.566077 Sep 23 04:09:42.534945 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2824/5716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:09:41 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1709 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:09:43.002213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f0be9-daf4-46b1-9822-5bd9df558282", "name": "network-vif-deleted", "tag": "8be5e1d8-275a-4f80-8cfc-1e6fae09190b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:09:43.033893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:43.036197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:43.036804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:43.070504 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] Creating event network-vif-deleted:8be5e1d8-275a-4f80-8cfc-1e6fae09190b for instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 on n-h1-858495-2 Sep 23 04:09:43.084713 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-eecb6814-df89-4023-aab0-45437d558731 req-bdfc5658-0b7e-40cf-8d0d-b06e1e2cda93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.607757 Sep 23 04:09:43.088206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2893/5717] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:09:43.497596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:43.498254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:43.519780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:43.520280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:43.520730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:43.521496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:43.521998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:43.522386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:43.554587 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 HTTP/1.1 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6a9f0be9-daf4-46b1-9822-5bd9df558282'} Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:43.561514 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:43.566956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:43.569461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:43.574659 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5510b5d-5afc-471a-a531-bd4d7e10c863 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 404 len: 111 microversion: 2.20 time: 0.077690 Sep 23 04:09:43.576476 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2825/5718] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:43 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:09:43.586570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b3c0773-1b91-4e82-88e9-1ca441cab269 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '.version_select at 0x7f0c8a6ed430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:43.652794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b3c0773-1b91-4e82-88e9-1ca441cab269 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185370387" status: 204 len: 0 microversion: 2.20 time: 0.071301 Sep 23 04:09:43.654115 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2894/5719] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 23 04:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185370387 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:09:48.502749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:48.503420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:48.515635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:48.516133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:48.516574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:48.517839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:48.520540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:48.523625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:48.573859 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 HTTP/1.1 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6a9f0be9-daf4-46b1-9822-5bd9df558282'} Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:48.576318 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.581726 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.583619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:48.584796 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c97b1d4-6172-4543-851d-f318224654fd tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 404 len: 111 microversion: 2.20 time: 0.086858 Sep 23 04:09:48.585958 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2826/5720] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:09:48 2022] DELETE /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:09:48.601303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:48.603341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 6a9f0be9-daf4-46b1-9822-5bd9df558282] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:48.613951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:48.615044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:48.615646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:48.617716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:48.618354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:48.618976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:48.641084 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 HTTP/1.1 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6a9f0be9-daf4-46b1-9822-5bd9df558282'} Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.643831 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. Sep 23 04:09:48.648756 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:48.653441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 6a9f0be9-daf4-46b1-9822-5bd9df558282 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:48.655198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a244f13-ef1d-4b7c-ab3f-303cb2a2eea3 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282" status: 404 len: 111 microversion: 2.20 time: 0.065341 Sep 23 04:09:48.656312 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2895/5721] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:48 2022] GET /compute/v2.1/servers/6a9f0be9-daf4-46b1-9822-5bd9df558282 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:09:53.253913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:53.254443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:53.276517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:53.276918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:53.278584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:53.282269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:53.285673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:53.290259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:53.331187 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 HTTP/1.1 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '74f9860d-c80e-4fed-ba41-76b76d507172'} Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:53.333613 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.338630 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.340706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:53.341672 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e58469d-7102-4b35-bb4e-2de49e64e101 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 404 len: 111 microversion: 2.20 time: 0.092453 Sep 23 04:09:53.342808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2827/5722] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 23 04:09:53 2022] DELETE /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:09:53.351615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:09:53.352393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] [instance: 74f9860d-c80e-4fed-ba41-76b76d507172] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:09:53.379510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:53.380201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:53.380763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:53.382063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:09:53.382664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:09:53.383287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:09:53.435178 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] HTTP exception thrown: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Request method failure captured: Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 HTTP/1.1 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLS-1EtThTCnP_g_I5JHqqasf2PZtsipUFnTh40QgKDRxg9P7Uk9lL8bxUdIzBUUAyFPslzSOSgspJ-TdzJZuvwnnVrfF-O7cI-SjNbuy22erijyoy4JpKqowFKGxoSZzC0QdswbcWLARpIR2ECh591uSEFzDPZmWza6TIiq4MLkk5tE Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_689c81796d7a49e08c92dde8fb2a5082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 689c81796d7a49e08c92dde8fb2a5082 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-635310696 Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0965ea0e7b6b4e1e86d9c7052130478d Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-635310696-project Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '74f9860d-c80e-4fed-ba41-76b76d507172'} Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.442916 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] Returning 404 to user: Instance 74f9860d-c80e-4fed-ba41-76b76d507172 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:09:53.447566 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-783bb35e-d80b-4ff2-9a31-88cdd44c4488 tempest-AttachVolumeShelveTestJSON-635310696 tempest-AttachVolumeShelveTestJSON-635310696-project] 10.222.0.25 "GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172" status: 404 len: 111 microversion: 2.20 time: 0.100003 Sep 23 04:09:53.452131 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2896/5723] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 23 04:09:53 2022] GET /compute/v2.1/servers/74f9860d-c80e-4fed-ba41-76b76d507172 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:10:03.502780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:03.505093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:04.031151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-932e35ed-36e0-4e96-9a94-bfb41ce378fb tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Action: 'create', calling method: .version_select at 0x7f0c8a645f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1210831840", "metadata": {"Type": "work"}}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:04.565896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-932e35ed-36e0-4e96-9a94-bfb41ce378fb tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.073977 Sep 23 04:10:04.576367 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2828/5724] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 23 04:10:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1085 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 04:10:04.581200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3a9702b7-2b19-4e65-8f2b-5fc76c520f33 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a6ed310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:04.603947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:04.604735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:04.700030 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3a9702b7-2b19-4e65-8f2b-5fc76c520f33 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.123274 Sep 23 04:10:04.701109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2897/5725] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:04 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:05.720900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-762ec6a2-9f34-4a30-829e-e6cff381c668 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a839c10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:05.824156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-762ec6a2-9f34-4a30-829e-e6cff381c668 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.112951 Sep 23 04:10:05.832713 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2829/5726] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:05 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:06.839955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6660e83-5b58-4cfe-ac00-fdc74dcd63c1 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8b5f4c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:06.983468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6660e83-5b58-4cfe-ac00-fdc74dcd63c1 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 354 microversion: 2.1 time: 0.148249 Sep 23 04:10:06.984199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2898/5727] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:06 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:06.998943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07c5eef9-7c96-4de2-b17a-5f27fc89f7ea tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a6b4040>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:07.123110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07c5eef9-7c96-4de2-b17a-5f27fc89f7ea tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 354 microversion: 2.1 time: 0.128455 Sep 23 04:10:07.124125 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2830/5728] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:06 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:07.139326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89d39bfe-0579-4c36-a19a-843ba47eec97 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8baa1310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:07.270996 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89d39bfe-0579-4c36-a19a-843ba47eec97 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 202 len: 0 microversion: 2.1 time: 0.135917 Sep 23 04:10:07.271666 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2899/5729] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:10:07 2022] DELETE /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:10:07.280641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ed73f43-6982-473e-b3f4-d55b6d784cef tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a65b8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:07.373420 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ed73f43-6982-473e-b3f4-d55b6d784cef tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.097204 Sep 23 04:10:07.374534 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2831/5730] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:07 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:08.389324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6f68f2d-c711-48c8-905c-7c53fc2f0419 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8b263160>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:08.509323 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6f68f2d-c711-48c8-905c-7c53fc2f0419 tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.124953 Sep 23 04:10:08.510573 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2900/5731] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:08 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:09.526236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b805f4fb-9294-4f25-adfb-f355d39e2bea tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a603b80>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:09.619913 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b805f4fb-9294-4f25-adfb-f355d39e2bea tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.099726 Sep 23 04:10:09.620792 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2832/5732] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:09 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:10.637187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-caeb39ff-8b77-4c48-92e7-4b64e85230ec tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a4f28b0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:10.766875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-caeb39ff-8b77-4c48-92e7-4b64e85230ec tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 200 len: 353 microversion: 2.1 time: 0.134263 Sep 23 04:10:10.768197 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2901/5733] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:10 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:11.785212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-371360fc-88f3-4503-807e-a509de85a6ab tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Calling method '.version_select at 0x7f0c8a5bfc10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:11.851824 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-371360fc-88f3-4503-807e-a509de85a6ab tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] HTTP exception thrown: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-371360fc-88f3-4503-807e-a509de85a6ab tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Request method failure captured: Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea HTTP/1.1 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTGbbbjra5o5ixV7rjHjWk6AxEEY4-6MJyMkMyTxZa-xg2t-3wtut47mPfhZf_YO044bVSgebLo2YhKbVsU10x-mPw9eL18E_qoxTzyhTO__Qc3NZ0ythCPyzxonDXCPmXIelNaW6SdFZULnS1FriHfBrk7l9CVqm10WjSWwzvGZHp4 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 97553f6cb2394bb087bd5448b84846c5 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesGetTestJSON-1779232485 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97553f6cb2394bb087bd5448b84846c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97553f6cb2394bb087bd5448b84846c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97553f6cb2394bb087bd5448b84846c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97553f6cb2394bb087bd5448b84846c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesGetTestJSON-1779232485 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 97553f6cb2394bb087bd5448b84846c5 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesGetTestJSON-1779232485 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesGetTestJSON-1779232485-project Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f2ecdbe0f45d49e0828c801b6018d884 Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesGetTestJSON-1779232485-project Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: exception: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '09f5e763-3e16-4214-8ba2-6bb603517fea'} Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. (HTTP 404) (Request-ID: req-1e726fa3-af20-4f46-aeac-ac45fed8997a) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:10:11.854554 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. Sep 23 04:10:11.858952 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:10:11.865482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-371360fc-88f3-4503-807e-a509de85a6ab tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] Returning 404 to user: Volume 09f5e763-3e16-4214-8ba2-6bb603517fea could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:10:11.865482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-371360fc-88f3-4503-807e-a509de85a6ab tempest-VolumesGetTestJSON-1779232485 tempest-VolumesGetTestJSON-1779232485-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea" status: 404 len: 109 microversion: 2.1 time: 0.083714 Sep 23 04:10:11.865482 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2833/5734] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:10:11 2022] GET /compute/v2.1/os-volumes/09f5e763-3e16-4214-8ba2-6bb603517fea => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:10:20.914625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd12c770-d56b-4d96-9d4b-dc80b928059e tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Action: 'create', calling method: .version_select at 0x7f0c8b263160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1254601521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjUEWi4yovzH3xgMaN2MsaqJQZcMqy14S1YM6s3ujzHY80Uud89/qohFiBRSzVUsvMGsJsWftDyCjhOW7ngCIFAzJ/YMBSkjq4LcDoAt73aj44Innm7PWW3Rw8eGjcGAA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:20.949100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-bd12c770-d56b-4d96-9d4b-dc80b928059e tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:10:20.968362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-bd12c770-d56b-4d96-9d4b-dc80b928059e tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for user 7de743dbd1f94ab48b992d9696a710ab and project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:10:21.038634 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd12c770-d56b-4d96-9d4b-dc80b928059e tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.928341 Sep 23 04:10:21.039635 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2902/5735] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:10:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:23.966566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-416101996", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1254601521", "security_groups": [{"name": "tempest-secgroup-smoke-1145606256"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "879acd09-d3b5-42f1-9768-2486115057aa"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:24.284478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] validate_networks() for [('879acd09-d3b5-42f1-9768-2486115057aa', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:10:25.275966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:10:25.300576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for user 7de743dbd1f94ab48b992d9696a710ab and project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: dict_keys(['metadata_items']) {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:10:25.333981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:10:25.341017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:10:25.341709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:10:25.343169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:10:25.343745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:10:25.369544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:25.371786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:25.373086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:25.376309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:25.376875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:25.377419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:25.409645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:10:25.417872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Getting quotas for user 7de743dbd1f94ab48b992d9696a710ab and project 8da0fb42f40b42a086a4ae7e2e6473de. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:10:25.433758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:10:25.436777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:10:25.636822 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-941de9bf-f00b-4a4f-8b24-d97c51fa523a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.683282 Sep 23 04:10:25.642236 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2834/5736] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:10:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:10:25.649734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72d67301-ac3a-4806-a6ec-3c08a47cd601 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:25.650361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72d67301-ac3a-4806-a6ec-3c08a47cd601 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:26.008775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72d67301-ac3a-4806-a6ec-3c08a47cd601 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:26.025960 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72d67301-ac3a-4806-a6ec-3c08a47cd601 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1302 microversion: 2.1 time: 0.380991 Sep 23 04:10:26.026581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2903/5737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:25 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1302 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:26.847256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a3c5f88-1483-42af-9553-b3c21c87f6c1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: .version_select at 0x7f0c8a839280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1710817650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5kHkGG0Gn/0FEypyPl/K+GJEphui9mYoNXyhpWETz32K5EHvJtZrLoKeOQPNCNufNt00+06sOZ+AKQRiCv9k1K/9a+tN8QpJWkDR5lOoLr/Hj4nC/aQmfzzlGIhYXa2w=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:26.912074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3a3c5f88-1483-42af-9553-b3c21c87f6c1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:10:26.936383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3a3c5f88-1483-42af-9553-b3c21c87f6c1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:10:27.042179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a3c5f88-1483-42af-9553-b3c21c87f6c1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.197627 Sep 23 04:10:27.060532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:27.061447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:27.070691 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2835/5738] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:10:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:27.082007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:27.082705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:27.085428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:27.086729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:27.087983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:27.088635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:27.234594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:27.255067 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eeddb8ca-edac-4ca3-ac01-325689974849 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1354 microversion: 2.1 time: 0.198566 Sep 23 04:10:27.256460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2904/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:27 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:28.283047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:28.283988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:28.302949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:28.312602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:28.315849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:28.316750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:28.318199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:28.324185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:28.573181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:28.589951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ac72516a-1a15-48b4-8cde-265138110d0a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1360 microversion: 2.1 time: 0.313494 Sep 23 04:10:28.598400 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2836/5740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:28 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:29.620560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:29.621175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:29.641754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:29.642275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:29.642736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:29.643477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:29.643942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:29.644377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:29.812505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:29.823584 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-588f1ec2-99cf-45d8-be78-1c1cc51d18eb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1360 microversion: 2.1 time: 0.208414 Sep 23 04:10:29.824977 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2905/5741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:29 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1360 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:30.682677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1542876468", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1b598a16-dcb0-49b3-9239-44e24af04195"}], "key_name": "tempest-TestNetworkBasicOps-1710817650", "security_groups": [{"name": "tempest-secgroup-smoke-1421755253"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:30.848836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:30.849525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:30.872382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:30.872775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:30.873217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:30.873968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:30.874967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:30.875402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:30.994629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] validate_networks() for [('1b598a16-dcb0-49b3-9239-44e24af04195', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:10:31.503201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:31.511166 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2b7f4f15-20f9-46b8-9e67-e9856885b409 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.666389 Sep 23 04:10:31.514434 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2906/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:30 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:32.072770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:10:32.073226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:10:32.073778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:10:32.074263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:10:32.074794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:10:32.095913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:32.096329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:32.096786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:32.101999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:32.102610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:32.102972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:32.148863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:10:32.164965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:10:32.196531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:10:32.201818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:10:32.316617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aa459c28-fe82-48e8-a688-c98f1727b8e5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.637723 Sep 23 04:10:32.317745 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2837/5743] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:10:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:10:32.329386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d327da8-4786-4109-9962-f6b3b7c7f4e2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:32.331348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d327da8-4786-4109-9962-f6b3b7c7f4e2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:32.442789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d327da8-4786-4109-9962-f6b3b7c7f4e2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:32.479811 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d327da8-4786-4109-9962-f6b3b7c7f4e2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1249 microversion: 2.1 time: 0.154872 Sep 23 04:10:32.480801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2907/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:32 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1249 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:32.541255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:32.542955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:32.589590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:32.590120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:32.595100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:32.597066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:32.597920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:32.601177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:32.903088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:32.919379 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-601e58ac-4c92-498a-af18-5fb0917233d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.385896 Sep 23 04:10:32.925598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2838/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:32 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:33.012651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2789b6-fc1d-4ae8-99d4-43719f865d99", "tag": "8407317e-0415-434b-8811-5ffa6eb47047"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:33.032839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:33.033543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:33.034293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:33.058105 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] Creating event network-changed:8407317e-0415-434b-8811-5ffa6eb47047 for instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 on n-h1-858495-2 Sep 23 04:10:33.074353 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a65d40d7-e6bc-4d15-893d-a87506e68805 req-a1102278-ed34-40de-8dd3-388f619734d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063251 Sep 23 04:10:33.075322 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2908/5746] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:33.522864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:33.524622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:33.541512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:33.542033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:33.543366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:33.545808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:33.546905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:33.547362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:33.694427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:33.703617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11709e0f-5b4a-4f19-be02-c01e55a0be5d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1245 microversion: 2.1 time: 0.201163 Sep 23 04:10:33.729904 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2839/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:33 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1245 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:33.944693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:33.945540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:33.957390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:33.957908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:33.958358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:33.959082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:33.959547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:33.959986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:34.290088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:34.305964 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f163de0-0bc7-417c-808b-ef30bbbc6410 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.362795 Sep 23 04:10:34.306907 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2909/5748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:33 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:34.746142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:34.747352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:34.759427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:34.765342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:34.770178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:34.771845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:34.772500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:34.773096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:35.162243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:35.174745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-571f383e-7125-4971-bcc3-d90e63862ef2 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1307 microversion: 2.1 time: 0.432538 Sep 23 04:10:35.194544 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2840/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:34 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:35.331307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:35.331933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:35.351171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:35.351741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:35.353728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:35.354946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:35.356479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:35.356625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:35.706607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:35.719250 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6fac7a1-8963-4cf3-a727-c9b491914dbd tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.392922 Sep 23 04:10:35.720840 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2910/5750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:35 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:36.203067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:36.204339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:36.233135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:36.235809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:36.236566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:36.237588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:36.238257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:36.238889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:36.575092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:36.587556 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10486361-acd7-43ff-a3da-7bfb70e97b42 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.388323 Sep 23 04:10:36.588612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2841/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:36 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:36.744655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:36.745265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:36.757610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:36.758344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:36.759277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:36.760513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:36.762890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:36.763514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:37.240561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:37.261106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8e73c37-1463-46da-b3b7-1857911ae7f2 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.520624 Sep 23 04:10:37.277918 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2911/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:36 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:37.612103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:37.612732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:37.627526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:37.628044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:37.628503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:37.629239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:37.630714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:37.631171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:37.771137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:37.774207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:37.783956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:37.785456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:37.786315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:37.788323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:37.789058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:37.790039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:37.958655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lazy-loading 'services' on Instance uuid 6741243b-b27c-4e67-a424-085ca4b2692e {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:10:38.052812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:38.062338 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ae5527e5-1323-48d3-9924-0493fd490208 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.455245 Sep 23 04:10:38.062954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2842/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:37 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:38.128473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cb3aea54-ea09-4f71-b2b6-74705cadaa37 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments/1fee65f6-cdb0-4b12-b574-666934010d23" status: 202 len: 0 microversion: 2.1 time: 0.364375 Sep 23 04:10:38.129449 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2912/5754] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:10:37 2022] DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments/1fee65f6-cdb0-4b12-b574-666934010d23 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:10:38.291090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:38.292102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:38.306906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:38.308289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:38.310112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:38.311419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:38.314002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:38.316866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:38.434839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687f048d-d268-448c-b90d-ba1471499a70", "tag": "30a9f312-ba0c-481d-8231-0b2189045f14"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:38.450973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:38.453399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:38.455218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:38.483883 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] Creating event network-changed:30a9f312-ba0c-481d-8231-0b2189045f14 for instance 687f048d-d268-448c-b90d-ba1471499a70 on n-h2-858495-2 Sep 23 04:10:38.494961 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a73c0509-7ef6-46a6-a8d7-39e801f1364a req-c2dda95d-4144-4b78-8936-383bc90be8a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429696 Sep 23 04:10:38.496979 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2843/5755] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:38.596538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:38.604398 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6347f8fe-1e70-4147-9a18-8a33b4b3446b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.320696 Sep 23 04:10:38.605084 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2913/5756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:38 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:10:39.088953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:39.089925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:39.097804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:39.098380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:39.098903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:39.099692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:39.100244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:39.100923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:39.395154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:39.403490 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-224cd459-c875-4bd7-8f9b-a3cb97a20f46 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.318764 Sep 23 04:10:39.404257 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2844/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:39 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:39.629168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:39.630556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:39.640168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:39.641081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:39.641632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:39.642597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:39.643263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:39.643763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:39.855975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2789b6-fc1d-4ae8-99d4-43719f865d99", "name": "network-vif-plugged", "status": "completed", "tag": "8407317e-0415-434b-8811-5ffa6eb47047"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:39.868000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:39.871256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:39.876790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:39.903339 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] Creating event network-vif-plugged:8407317e-0415-434b-8811-5ffa6eb47047 for instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 on n-h1-858495-2 Sep 23 04:10:39.919337 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9fa901d0-2d27-42b2-813e-0248b7787ce1 req-fce275f9-8f19-4bbc-816c-bf984f9b6f0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067648 Sep 23 04:10:39.926230 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2845/5758] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:39.990735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:40.006843 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f155c942-c78f-4503-a19e-0d429d69098a tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.383612 Sep 23 04:10:40.008434 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2914/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:39 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:10:40.434741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:40.437725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:40.447432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:40.448504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:40.449559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:40.450732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:40.451517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:40.466593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:40.694978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:40.705315 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37dad192-9b79-46b1-a101-58e48190cb90 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.279343 Sep 23 04:10:40.706060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2846/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:40 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:41.037323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:41.038679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:41.065925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:41.069672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:41.072101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:41.073060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:41.075123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:41.081090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:41.735878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:41.737578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:41.754874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:41.755382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:41.755891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:41.756540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:41.757009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:41.768249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:41.792166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:41.803028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7fbf2d0a-63e0-4674-8bfb-59d0c624d929 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1428 microversion: 2.1 time: 0.770567 Sep 23 04:10:41.805834 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2915/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:41 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1428 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:42.127604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:42.184313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:42.192939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:42.201093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40b8ee01-2a33-4c58-8a2a-1d20a6959ef0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.471764 Sep 23 04:10:42.215029 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2847/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:41 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:42.832980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:42.833712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:42.844270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:42.848925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:42.849455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:42.849905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:42.854040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:42.855939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:42.856580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.101927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:43.115875 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58ae8f62-b3b9-4f74-a104-6fd88f132deb tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1609 microversion: 2.1 time: 0.286900 Sep 23 04:10:43.117277 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2916/5763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:42 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1609 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:43.139698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:43.141639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:43.150625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.151431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.152588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.153593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.154287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.155504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.230289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:43.231218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:43.246872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.249573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.254602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.256990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.259245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.259945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.714116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:43.730680 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8cd1e316-3631-413c-97e1-669f71dbeee3 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1609 microversion: 2.1 time: 0.595101 Sep 23 04:10:43.732427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2848/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:43 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1609 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:43.738253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687f048d-d268-448c-b90d-ba1471499a70", "name": "network-vif-plugged", "status": "completed", "tag": "30a9f312-ba0c-481d-8231-0b2189045f14"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:43.751637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.752336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.753009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.773725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:43.782010 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-626ef344-b6e9-4ca7-ade6-c13cd4fefab6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.555911 Sep 23 04:10:43.792276 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] Creating event network-vif-plugged:30a9f312-ba0c-481d-8231-0b2189045f14 for instance 687f048d-d268-448c-b90d-ba1471499a70 on n-h2-858495-2 Sep 23 04:10:43.792437 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2917/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:43 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:43.804687 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3f0090e6-d131-450b-8738-96812b5d70b0 req-359aadd7-818c-479f-ba01-6a7078de58b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070616 Sep 23 04:10:43.807437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:43.808062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:43.808562 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2849/5766] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:43.814921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.815436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.815836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:43.816545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:43.817002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:43.817571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:44.135205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:44.149448 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd555b4f-c616-4747-b66d-16f2a3a3ce4b tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1609 microversion: 2.1 time: 0.355547 Sep 23 04:10:44.168010 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2918/5767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:43 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1609 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:44.811586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:44.812299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:44.832666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:44.837345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:44.838044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:44.838692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:44.839658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:44.840009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:45.072707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:45.081747 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8975334e-33c7-485a-8783-b85fd8911aa9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1375 microversion: 2.1 time: 0.275345 Sep 23 04:10:45.082349 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2850/5768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:44 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1375 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:45.489646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:45.498525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:45.499295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:45.499955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:45.564723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Going to try to stop instance {{(pid=128724) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:10:45.633080 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3ebf1b4-c36e-468b-a55e-f6861d0d095b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action" status: 202 len: 0 microversion: 2.1 time: 0.158410 Sep 23 04:10:45.638106 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2919/5769] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:10:45 2022] POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:10:45.663767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:45.671636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:45.694696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:45.696745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:45.697393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:45.699007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:45.702511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:45.704029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:46.106596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:46.107223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:46.118211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:46.119421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:46.120282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:46.121421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:46.122449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:46.124396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:46.153675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:46.209548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:46.218878 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d27b86a-4b93-446f-9623-d9e6a10b4963 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.579692 Sep 23 04:10:46.233829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2851/5770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:45 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:46.422437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:46.443451 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-070bab1b-5b90-4399-bf78-fb9171e8d292 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1547 microversion: 2.1 time: 0.334827 Sep 23 04:10:46.450277 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2920/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:46 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1547 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:10:46.468270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:46.469050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:46.486636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:46.487429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:46.488142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:46.489104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:46.489806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:46.490473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:46.800416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:46.814534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-753a9c50-31d4-4699-8a8b-cbebb5f812b0 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1547 microversion: 2.1 time: 0.351443 Sep 23 04:10:46.816943 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2852/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:46 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1547 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:47.246538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:47.249096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:47.259629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:47.260423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:47.261038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:47.263212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:47.263865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:47.264493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:47.626062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2789b6-fc1d-4ae8-99d4-43719f865d99", "tag": "8407317e-0415-434b-8811-5ffa6eb47047"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:47.628136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:47.639729 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a0d8f7f-f039-4e49-b8c8-764418d0381c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.398364 Sep 23 04:10:47.643547 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2921/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:47 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:47.645055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:47.645751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:47.646337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:47.661046 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] Creating event network-changed:8407317e-0415-434b-8811-5ffa6eb47047 for instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 on n-h1-858495-2 Sep 23 04:10:47.670641 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0f9c56b6-7609-494f-8e44-23452f5529e4 req-d256f34d-6537-422d-9c49-848291012c65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049554 Sep 23 04:10:47.672774 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2853/5774] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:48.665293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:48.666084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:48.679091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:48.679875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:48.682320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:48.683407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:48.684051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:48.685419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:49.070259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:49.078881 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66141a5a-a254-405c-a1f4-6850310d4d5b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.418621 Sep 23 04:10:49.079456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2922/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:48 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:50.111390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:50.112098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:50.127992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:50.128482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:50.128929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:50.129686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:50.130149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:50.130579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:50.526888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:50.538239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d365ba94-b210-41a9-b028-d27a9d1cdec8 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.431945 Sep 23 04:10:50.555136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2854/5776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:50 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:51.124508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687f048d-d268-448c-b90d-ba1471499a70", "tag": "30a9f312-ba0c-481d-8231-0b2189045f14"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:51.143768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:51.148154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:51.149528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:51.150646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:51.177872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] Creating event network-changed:30a9f312-ba0c-481d-8231-0b2189045f14 for instance 687f048d-d268-448c-b90d-ba1471499a70 on n-h2-858495-2 Sep 23 04:10:51.187545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c53a37ef-7604-4d2b-8ff1-05e63e3513c9 req-1ba29605-7a45-41a1-873f-1e856831d1c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072941 Sep 23 04:10:51.188657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2923/5777] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:10:51.575613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:51.577571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:51.588659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:51.590532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:51.592498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:51.596352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:51.598725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:51.600214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:51.635226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:51.837940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:51.853047 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31024ff5-5616-4dd3-9561-70d402b764ba tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.278738 Sep 23 04:10:51.856076 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2855/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:51 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:52.894799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:52.895521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:52.901873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:52.902367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:52.903012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:52.903729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:52.904198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:52.904635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:53.124367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:53.138564 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71ee4859-5892-4fd2-a503-6707348af616 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.250593 Sep 23 04:10:53.139770 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2924/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:52 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:54.162643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:54.163605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:54.167869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:10:54.175858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:54.175858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:54.175858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:54.175858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:54.176592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:54.176592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:54.328496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:54.336466 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e22456f-4f97-4caf-bc1c-c63d45d87885 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.178170 Sep 23 04:10:54.337243 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2856/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:54 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:55.360906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:55.361564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:55.381735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:55.383181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:55.383759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:55.384474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:55.384935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:55.385642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:55.689945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:55.702330 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cda8cd4a-5c9c-40e6-af27-d4b6dd8604b4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1673 microversion: 2.1 time: 0.345090 Sep 23 04:10:55.703204 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2925/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:55 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1673 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:56.726380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:56.727012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:56.734248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:56.734777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:56.735627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:56.736184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:56.736673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:56.737110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:56.989608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:56.999134 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-525c6552-b09b-44b8-91f4-66c3b868c0a6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1650 microversion: 2.1 time: 0.277080 Sep 23 04:10:57.000069 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2857/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:56 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1650 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:57.023029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:10:57.030457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:57.031184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:57.031842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:57.056505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Going to try to start instance {{(pid=128724) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:10:57.108299 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4ba8d6f-6ce5-4f88-ad79-86548a8efec0 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action" status: 202 len: 0 microversion: 2.1 time: 0.087250 Sep 23 04:10:57.110916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2926/5783] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:10:57 2022] POST /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:10:57.119459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:57.120345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:57.129097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:57.130855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:57.131483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:57.132746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:57.133204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:57.133883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:57.471005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:57.481436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0883dc96-200d-4622-8564-dc9d03a65f42 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1659 microversion: 2.1 time: 0.365741 Sep 23 04:10:57.482737 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2858/5784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:57 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1659 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:10:58.507325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:58.508127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:58.515487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:58.515981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:58.516423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:58.517135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:58.517623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:58.518851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:58.769995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:10:58.782089 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d2d8e81-5daf-466a-8c1f-7d0ca58de184 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1659 microversion: 2.1 time: 0.278998 Sep 23 04:10:58.782671 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2927/5785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:58 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1659 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:10:59.806322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:10:59.807421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:10:59.815283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:59.816142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:59.816375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:10:59.817940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:10:59.818111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:10:59.818623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:00.047646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:11:00.061510 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0a19202-4155-41cf-927f-53cb73e3890f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1663 microversion: 2.1 time: 0.258600 Sep 23 04:11:00.061739 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2859/5786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:10:59 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1663 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:11:21.505575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:11:21.507741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:11:21.514766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:21.516050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:21.518078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:21.518647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:21.519266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:21.520704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:21.521966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:21.522560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:21.612949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-414c2ff3-31f5-4a3b-8172-953c8af02453 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70/action" status: 200 len: 24547 microversion: 2.1 time: 0.113797 Sep 23 04:11:21.618564 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2928/5787] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:11:21 2022] POST /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70/action => generated 24547 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:11:22.790251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:11:22.791504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:11:22.794709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=7 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:22.795845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=26 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:22.803107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:22.803660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:22.804139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:22.804937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:22.805686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:22.805914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:22.836411 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2f0b0ca-aa65-4393-aa26-f6c2007d532f tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051108 Sep 23 04:11:22.837812 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2860/5788] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Sep 23 04:11:22 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99/os-server-password => generated 116 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:11:23.661312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Calling method '.version_select at 0x7f0c8aa3ff70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:11:23.663533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:23.664126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:23.664680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:23.683027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:23.684416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:23.685069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:23.698490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:23.699175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:23.700436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:23.708449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-db59d3ce-01e6-470b-9e90-2c6d9ea32fc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236 tempest-PortsAdminExtendedAttrsIpV6TestJSON-616742236-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.190405 Sep 23 04:11:23.709212 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2929/5789] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:11:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:11:32.929672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:32.931179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:11:33.145834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Calling method '.version_select at 0x7f0c8b371a60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:11:33.148145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:33.148709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:33.149168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:33.166677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:33.167558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:33.168721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:33.199229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:11:33.199745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:11:33.200198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:11:33.212111 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa3af2dd-4878-41e0-b3dd-a7f4db327e7e tempest-PortsAdminExtendedAttrsTestJSON-222840721 tempest-PortsAdminExtendedAttrsTestJSON-222840721-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.288152 Sep 23 04:11:33.212727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2861/5790] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:11:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:03.243047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:03.246262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:03.250805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:03.251608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=10 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:03.261777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.266361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.268680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.272176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.272755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.273275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.403629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eff7889b-2c37-4616-9488-3a8d06990ea1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164693 Sep 23 04:12:03.410725 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2930/5791] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:12:03 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:12:03.526878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:03.529110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:03.532526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:03.533858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:03.544927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.546710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.547553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.549716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.550418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.551042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.590860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:12:03.714656 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49d43e65-7bcf-466b-9c81-ddc08ec8c82a tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 204 len: 0 microversion: 2.1 time: 0.191741 Sep 23 04:12:03.715859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2862/5792] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:12:03 2022] DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:12:03.726841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:03.726841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:03.738060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.738782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.739581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.740341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:03.740932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:03.741802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:03.956371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:03.990807 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-099ae4f3-0be7-4441-9e10-6a480565d66e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1669 microversion: 2.1 time: 0.270389 Sep 23 04:12:03.997227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2931/5793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:03 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:05.020334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:05.022088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:05.033194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:05.034402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:05.035884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:05.037238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:05.039345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:05.046717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:05.364610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:05.375869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fd5f462-7ec0-413d-a28f-a7531da88182 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1669 microversion: 2.1 time: 0.361882 Sep 23 04:12:05.377763 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2863/5794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:05 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:05.499971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ce79374-f4a3-42df-b848-76b8672fb768 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: .version_select at 0x7f0c8b1dc160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1558947281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLg5xf+uqYCgBWYBbPIaPxuUU9txHBhBJ87zqkZRmzxxSUPwqvg/FCpAcxjx6ZTlLS9GK+2XC0jnFWuLXDXlQYE7l5GaxoA+fRKBU/kyA51OlSAGjVahTv03xV2V8TiLw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:05.527854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0ce79374-f4a3-42df-b848-76b8672fb768 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:12:05.538181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-0ce79374-f4a3-42df-b848-76b8672fb768 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:12:05.580346 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ce79374-f4a3-42df-b848-76b8672fb768 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089219 Sep 23 04:12:05.581085 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2932/5795] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:12:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:06.402667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:06.404649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:06.413175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:06.413945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:06.423676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:06.426691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:06.428112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:06.428925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:07.046616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:07.057412 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-206e3905-acbf-41cf-84ce-f1237cda2b0d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1669 microversion: 2.1 time: 0.658891 Sep 23 04:12:07.080942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2864/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:06 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1669 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:08.090117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:08.090738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:08.100922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:08.101446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:08.101963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:08.102674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:08.103165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:08.104244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:08.293005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:08.305106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58eae500-6ea6-4439-98ec-244478067d8b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 200 len: 1602 microversion: 2.1 time: 0.218478 Sep 23 04:12:08.326213 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2933/5797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:08 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 1602 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:08.360349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6741243b-b27c-4e67-a424-085ca4b2692e", "name": "network-vif-deleted", "tag": "8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:08.380028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:08.380858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:08.381613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:08.418739 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] Creating event network-vif-deleted:8fb3cf6e-4c3d-4caf-805e-55bb0c5aa061 for instance 6741243b-b27c-4e67-a424-085ca4b2692e on n-h2-858495-2 Sep 23 04:12:08.438924 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8ade2f07-bff2-4358-a8a8-2de24bd53230 req-6f876140-bee3-471f-9ccc-f704b38f55c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084646 Sep 23 04:12:08.449906 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2865/5798] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:12:09.337108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:09.350666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:09.393337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:09.398303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:09.399714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:09.403807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:09.404811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:09.405497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:09.515892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1279220642", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "3aafcc4d-84d0-4773-921c-0924f8fcb324"}], "key_name": "tempest-TestNetworkBasicOps-1558947281", "security_groups": [{"name": "tempest-secgroup-smoke-1856145794"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:09.519062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e HTTP/1.1 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6741243b-b27c-4e67-a424-085ca4b2692e'} Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:12:09.530842 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:12:09.539311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47309bcc-cc2e-4950-8a05-2fbab4a92edd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 404 len: 111 microversion: 2.1 time: 0.203329 Sep 23 04:12:09.546263 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2934/5799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:09 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:12:09.560183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9363ad3-29da-4152-9167-2748568a2b1d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '.version_select at 0x7f0c8b10c820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:09.637281 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9363ad3-29da-4152-9167-2748568a2b1d tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-253126218" status: 202 len: 0 microversion: 2.1 time: 0.089840 Sep 23 04:12:09.637934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2935/5800] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 04:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-253126218 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:12:10.211027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] validate_networks() for [('3aafcc4d-84d0-4773-921c-0924f8fcb324', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:12:12.030506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:12:12.031289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:12:12.031529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:12:12.031887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:12:12.032646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:12:12.049192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:12.049718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:12.050174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:12.050902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:12.051370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:12.051802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:12.097241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:12:12.113454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:12:12.135784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:12:12.145045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:12:12.238717 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-beb40fb9-700e-4a80-8bcd-2b42fb855ca1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.727144 Sep 23 04:12:12.239391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2866/5801] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:12:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:12:12.252161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e4a79b4-843a-4d6a-871b-31b35e8fa8bf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:12.253801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e4a79b4-843a-4d6a-871b-31b35e8fa8bf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:12.421567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e4a79b4-843a-4d6a-871b-31b35e8fa8bf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:12.429323 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e4a79b4-843a-4d6a-871b-31b35e8fa8bf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1249 microversion: 2.1 time: 0.182146 Sep 23 04:12:12.434833 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2936/5802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:12 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1249 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:12.785212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab6679f9-f501-4efe-b36f-bb14f604ccbc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: .version_select at 0x7f0c8a595430>, body: {"keypair": {"name": "tempest-keypair-940197245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WtccSsnJEXz/x0VSBCnm5pj4aDRgKy7O/PsoarD41iB4GgdugtS422pcBdAwun9Rj5BP94IaN+LUn8uj/RPemnuRspFsR+T04BujEHQNXQd67RN2/YxsFb6VoVm81XQ=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:12.819426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ab6679f9-f501-4efe-b36f-bb14f604ccbc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for project 0bfd88f113124be8892a9c850eb992e2. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:12:12.827161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ab6679f9-f501-4efe-b36f-bb14f604ccbc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for user 14fc1741357b4427a9fa52488a7e99dc and project 0bfd88f113124be8892a9c850eb992e2. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:12:12.885136 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab6679f9-f501-4efe-b36f-bb14f604ccbc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103114 Sep 23 04:12:12.886379 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2867/5803] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:12:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:13.459393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:13.460597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:13.473775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:13.475825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:13.479824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:13.481554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:13.485255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:13.485748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:13.683321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:13.698899 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4af54e4f-b799-4954-aefc-0a5aed599aad tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1301 microversion: 2.1 time: 0.244853 Sep 23 04:12:13.699515 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2937/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:13 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1301 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:14.724384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:14.734505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:14.754359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:14.756822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:14.761741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:14.768424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:14.769214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:14.772958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:14.939048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:14.956266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0924583-a214-43f3-af2e-fff3a1b95cf9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1307 microversion: 2.1 time: 0.234874 Sep 23 04:12:14.970381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2868/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:14 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:15.985279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:15.985953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:16.003431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:16.003938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:16.004386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:16.005289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:16.005783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:16.006226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:16.208571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:16.222920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a055f9f6-1742-4ef1-9697-3a51c76d0c0d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1307 microversion: 2.1 time: 0.242387 Sep 23 04:12:16.224249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2938/5806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:15 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:17.251977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:17.253938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:17.282269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:17.290475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:17.291377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:17.292493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:17.293247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:17.293959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:18.130634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:18.161482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2097e3f2-fc35-4fe9-b0f3-30d0293382f7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.916719 Sep 23 04:12:18.163530 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2869/5807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:17 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:19.082079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-617810704", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9cbc138-68e0-4aed-be63-6698f9c17d51"}], "security_groups": [{"name": "tempest-securitygroup--1459577011"}], "key_name": "tempest-keypair-940197245", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:19.189622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:19.190805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:19.205622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:19.206484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:19.207067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:19.207915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:19.213861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:19.214487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:19.540243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] validate_networks() for [('a9cbc138-68e0-4aed-be63-6698f9c17d51', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:12:19.817173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:19.829649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b87097e-d798-46c2-bd61-8d735d3a95bc tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.643970 Sep 23 04:12:19.831045 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2870/5808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:19 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:20.604438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:12:20.604866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:12:20.605341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:12:20.605775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:12:20.606188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:12:20.616205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:20.616691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:20.617135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:20.617965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:20.618957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:20.619581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:20.638314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for project 0bfd88f113124be8892a9c850eb992e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:12:20.644044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Getting quotas for user 14fc1741357b4427a9fa52488a7e99dc and project 0bfd88f113124be8892a9c850eb992e2. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:12:20.657582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:12:20.660032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:12:20.713550 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [a2932ab4-9f68-4dd1-b44b-5f73abfbbbee] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:12:20.860600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:20.861688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:20.879734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:20.880232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:20.881127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:20.888192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:20.889793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:20.890446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:21.268293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:21.282857 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8a602d10-61c5-4907-b043-7bd68dceef1b tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.432018 Sep 23 04:12:21.285374 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2871/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:20 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:12:21.318674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca02e734-3142-484a-b918-d4da83e07011", "tag": "c09fb7fd-0a26-4b25-866d-03d499c94939"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:21.364254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:21.364890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:21.365731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:21.383351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] Creating event network-changed:c09fb7fd-0a26-4b25-866d-03d499c94939 for instance ca02e734-3142-484a-b918-d4da83e07011 on n-h1-858495-2 Sep 23 04:12:21.390772 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c7e1336b-d70c-4b41-9b5e-ff39d1169bd7 req-a8b9f3c2-b79d-4ef6-b95b-f2110e058074 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084767 Sep 23 04:12:21.392644 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2872/5810] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:21.722964 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [a2932ab4-9f68-4dd1-b44b-5f73abfbbbee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60830. Sep 23 04:12:21.729098 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3837edaa-b137-4628-bd60-39c2261d399b tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.651289 Sep 23 04:12:21.730089 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2939/5811] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:12:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:12:21.754014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-633d1b9d-02c5-4928-a54c-be2d6b9e7851 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:21.754781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-633d1b9d-02c5-4928-a54c-be2d6b9e7851 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:22.079611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:22.314044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:22.315142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:22.316620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-633d1b9d-02c5-4928-a54c-be2d6b9e7851 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:22.325336 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-633d1b9d-02c5-4928-a54c-be2d6b9e7851 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1236 microversion: 2.1 time: 0.586908 Sep 23 04:12:22.330058 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2873/5812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:21 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1236 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:22.349212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:22.352062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:22.352525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:22.356199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:22.356696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:22.357144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:22.814444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:22.827710 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d8d0cca-dac6-45a2-9b0f-57a65684239c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.518613 Sep 23 04:12:22.829028 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2940/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:22 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:23.357190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:23.358037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:23.372790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:23.373661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:23.374757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:23.376590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:23.377606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:23.378267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:23.479299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:23.491620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-139ae71c-815f-4a09-bfa6-67fb61275da2 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1288 microversion: 2.1 time: 0.139217 Sep 23 04:12:23.492610 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2874/5814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:23 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:23.854259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:23.855058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:23.872829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:23.873296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:23.874233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:23.875487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:23.878786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:23.880681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:24.240363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:24.257236 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e3d11dc-1a0f-4fc8-a3a9-ed804d842a68 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.408304 Sep 23 04:12:24.269400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2941/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:23 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:24.517381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:24.518186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:24.537279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:24.537827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:24.541548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:24.542372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:24.547130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:24.547686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:24.736676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:24.752404 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-207ac92f-1a30-4a25-b47d-7f38b2e924d3 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1294 microversion: 2.1 time: 0.239992 Sep 23 04:12:24.753112 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2875/5816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:24 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:25.287410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:25.288532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:25.297622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:25.298388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:25.299360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:25.300266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:25.301243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:25.301867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:25.631307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:25.643883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bbf8a32c-66b9-4319-89f5-4593198d397f tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.361114 Sep 23 04:12:25.650556 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2942/5817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:25 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:25.776437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:25.777084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:25.792099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:25.792810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:25.793460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:25.806275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:25.808569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:25.809380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:26.248842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:26.266833 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2982bf63-7382-4c26-bf03-d68d6c3924c1 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.494318 Sep 23 04:12:26.276242 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2876/5818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:25 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:26.682183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:26.683766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:26.709758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:26.710324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:26.712063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:26.712063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:26.712659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:26.713104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:26.811221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e995c9d7-ef96-472b-8cfc-8d9d31f01daf", "tag": "4cdb25a8-d95b-4566-83b9-133e32d2f96e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:26.830681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:26.831071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:26.831519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:26.872256 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] Creating event network-changed:4cdb25a8-d95b-4566-83b9-133e32d2f96e for instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf on n-h2-858495-2 Sep 23 04:12:26.885927 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f1d6988a-f091-411a-a0f4-3c3c97925672 req-4bcac32c-d148-4136-a274-b45b6958da2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078637 Sep 23 04:12:26.886889 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2877/5819] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:12:27.140128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:27.150049 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8d736b8-b5ff-4a72-b235-b1277001a2cf tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.474300 Sep 23 04:12:27.180255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2943/5820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:26 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:27.294828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:27.295561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:27.311351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:27.311924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:27.313080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:27.313080 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:27.313830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:27.314150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:27.642889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:27.665233 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c8971bc0-6fab-40f1-8b97-ef90188a8860 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.376902 Sep 23 04:12:27.671089 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2878/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:27 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:28.178945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:28.183442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:28.194781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:28.196133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:28.196757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:28.197750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:28.198799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:28.199399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:28.406338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca02e734-3142-484a-b918-d4da83e07011", "name": "network-vif-plugged", "status": "completed", "tag": "c09fb7fd-0a26-4b25-866d-03d499c94939"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:28.427536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:28.430638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:28.431388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:28.431973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:28.439313 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd8d90f8-21fe-43b3-8b41-8bae4d187c18 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.267866 Sep 23 04:12:28.443985 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2944/5822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:28 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:28.470333 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] Creating event network-vif-plugged:c09fb7fd-0a26-4b25-866d-03d499c94939 for instance ca02e734-3142-484a-b918-d4da83e07011 on n-h1-858495-2 Sep 23 04:12:28.488282 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9c41d988-1c3e-4c30-8dae-7d0c3f3daa31 req-9752ba0a-8133-4463-b6ca-d2349292fbe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083475 Sep 23 04:12:28.490999 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2879/5823] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:12:28.706657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:28.707492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:28.713859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:28.715078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:28.715686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:28.716543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:28.717621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:28.718215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:29.156302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:29.166134 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5435759a-1a37-4f8a-b39e-adc763c49d3c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.463049 Sep 23 04:12:29.166729 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2945/5824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:28 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:29.472355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:29.474829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:29.483710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:29.484360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:29.484985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:29.485970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:29.486418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:29.486910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:29.763361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:29.772349 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2af2e1f4-a09e-43a4-9b32-9f375387fca5 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1375 microversion: 2.1 time: 0.306808 Sep 23 04:12:29.773285 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2880/5825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:29 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1375 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:30.193065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:30.193741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:30.200940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:30.202347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:30.203242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:30.204966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:30.205949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:30.206618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:30.628075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:30.650988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:30.796774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:30.797542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:30.808259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:30.813862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:30.814381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:30.815168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:30.815637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:30.816076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:31.000442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:31.021853 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b946314-469e-46f3-841b-3c233611dedc tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.832850 Sep 23 04:12:31.022467 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2946/5826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:30 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:31.287004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:31.296907 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3a5501c-92e4-46de-ba6b-698ccdd02e73 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1548 microversion: 2.1 time: 0.503982 Sep 23 04:12:31.297543 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2881/5827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:30 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1548 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:31.320041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:31.320659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:31.327852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:31.328726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:31.329550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:31.330555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:31.331350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:31.332363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:31.690122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:31.699338 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-051b6712-8fbf-4308-a6ae-6a5f3719b447 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1548 microversion: 2.1 time: 0.384168 Sep 23 04:12:31.706283 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2947/5828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:31 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1548 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:32.052339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:32.053006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:32.064943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:32.065762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:32.070805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:32.072339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:32.073091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:32.073835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:32.083788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:32.325112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:32.387873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:32.419291 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1ef37aa-ad2a-4349-86c8-29f2ab4c6f58 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.371988 Sep 23 04:12:32.421403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2882/5829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:32 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:33.444203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:33.444833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:33.448191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:33.465471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:33.466219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:33.466885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:33.467883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:33.468567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:33.469213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:33.475178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=83 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:33.769481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:33.782152 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c16fb4be-9e8f-4929-8bc1-f040d3b9929f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.341742 Sep 23 04:12:33.783056 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2948/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:33 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:34.265502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e995c9d7-ef96-472b-8cfc-8d9d31f01daf", "name": "network-vif-plugged", "status": "completed", "tag": "4cdb25a8-d95b-4566-83b9-133e32d2f96e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:34.283458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:34.291730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:34.292790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:34.293465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:34.337619 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] Creating event network-vif-plugged:4cdb25a8-d95b-4566-83b9-133e32d2f96e for instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf on n-h2-858495-2 Sep 23 04:12:34.346512 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d2471e08-abaf-4ddb-b913-4a978add5ba1 req-0a29c9b4-ed0a-4326-ae04-451e0ec5415f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085090 Sep 23 04:12:34.350328 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2883/5831] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:34.811358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:34.812629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:34.828949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:34.829484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:34.829938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:34.830667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:34.831136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:34.831574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:36.419139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:36.434177 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42e18b89-ac76-468e-96d2-6e8aa575edd5 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 1.620611 Sep 23 04:12:36.435446 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2949/5832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:34 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:37.468560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:37.474233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:37.500644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:37.501173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:37.501657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:37.502389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:37.505101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:37.505884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:37.819030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:37.863487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c333a20-d032-4e06-a1b9-a42e31ae40aa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1362 microversion: 2.1 time: 0.396628 Sep 23 04:12:37.877881 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2884/5833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:37 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:39.093652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:39.094288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:39.104581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:39.113846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:39.114750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:39.115982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:39.119032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:39.119676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:39.536744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:12:39.547351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63c088e4-1a9e-4c5e-91c9-00a6f33b8f96 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1547 microversion: 2.1 time: 0.662451 Sep 23 04:12:39.555102 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2950/5834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:12:38 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1547 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:12:39.571491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:39.572071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:39.579674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:39.580507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:39.581120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:39.582879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:39.583521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:39.584122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:39.855112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e6d8ffc-841d-4e8b-a840-fa14b133da39 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288079 Sep 23 04:12:39.855716 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2885/5835] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:12:39 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-interface => generated 284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:41.301031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e995c9d7-ef96-472b-8cfc-8d9d31f01daf", "tag": "4cdb25a8-d95b-4566-83b9-133e32d2f96e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:12:41.314850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:41.315338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:41.315776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:41.334119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] Creating event network-changed:4cdb25a8-d95b-4566-83b9-133e32d2f96e for instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf on n-h2-858495-2 Sep 23 04:12:41.350466 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0373b441-524f-4086-91e1-55db90095483 req-c14dd911-24dd-4221-ba57-64946688252b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052357 Sep 23 04:12:41.351498 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2951/5836] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:12:59.891991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:12:59.894837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:12:59.905716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=5 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:59.908247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=16 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:12:59.911766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:59.912501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:59.913107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:12:59.915735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:12:59.916587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:12:59.917232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:00.019555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:13:00.203509 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c8331ad-01ce-46f8-8dd8-569903220ac4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 204 len: 0 microversion: 2.1 time: 0.326089 Sep 23 04:13:00.204701 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2886/5837] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:12:59 2022] DELETE /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:13:00.212908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=7 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:00.213683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=19 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:00.218791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:00.222206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:00.240476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:00.241565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:00.242314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:00.244541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:00.245193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:00.249421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:01.235869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:01.246552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97b92330-63f9-4850-92f1-6c84c6d835e4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1554 microversion: 2.1 time: 1.036789 Sep 23 04:13:01.254286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2952/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:00 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1554 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:02.270600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:02.271375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:02.284939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:02.287091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:02.287706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:02.288659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:02.290292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:02.293279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:02.683647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:02.692300 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b950b38-580e-4e14-8266-2b5be26c1865 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1554 microversion: 2.1 time: 0.426502 Sep 23 04:13:02.692899 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2887/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:02 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1554 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:03.429757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca02e734-3142-484a-b918-d4da83e07011", "name": "network-vif-deleted", "tag": "c09fb7fd-0a26-4b25-866d-03d499c94939"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:03.450996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:03.458727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:03.460934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:03.487810 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] Creating event network-vif-deleted:c09fb7fd-0a26-4b25-866d-03d499c94939 for instance ca02e734-3142-484a-b918-d4da83e07011 on n-h1-858495-2 Sep 23 04:13:03.507429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0d5ffd40-61e7-4520-ae3f-b59e1cdca45f req-ed136789-a13d-440c-92ea-fa7173b83788 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080898 Sep 23 04:13:03.520271 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2953/5840] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:03.718991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:03.720468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:03.735252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:03.736217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:03.741388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:03.742413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:03.744075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:03.750260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:03.840921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:03.845316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:03.845948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:03.846822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lazy-loading 'fault' on Instance uuid ca02e734-3142-484a-b918-d4da83e07011 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:13:03.948674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:03.958068 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-509aa834-434b-413d-a0ba-a732d57bfc07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 200 len: 1339 microversion: 2.1 time: 0.243021 Sep 23 04:13:03.975593 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2888/5841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:03 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 1339 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:05.012746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:05.013506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: ca02e734-3142-484a-b918-d4da83e07011] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:05.035720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:05.036184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:05.036556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:05.037291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:05.037786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:05.038261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:05.063694 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] HTTP exception thrown: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Request method failure captured: Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 HTTP/1.1 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTGhiVVkmCggs-ek7Cx9mvYfqkX6Ex3Zj5w-FslEluqVePAjQ7bUYuoBFJC5WZtx7yzLTvNqdkuTLyoWUD4b2hxOZBXN0omK5TkmQmJa5_bgFV_t2eOhSCz0S0oSg3cPyMnSiehV6ueNIJCOXv9RJHgsYgQXlXDZQsLIkM5PRZXY9kI Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 054d6e2f0c5c4397b2cb9e83174663fc Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'ca02e734-3142-484a-b918-d4da83e07011'} Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:13:05.065443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Returning 404 to user: Instance ca02e734-3142-484a-b918-d4da83e07011 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b08850ce-6757-44dc-bacc-d5c310b1aad4 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011" status: 404 len: 111 microversion: 2.1 time: 0.067608 Sep 23 04:13:05.071363 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2954/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:04 2022] GET /compute/v2.1/servers/ca02e734-3142-484a-b918-d4da83e07011 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:13:05.432558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85b9439f-6f99-458a-9d1c-18c02747cd38 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '.version_select at 0x7f0c8a79cc10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:05.536071 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85b9439f-6f99-458a-9d1c-18c02747cd38 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1558947281" status: 202 len: 0 microversion: 2.1 time: 0.109376 Sep 23 04:13:05.537269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2889/5843] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 04:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1558947281 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:13:10.149628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:10.150124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:10.161954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687f048d-d268-448c-b90d-ba1471499a70", "tag": "30a9f312-ba0c-481d-8231-0b2189045f14"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:10.168025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:10.170630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:10.171333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:10.172128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:10.181668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:10.182417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:10.203209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:10.203628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:10.210318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:10.230006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:13:10.268083 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] Creating event network-changed:30a9f312-ba0c-481d-8231-0b2189045f14 for instance 687f048d-d268-448c-b90d-ba1471499a70 on n-h2-858495-2 Sep 23 04:13:10.277444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a06c8043-8451-4f74-95ad-7faff7a2cac5 req-9e2122de-31f2-4b7b-bd63-2a0fd2f918c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120270 Sep 23 04:13:10.279969 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2890/5844] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:10.421906 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a20a96d-05b1-41b3-8f30-86187ea71ad7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 204 len: 0 microversion: 2.1 time: 0.276280 Sep 23 04:13:10.433012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:10.433538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:10.435726 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2955/5845] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:13:10 2022] DELETE /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:13:10.445344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:10.446175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:10.448513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:10.449324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:10.451292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:10.452106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:10.745205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:10.775938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e2903ec-10b9-48b3-aed1-6b8d59ee1e88 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1672 microversion: 2.1 time: 0.347880 Sep 23 04:13:10.776594 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2891/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:10 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1672 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:11.800699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:11.801693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:11.820539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:11.821220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:11.821947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:11.822925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:11.823618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:11.824460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:12.242434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:12.252351 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5f9031b0-4785-4625-92de-9d2014aed2f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1672 microversion: 2.1 time: 0.456379 Sep 23 04:13:12.274649 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2956/5847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:11 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1672 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:13.278392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:13.280478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:13.291422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:13.295113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:13.305525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:13.306857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:13.307608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:13.308280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:13.604645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:13.616173 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-770d9b3e-6fa8-4d83-92c2-79f853a9df3c tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1672 microversion: 2.1 time: 0.342332 Sep 23 04:13:13.618050 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2892/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:13 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:13.803736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687f048d-d268-448c-b90d-ba1471499a70", "name": "network-vif-deleted", "tag": "30a9f312-ba0c-481d-8231-0b2189045f14"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:13.822113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:13.823038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:13.839016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:13.868520 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] Creating event network-vif-deleted:30a9f312-ba0c-481d-8231-0b2189045f14 for instance 687f048d-d268-448c-b90d-ba1471499a70 on n-h2-858495-2 Sep 23 04:13:13.875321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-178eb401-2457-475b-b7bf-be4e2cde90fa req-1e79d1c6-35a7-49af-b463-d9ff483874b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076679 Sep 23 04:13:13.876541 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2957/5849] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:13:14.641037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:14.642785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:14.656946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:14.657549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:14.658044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:14.658942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:14.659572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:14.660186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:14.751969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:14.752479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:14.753417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:14.753894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lazy-loading 'fault' on Instance uuid 687f048d-d268-448c-b90d-ba1471499a70 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:13:14.839765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:14.859053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4814616-b58c-41b5-bed5-c4e43421928a tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 200 len: 1339 microversion: 2.1 time: 0.221851 Sep 23 04:13:14.877422 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2893/5850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:14 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 1339 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:15.890241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:15.891993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 687f048d-d268-448c-b90d-ba1471499a70] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:15.902782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:15.903713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:15.904387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:15.905440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:15.906224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:15.906998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:15.930385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] HTTP exception thrown: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Request method failure captured: Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 HTTP/1.1 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTGhiVVkmCggs-ek7Cx9mvYfqkX6Ex3Zj5w-FslEluqVePAjQ7bUYuoBFJC5WZtx7yzLTvNqdkuTLyoWUD4b2hxOZBXN0omK5TkmQmJa5_bgFV_t2eOhSCz0S0oSg3cPyMnSiehV6ueNIJCOXv9RJHgsYgQXlXDZQsLIkM5PRZXY9kI Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 054d6e2f0c5c4397b2cb9e83174663fc Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '687f048d-d268-448c-b90d-ba1471499a70'} Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:13:15.932611 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. Sep 23 04:13:15.937367 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:13:15.939668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Returning 404 to user: Instance 687f048d-d268-448c-b90d-ba1471499a70 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:13:15.940966 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f503f2dd-e0fa-4567-ab58-92d74cbec4e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70" status: 404 len: 111 microversion: 2.1 time: 0.056113 Sep 23 04:13:15.942313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2958/5851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:15 2022] GET /compute/v2.1/servers/687f048d-d268-448c-b90d-ba1471499a70 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:13:16.190796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e479fde-f8b4-4639-976d-7e4989a2cdd8 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '.version_select at 0x7f0c8a2f33a0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:16.237682 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e479fde-f8b4-4639-976d-7e4989a2cdd8 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1710817650" status: 202 len: 0 microversion: 2.1 time: 0.048696 Sep 23 04:13:16.238403 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2894/5852] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 04:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1710817650 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:13:31.990837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6647fea7-d8b6-4810-9600-0df9583204de tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: .version_select at 0x7f0c8b0d6670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1875424223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX0LJGTjqo+k67Dwz1O5dEJ2rAKguNgTr201D9SbwtA+Ge6O3XRp7iDSuZyShkcd+ly5otSIU8IAGGIPepJH5LR3OfkCK2hjNcaAhMzBFXhWjlgRZ/wJxy/U/USeNYfvw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:32.001677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:32.002567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:32.020790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-6647fea7-d8b6-4810-9600-0df9583204de tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:13:32.028513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-6647fea7-d8b6-4810-9600-0df9583204de tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:13:32.063561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6647fea7-d8b6-4810-9600-0df9583204de tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.078382 Sep 23 04:13:32.072816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2959/5853] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:13:31 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:34.413982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1996854671", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a244507e-f0b2-4201-a00d-0913ae2b2d7f"}], "key_name": "tempest-TestNetworkBasicOps-1875424223", "security_groups": [{"name": "tempest-secgroup-smoke-1500538548"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:34.436845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:34.441329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:34.596789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] validate_networks() for [('a244507e-f0b2-4201-a00d-0913ae2b2d7f', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:13:35.494258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:13:35.494910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:13:35.495268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:13:35.495785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:13:35.496353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:13:35.507346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:35.507938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:35.508463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:35.509288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:35.509877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:35.510543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:35.534560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:13:35.541576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Getting quotas for user 054d6e2f0c5c4397b2cb9e83174663fc and project f4121436d5ba4d128e3fae745af25aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:13:35.556629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:13:35.559129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:13:35.624321 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4920a45-82cf-4466-9047-56f92cc24fb7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.214462 Sep 23 04:13:35.631164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2895/5854] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:13:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:13:35.636893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66643980-5bb0-4d21-a277-ac861fd7328e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:35.638212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66643980-5bb0-4d21-a277-ac861fd7328e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:35.720082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-66643980-5bb0-4d21-a277-ac861fd7328e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:35.730647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66643980-5bb0-4d21-a277-ac861fd7328e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1249 microversion: 2.1 time: 0.098072 Sep 23 04:13:35.732152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2960/5855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:35 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:36.756608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:36.757266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:36.768868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:36.771361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:36.772497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:36.773758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:36.774911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:36.776050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:36.881524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:36.890625 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ee9ad5d-c014-4b21-81cf-b7967db992f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1301 microversion: 2.1 time: 0.139111 Sep 23 04:13:36.891232 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2896/5856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:36 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1301 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:13:37.915987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:37.916600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:37.928083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:37.928585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:37.930653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:37.931396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:37.931870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:37.932320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:38.104670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:38.132106 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5beaef0-d28d-4a0f-914f-b9cfe3ea2285 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1307 microversion: 2.1 time: 0.221815 Sep 23 04:13:38.132914 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2961/5857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:37 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:39.166912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:39.168196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:39.182009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:39.182879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:39.183504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:39.184596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:39.185240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:39.185932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:39.380034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ded7af4-d9a1-409b-9725-be41a085e363", "tag": "6ace0f24-c9cb-4f9f-8a02-ff703b958890"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:39.383227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:39.397962 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52fd2cdc-7d92-4391-94af-fe2578529bf6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.243940 Sep 23 04:13:39.404503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:39.405274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:39.405923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:39.411633 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2897/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:39 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:39.429074 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] Creating event network-changed:6ace0f24-c9cb-4f9f-8a02-ff703b958890 for instance 7ded7af4-d9a1-409b-9725-be41a085e363 on n-h1-858495-2 Sep 23 04:13:39.435772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-95555fcc-cdda-4ca1-b9c0-a8474f11169f req-ad6e5164-6dac-47f2-b5bb-100f0fb08e66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059864 Sep 23 04:13:39.437146 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2962/5859] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:40.423705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:40.424292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:40.432982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:40.433812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:40.434429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:40.435524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:40.436217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:40.436953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:40.695121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:40.705638 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-684a5d26-39ae-47cf-a26d-deb8bfbd421d tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.286727 Sep 23 04:13:40.707389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2898/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:40 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:41.731758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:41.733010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:41.746859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:41.748784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:41.750598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:41.753695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:41.754978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:41.755736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:41.995907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:42.004824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b4400544-3dfa-4447-b359-efe0227c83ab tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.277456 Sep 23 04:13:42.005752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2963/5861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:41 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:43.028911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:43.029844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:43.062520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:43.063670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:43.064163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:43.069446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:43.070839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:43.071462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:43.441251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:43.459263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ae5d1d3-37ef-44af-bf50-4b1584a74827 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.431286 Sep 23 04:13:43.474752 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2899/5862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:43 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:44.482693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:44.483389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:44.492718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:44.493555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:44.494357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:44.495285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:44.495950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:44.496586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:44.597787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:44.599252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:44.610644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:44.613584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:44.615995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:44.616865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:44.619422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:44.619979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:44.688143 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-77f1c723-c4b1-4f44-8cc9-fd753a562152 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/ips" status: 200 len: 145 microversion: 2.1 time: 0.094648 Sep 23 04:13:44.689668 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2900/5863] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:13:44 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:44.745806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:44.766795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ff0834a3-61a5-462d-9bc1-0385d95a9a07 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.288229 Sep 23 04:13:44.783292 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2964/5864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:44 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:44.837903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded7af4-d9a1-409b-9725-be41a085e363", "name": "network-vif-plugged", "status": "completed", "tag": "6ace0f24-c9cb-4f9f-8a02-ff703b958890"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:44.862296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:44.869165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:44.869808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:44.904657 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] Creating event network-vif-plugged:6ace0f24-c9cb-4f9f-8a02-ff703b958890 for instance 7ded7af4-d9a1-409b-9725-be41a085e363 on n-h1-858495-2 Sep 23 04:13:44.919436 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bed58ca3-2af7-4b0b-aecc-af01860c3ccf req-ac052377-0770-42f2-baad-6267106d09da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092165 Sep 23 04:13:44.923596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2901/5865] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:13:45.794725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:45.795544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:45.798746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:45.822835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:45.823436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:45.825148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:45.825927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:45.826393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:45.826829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:46.149119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:46.160191 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb4ddcd6-889a-4845-8a87-893c6af6604e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1375 microversion: 2.1 time: 0.369642 Sep 23 04:13:46.160850 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2965/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:45 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:47.187265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:47.188125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:13:47.193778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:47.194728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:47.203084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.203812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.204428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.205754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.206366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.206856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.384021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc02f9e6-72bc-4d5f-b616-96933f49456b"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:47.386403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:47.394444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.394622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.395441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.396207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.396719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.397152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.429671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:47.443155 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d82c3ca7-dba4-4dff-bd38-aad4031e12e9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1547 microversion: 2.1 time: 0.255876 Sep 23 04:13:47.444061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2902/5867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:47 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:47.476797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:13:47.477954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:13:47.495577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.497321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.498464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.501100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:47.502076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:47.502672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:47.710564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:13:47.721545 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7b5ef2c-504c-4c4b-83c6-ca63a0140222 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1547 microversion: 2.1 time: 0.255344 Sep 23 04:13:47.734194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2903/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:13:47 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1547 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:13:47.778346 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6399260-218b-45a6-8815-30a8b557c2bd tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397226 Sep 23 04:13:47.779740 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2966/5869] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:13:47 2022] POST /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:13:50.644176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ded7af4-d9a1-409b-9725-be41a085e363", "tag": "6ace0f24-c9cb-4f9f-8a02-ff703b958890"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:13:50.667791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:13:50.668283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:13:50.668717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:13:50.695057 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] Creating event network-changed:6ace0f24-c9cb-4f9f-8a02-ff703b958890 for instance 7ded7af4-d9a1-409b-9725-be41a085e363 on n-h1-858495-2 Sep 23 04:13:50.708414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-24421c50-332b-4de1-b184-46e35b0f8679 req-559da544-fb39-4874-9e14-6befe4e8fbdd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067705 Sep 23 04:13:50.709934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2904/5870] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:01.384911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:01.388741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:01.393664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:01.399362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:01.414850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:01.415548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:01.416265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:01.417137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:01.421306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:01.421869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:01.477715 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ea3724b-2832-4c8a-a9a3-2e17c6117137 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083509 Sep 23 04:14:01.484955 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2967/5871] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:14:01 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:01.489529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:01.490787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=46 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:01.496219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:01.498044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:01.526869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:01.530425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:01.532724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:01.537048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:01.539551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:01.540677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:01.628141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60ba15e1-6f87-40d2-af0e-2a1a3bfadb35 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b" status: 200 len: 194 microversion: 2.1 time: 0.141098 Sep 23 04:14:01.646933 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2905/5872] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 23 04:14:01 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b => generated 194 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:04.601777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1fa3214-4fc0-4d94-b89e-4ac84d95c03f"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:04.604273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:04.611798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:04.612645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:04.613916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:04.614838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:04.615504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:04.616039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:05.044933 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f39ae56-0238-4fe7-a69c-cdfda2770261 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "POST /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447463 Sep 23 04:14:05.052101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2968/5873] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:14:04 2022] POST /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:14.508156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:14.511079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:14.520498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:14.521835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:14.527303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:14.528081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:14.528768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:14.529771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:14.530308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:14.530818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:14.606421 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-acca28c7-4e91-41a2-bb98-4e06a994b3f6 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363/action" status: 200 len: 24568 microversion: 2.1 time: 0.102427 Sep 23 04:14:14.614365 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2906/5874] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:14:14 2022] POST /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363/action => generated 24568 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:14:20.638015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:20.639290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:20.645929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:20.648622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:20.660679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.662612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.663061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:20.663787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.664444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.664665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:20.698051 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-321a855c-1255-4772-af4b-5da2b561144e tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062010 Sep 23 04:14:20.699010 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2969/5875] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:14:20 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:20.846294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:20.847278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:20.856774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.857540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.858150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:20.859035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.859646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.860229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:20.899131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-491136d2-ab36-4869-afec-474299644258 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b" status: 200 len: 194 microversion: 2.1 time: 0.057910 Sep 23 04:14:20.905907 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2907/5876] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 23 04:14:20 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:20.911963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:20.912638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:20.921893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.922381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.923053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:20.923756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:20.924353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:20.924965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:21.029003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lazy-loading 'services' on Instance uuid e995c9d7-ef96-472b-8cfc-8d9d31f01daf {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:14:21.136517 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-665cdc9f-d59e-4b63-aa16-807a291cf8be tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b" status: 202 len: 0 microversion: 2.1 time: 0.228914 Sep 23 04:14:21.145080 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2970/5877] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:14:20 2022] DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/cc02f9e6-72bc-4d5f-b616-96933f49456b => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:14:21.150526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:21.153716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:21.163882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:21.166474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:21.168670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:21.169741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:21.170899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:21.172039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:21.269691 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba7ff5a1-1a75-4a95-be55-fcfc840a1c20 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "POST /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363/action" status: 200 len: 32637 microversion: 2.1 time: 0.122173 Sep 23 04:14:21.270790 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2908/5878] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:14:21 2022] POST /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363/action => generated 32637 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:14:23.073804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:23.074425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ded7af4-d9a1-409b-9725-be41a085e363", "tag": "6ace0f24-c9cb-4f9f-8a02-ff703b958890"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:23.074796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:23.085779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:23.086274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:23.086970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:23.087396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:23.088141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:23.090029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:23.092114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:23.094304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:23.095272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:23.109096 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] Creating event network-changed:6ace0f24-c9cb-4f9f-8a02-ff703b958890 for instance 7ded7af4-d9a1-409b-9725-be41a085e363 on n-h1-858495-2 Sep 23 04:14:23.116095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3ca92db5-a005-4e7b-a34a-cbe884d2155a req-b554ccc5-3c8d-4ae8-9bb3-01f9bd38a3d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045620 Sep 23 04:14:23.116718 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2909/5879] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:14:23.155938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:14:23.340440 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bfdbce7-6e74-4125-8203-7aea4a137af1 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 204 len: 0 microversion: 2.1 time: 0.271235 Sep 23 04:14:23.346124 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2971/5880] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:14:23 2022] DELETE /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:14:23.359366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:23.360569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:23.376761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:23.379138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:23.379703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:23.382003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:23.383520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:23.385707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:23.684997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:23.695817 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6526b87-489e-45c6-b7b9-8281d0a8c061 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1671 microversion: 2.1 time: 0.342046 Sep 23 04:14:23.696818 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2910/5881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:23 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1671 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:24.723336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:24.724183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:24.735350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:24.735844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:24.736419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:24.737719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:24.747730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:24.748388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:25.005817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:25.015032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3130e0b-64e0-4a35-9030-a213a2676be9 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1671 microversion: 2.1 time: 0.296821 Sep 23 04:14:25.016362 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2972/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:24 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1671 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:14:25.886811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded7af4-d9a1-409b-9725-be41a085e363", "name": "network-vif-deleted", "tag": "6ace0f24-c9cb-4f9f-8a02-ff703b958890"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:25.913052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:25.914050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:25.914816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:25.932954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] Creating event network-vif-deleted:6ace0f24-c9cb-4f9f-8a02-ff703b958890 for instance 7ded7af4-d9a1-409b-9725-be41a085e363 on n-h1-858495-2 Sep 23 04:14:25.957181 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d820d0a2-25a7-4871-8bab-f11493ce0b94 req-b09eed5e-d74a-46e3-977a-58f988817ff2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073193 Sep 23 04:14:25.958110 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2911/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:26.040251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:26.040893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:26.052159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:26.052653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:26.053104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:26.053831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:26.054448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:26.055005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:26.140061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:26.141069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:26.141694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:26.142521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lazy-loading 'fault' on Instance uuid 7ded7af4-d9a1-409b-9725-be41a085e363 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:14:26.236596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054d6e2f0c5c4397b2cb9e83174663fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121436d5ba4d128e3fae745af25aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:26.246518 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e35e1d8-8093-4862-bcf1-8cc52cff41a7 tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 200 len: 1339 microversion: 2.1 time: 0.210094 Sep 23 04:14:26.254902 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2973/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:26 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:27.278061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:27.278777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] [instance: 7ded7af4-d9a1-409b-9725-be41a085e363] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:27.288904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:27.301715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:27.302223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:27.302988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:27.303465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:27.303905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:27.329674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] HTTP exception thrown: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Request method failure captured: Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 HTTP/1.1 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTGhiVVkmCggs-ek7Cx9mvYfqkX6Ex3Zj5w-FslEluqVePAjQ7bUYuoBFJC5WZtx7yzLTvNqdkuTLyoWUD4b2hxOZBXN0omK5TkmQmJa5_bgFV_t2eOhSCz0S0oSg3cPyMnSiehV6ueNIJCOXv9RJHgsYgQXlXDZQsLIkM5PRZXY9kI Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4121436d5ba4d128e3fae745af25aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: f4121436d5ba4d128e3fae745af25aaa Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestNetworkBasicOps-1202223055 Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 054d6e2f0c5c4397b2cb9e83174663fc Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestNetworkBasicOps-1202223055-project Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7ded7af4-d9a1-409b-9725-be41a085e363'} Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:27.331821 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Returning 404 to user: Instance 7ded7af4-d9a1-409b-9725-be41a085e363 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:14:27.337031 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-19517f32-2a9b-4f0d-b86e-941e94c0635e tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363" status: 404 len: 111 microversion: 2.1 time: 0.059683 Sep 23 04:14:27.337852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2912/5885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:27 2022] GET /compute/v2.1/servers/7ded7af4-d9a1-409b-9725-be41a085e363 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:14:27.568887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1da9d1c3-00aa-46a1-83e8-3a7dec064ace tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] Calling method '.version_select at 0x7f0c8b040670>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:27.618582 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1da9d1c3-00aa-46a1-83e8-3a7dec064ace tempest-TestNetworkBasicOps-1202223055 tempest-TestNetworkBasicOps-1202223055-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1875424223" status: 202 len: 0 microversion: 2.1 time: 0.054789 Sep 23 04:14:27.619187 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2974/5886] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Sep 23 04:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1875424223 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:14:29.220345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:29.221961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:29.238468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:29.240869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:29.244410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:29.244410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:29.244410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:29.244410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:29.323569 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0616f25a-4772-4c5b-aff5-ce6d46c67701 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/a1fa3214-4fc0-4d94-b89e-4ac84d95c03f" status: 200 len: 194 microversion: 2.1 time: 0.109322 Sep 23 04:14:29.324445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2913/5887] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 23 04:14:29 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/a1fa3214-4fc0-4d94-b89e-4ac84d95c03f => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:29.336270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:29.337702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:29.347148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:29.354553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:29.355232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:29.356397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:29.357092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:29.357707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:29.582230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lazy-loading 'services' on Instance uuid e995c9d7-ef96-472b-8cfc-8d9d31f01daf {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:14:29.707454 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c6289d4-1564-4330-b928-c1954c5d6fca tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/a1fa3214-4fc0-4d94-b89e-4ac84d95c03f" status: 202 len: 0 microversion: 2.1 time: 0.374644 Sep 23 04:14:29.708541 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2975/5888] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:14:29 2022] DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments/a1fa3214-4fc0-4d94-b89e-4ac84d95c03f => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:14:38.947096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:38.949743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:38.966120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:38.966634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:38.967086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:38.967812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:38.968280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:38.968717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.049860 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c9637aa-77cb-465c-bd71-51c7ea978220 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107369 Sep 23 04:14:39.060900 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2914/5889] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:14:38 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:14:39.296290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:39.299898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:39.310401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.311066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.311722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.312621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.313233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.314926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.354773 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-96ea4d0d-1af0-42d8-a623-8318bb10d579 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063269 Sep 23 04:14:39.362472 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2976/5890] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:14:39 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:14:39.530511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:39.531755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:39.547933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.549402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.550011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.554111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.554749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.555412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.618612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:14:39.779078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-419231d0-bf99-4c23-917b-b00fefd123ef tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 204 len: 0 microversion: 2.1 time: 0.258491 Sep 23 04:14:39.779727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2915/5891] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:14:39 2022] DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:14:39.790694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:39.791425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:39.811385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.811886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.812395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:39.813376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:39.813981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:39.814652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:40.091135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:40.102677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-53a7c033-24e8-4d12-9ca4-b41f2c4ca1c6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1672 microversion: 2.1 time: 0.317135 Sep 23 04:14:40.103877 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2977/5892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:39 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1672 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:41.129120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:41.130717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:41.138695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:41.139481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:41.140110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:41.141112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:41.142299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:41.143505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:41.409712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:41.421331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d02583d-f6b6-4282-86ba-0f5034d0257c tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1672 microversion: 2.1 time: 0.296183 Sep 23 04:14:41.422505 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2916/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:41 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1672 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:42.446644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:42.447260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:42.477216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:42.477963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:42.478580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:42.491730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:42.492444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:42.493028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:42.628651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:42.640995 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8a14a33b-9bcc-41fc-b1a4-0ce33d7babac tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1604 microversion: 2.1 time: 0.198300 Sep 23 04:14:42.641989 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2978/5894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:42 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:14:43.177989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e995c9d7-ef96-472b-8cfc-8d9d31f01daf", "name": "network-vif-deleted", "tag": "4cdb25a8-d95b-4566-83b9-133e32d2f96e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:43.201735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:43.202799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:43.203437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:43.222673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-257f267f-bc14-4b90-9d0a-531fcf35ebdf tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Action: 'create', calling method: .version_select at 0x7f0c9341e8b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-308477467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISedeb0ReqDD2cDXCpFTyYLBVabLCLnvjL7OjMMdmfG7Q4nSDGaCE6YU3r1S0xaUnHnPeiB3tj+t9PnIjku72B3JEl+Hq0Xr/EPkG8QjJt+jZxswCpY5Tg4MUdFKwzvDw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:43.247522 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] Creating event network-vif-deleted:4cdb25a8-d95b-4566-83b9-133e32d2f96e for instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf on n-h2-858495-2 Sep 23 04:14:43.259176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d3eaa3df-de2b-44dd-b84d-64962540415d req-1ebe4c4f-4315-4612-923a-3c23433f229b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085384 Sep 23 04:14:43.262662 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2979/5895] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:43.275685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-257f267f-bc14-4b90-9d0a-531fcf35ebdf tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:14:43.315999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-257f267f-bc14-4b90-9d0a-531fcf35ebdf tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for user 9cb91664432b427eadcec9f0da90b21b and project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:14:43.399009 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-257f267f-bc14-4b90-9d0a-531fcf35ebdf tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.550517 Sep 23 04:14:43.399719 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2917/5896] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:14:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:14:43.667061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:43.667773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:43.685884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:43.688572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:43.691148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:43.692061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:43.694297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:43.696702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:43.759166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:43.759652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:43.760090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:43.760543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lazy-loading 'fault' on Instance uuid e995c9d7-ef96-472b-8cfc-8d9d31f01daf {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:14:43.871814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc1741357b4427a9fa52488a7e99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd88f113124be8892a9c850eb992e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:43.891119 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3a9a9169-96d3-4ba3-8717-107c07e6767f tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 200 len: 1326 microversion: 2.1 time: 0.230603 Sep 23 04:14:43.891738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2980/5897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:43 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 1326 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:44.915487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:44.916121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:44.928931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:44.956502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:44.957197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:44.957798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:44.960749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:44.961391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:44.963404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:44.977154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:45.036764 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf HTTP/1.1 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e995c9d7-ef96-472b-8cfc-8d9d31f01daf'} Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:45.038686 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:45.042739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:14:45.044987 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a68b10e0-fefc-48a2-8240-476961a42bb6 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 404 len: 111 microversion: 2.1 time: 0.128732 Sep 23 04:14:45.045980 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2918/5898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:44 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:14:45.055111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a15a9f49-6d83-4bb7-bf89-676fed252632 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '.version_select at 0x7f0c8a8d73a0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:45.083129 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a15a9f49-6d83-4bb7-bf89-676fed252632 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940197245" status: 202 len: 0 microversion: 2.1 time: 0.032567 Sep 23 04:14:45.088431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2981/5899] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 04:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940197245 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:14:55.440320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-478174934-access_point-363391601", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "04a466ee-b7fb-4ba4-be5c-88d14a28ebf0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-308477467", "security_groups": [{"name": "tempest-secgroup_access--1224995119"}, {"name": "tempest-secgroup_general--1172240290"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:14:55.487243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:55.493248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:55.765095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] validate_networks() for [('04a466ee-b7fb-4ba4-be5c-88d14a28ebf0', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:14:56.342615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:14:56.343300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:14:56.343954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:14:56.344515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:14:56.345743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:14:56.356325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:56.357144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:56.357826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:56.358748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:56.359366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:56.359964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:56.379596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:14:56.385863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for user 9cb91664432b427eadcec9f0da90b21b and project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:14:56.411654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:14:56.414230 n-d-858495-2 devstack@n-api.service[128723]: WARNING nova.utils [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-478174934-access_point-363391601 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-478174934-acc Sep 23 04:14:56.415293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:14:56.487023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2900e55-9517-4d1f-9372-d2f069c271cc tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.051080 Sep 23 04:14:56.494223 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2919/5900] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:14:55 2022] POST /compute/v2.1/servers => generated 458 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:14:56.503305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f19c3ba5-a8dc-47de-a85a-c8d35f785c3e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:56.504729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f19c3ba5-a8dc-47de-a85a-c8d35f785c3e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:56.521559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:56.523969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:14:56.616063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f19c3ba5-a8dc-47de-a85a-c8d35f785c3e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:56.624468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f19c3ba5-a8dc-47de-a85a-c8d35f785c3e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1292 microversion: 2.1 time: 0.126943 Sep 23 04:14:56.629646 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2982/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:56 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:57.659661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:57.665384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:57.706299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:57.715260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:57.715723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:57.716483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:57.716944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:57.717403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:57.840098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:57.858183 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7be85320-3d33-4ae1-a5b1-e500128b418d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1288 microversion: 2.1 time: 0.208524 Sep 23 04:14:57.874200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2920/5902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:57 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1288 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:58.885235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:58.885913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:58.896030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:58.897281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:58.897988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:58.899146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:58.899780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:58.900366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:59.229782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:14:59.242836 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93019089-3d8a-4d7d-b36d-7e451d7629a5 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1350 microversion: 2.1 time: 0.362447 Sep 23 04:14:59.244674 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2983/5903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:58 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1350 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:14:59.410126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:59.411238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:59.424760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:59.425806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:59.426891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:59.430667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:59.431209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:59.432611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:59.509781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf HTTP/1.1 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e995c9d7-ef96-472b-8cfc-8d9d31f01daf'} Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:14:59.511690 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.515736 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.517085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:14:59.518066 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-195d2f05-fe52-4d13-aa37-e9074f88fbaa tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 404 len: 111 microversion: 2.1 time: 0.113166 Sep 23 04:14:59.525668 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2921/5904] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:14:59 2022] DELETE /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:14:59.529084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:14:59.529854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: e995c9d7-ef96-472b-8cfc-8d9d31f01daf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:14:59.540358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:59.541203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:59.543672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:59.544745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:14:59.548854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:14:59.549716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:14:59.574993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf HTTP/1.1 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e995c9d7-ef96-472b-8cfc-8d9d31f01daf'} Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:14:59.584488 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. Sep 23 04:14:59.587810 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:14:59.594230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance e995c9d7-ef96-472b-8cfc-8d9d31f01daf could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:14:59.594988 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8132cb02-9651-4014-8ffc-91e47aaf0066 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf" status: 404 len: 111 microversion: 2.1 time: 0.070512 Sep 23 04:14:59.596660 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2984/5905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:14:59 2022] GET /compute/v2.1/servers/e995c9d7-ef96-472b-8cfc-8d9d31f01daf => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:15:00.269078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:00.269727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:00.296161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:00.296599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:00.297059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:00.308567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:00.311577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:00.312073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:00.699815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:00.715287 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6194cfb5-5948-4bd5-aa63-929aa511b945 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1350 microversion: 2.1 time: 0.451145 Sep 23 04:15:00.716740 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2922/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:00 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1350 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:01.742712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:01.743328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:01.756751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:01.758626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:01.759084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:01.761061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:01.762409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:01.765068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:02.214370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:02.228370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a6a63536-e45c-4a77-b461-5b2d3ffc34a9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.490006 Sep 23 04:15:02.230603 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2985/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:01 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:02.763403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d1e7-031d-4610-8db1-fd69745dc334", "tag": "7c4117ab-f9bd-4155-827f-9f170024d39a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:02.796144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:02.798651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:02.800102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:02.845794 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] Creating event network-changed:7c4117ab-f9bd-4155-827f-9f170024d39a for instance 0681d1e7-031d-4610-8db1-fd69745dc334 on n-h2-858495-2 Sep 23 04:15:02.859008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2b49f2b1-b558-4ba7-8f9f-8c1c09acac12 req-7084d316-c9d3-4f1f-8fdb-c61ff436d751 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098503 Sep 23 04:15:02.861340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2923/5908] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:03.260913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:03.261554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:03.277517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:03.282037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:03.286219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:03.287195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:03.288058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:03.288679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:03.715667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:03.731046 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f59eba45-f638-49b3-b303-3fa8975ffb7e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.472747 Sep 23 04:15:03.734412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2986/5909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:03 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:04.760661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:04.761371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:04.771942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:04.773013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:04.774792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:04.778241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:04.780475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:04.783778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:05.074483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:05.084961 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-244ff482-051c-4ba3-a7ea-e65e1e004b2a tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.329288 Sep 23 04:15:05.086646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2924/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:04 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:05.454397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:05.455001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:05.492189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:05.492694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:05.493144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:05.493893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:05.494800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:05.495379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:05.519502 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e HTTP/1.1 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '6741243b-b27c-4e67-a424-085ca4b2692e'} Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:15:05.530401 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d4922e02-09a8-4e47-8f7c-ff40aba8d1e4 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 404 len: 111 microversion: 2.1 time: 0.082126 Sep 23 04:15:05.534650 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2987/5911] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:15:05 2022] DELETE /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:05.542170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:05.543155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] [instance: 6741243b-b27c-4e67-a424-085ca4b2692e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:05.554471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:05.555772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:05.557451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:05.559222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:05.561054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:05.561880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:05.603542 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] HTTP exception thrown: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Request method failure captured: Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e HTTP/1.1 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTEJ1-HynnkerPunjNOxDEMzGYakQRSxiM6eGxuOMRHNuJraLYqFcRQeE-JEP2jsgZ2NTIREmtn2SbbC65ba7mMbke3Hp0lJZl8YDy0VmrmIxEOAbN5aHlJ-BfdzRiE-15FoFkfWzHXxN0XW-qz1zJte307LbHpuSwlHZ5kCvjK3qao Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfd88f113124be8892a9c850eb992e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0bfd88f113124be8892a9c850eb992e2 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1631440228 Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 14fc1741357b4427a9fa52488a7e99dc Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-AttachVolumeTestJSON-1631440228-project Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '6741243b-b27c-4e67-a424-085ca4b2692e'} Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:05.610355 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. Sep 23 04:15:05.614688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:05.616514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] Returning 404 to user: Instance 6741243b-b27c-4e67-a424-085ca4b2692e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:05.617812 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd6b0afb-44d8-49e0-9707-3d3bad7c41d9 tempest-AttachVolumeTestJSON-1631440228 tempest-AttachVolumeTestJSON-1631440228-project] 10.222.0.25 "GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e" status: 404 len: 111 microversion: 2.1 time: 0.080018 Sep 23 04:15:05.618886 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2925/5912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:05 2022] GET /compute/v2.1/servers/6741243b-b27c-4e67-a424-085ca4b2692e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:06.110391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:06.111238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:06.122583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:06.124008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:06.124763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:06.126717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:06.127547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:06.128140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:06.522017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:06.538007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f40e70e3-d47e-4487-88c0-83b9a23e4528 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.432010 Sep 23 04:15:06.551716 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2988/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:06 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:07.561586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:07.563385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:07.570111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:07.572958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:07.596329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:07.599780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:07.600390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:07.601508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:07.602287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:07.605943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:08.211353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:08.224207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e1a4e53-6a11-4bff-b2c9-3b845839c6ea tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.663934 Sep 23 04:15:08.229458 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2926/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:07 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:09.252786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:09.258164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:09.263039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:09.283217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:09.284799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:09.285590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:09.286500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:09.287380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:09.288454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:09.651900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:09.665673 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7a6ac356-a9c7-4d74-be3c-4b7c2c748a04 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.417877 Sep 23 04:15:09.667581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2989/5915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:09 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:10.694851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:10.695475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:10.711129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:10.711638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:10.712081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:10.716639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:10.718223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:10.720733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:11.456163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:11.468072 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6dbc5b5b-4c0e-4126-882a-9cfc478141ed tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.776971 Sep 23 04:15:11.485560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2927/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:10 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:11.591041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d1e7-031d-4610-8db1-fd69745dc334", "name": "network-vif-plugged", "status": "completed", "tag": "7c4117ab-f9bd-4155-827f-9f170024d39a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:11.611821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:11.613267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:11.615016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:11.660573 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] Creating event network-vif-plugged:7c4117ab-f9bd-4155-827f-9f170024d39a for instance 0681d1e7-031d-4610-8db1-fd69745dc334 on n-h2-858495-2 Sep 23 04:15:11.670182 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ac5ced2e-bceb-4e11-9235-64d01c0a1ddf req-d662c955-87c7-406a-818c-e70b9ee4fba8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393740 Sep 23 04:15:11.670916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2990/5917] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:15:12.494927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:12.495614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:12.508861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:12.509461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:12.514096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:12.514900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:12.515457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:12.517875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:12.871848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:12.889006 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7cc211e-f7ed-414e-bc07-453535f7f10d tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1470 microversion: 2.1 time: 0.397302 Sep 23 04:15:12.908179 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2928/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:12 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:13.818608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc4b48a4-77cc-4d90-914b-e4f874d8b96f tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Action: 'create', calling method: .version_select at 0x7f0c8afe6040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-945597467"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:13.913719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:13.915772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:13.927480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:13.928057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:13.928459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:13.929182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:13.929683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:13.930121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:14.182068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:14.193808 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-109046ae-0dad-4f06-a384-e838bd07fba7 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1642 microversion: 2.1 time: 0.285455 Sep 23 04:15:14.196937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2929/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:13 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1642 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:14.233099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:14.235693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:14.251789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:14.252660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:14.253112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:14.253868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:14.254330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:14.260215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:14.342356 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc4b48a4-77cc-4d90-914b-e4f874d8b96f tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.688273 Sep 23 04:15:14.344736 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2991/5920] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Sep 23 04:15:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 691 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 04:15:14.364157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b629df8-81f1-4d0f-8b35-14c8d9ede52a tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a8d0430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:14.507247 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b629df8-81f1-4d0f-8b35-14c8d9ede52a tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 200 len: 344 microversion: 2.1 time: 0.152494 Sep 23 04:15:14.509482 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2992/5921] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:14 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:14.611434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:14.622061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d32e0b10-866d-4057-99e3-07b9646ae6ec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1642 microversion: 2.1 time: 0.407135 Sep 23 04:15:14.622916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2930/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:14 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1642 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:15:14.645790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:14.647944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:14.659902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:14.671366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:14.673452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:14.677820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:14.678448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:14.679120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:14.797778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-444460928", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "bc40aa02-f8a1-4477-a792-3d58fcf04658"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:14.925616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] validate_networks() for [('bc40aa02-f8a1-4477-a792-3d58fcf04658', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:15:15.727910 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73ac0c74-6d81-4518-94d0-c232431112cd tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1793 microversion: 2.1 time: 1.086585 Sep 23 04:15:15.736160 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2993/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:14 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1793 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:15.753454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f636d22e-eb7d-4c3c-bc6b-4d8f891efdfa tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a789d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:15.847197 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f636d22e-eb7d-4c3c-bc6b-4d8f891efdfa tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 200 len: 344 microversion: 2.1 time: 0.109483 Sep 23 04:15:15.848252 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2994/5924] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:15 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:16.117289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:15:16.118418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:15:16.119250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:15:16.119819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:15:16.121024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:15:16.140475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:16.141788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:16.143140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:16.144032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:16.144709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:16.145176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:16.167230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Getting quotas for project edde974c6d3c419e9bdee21add07c419. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:15:16.174230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Getting quotas for user 56b373ae88da41f2afacd87082d047d5 and project edde974c6d3c419e9bdee21add07c419. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:15:16.188403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:15:16.191533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:15:16.246936 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9ac0c41-0b39-4e15-adbc-f2bd76b09aae tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456337 Sep 23 04:15:16.259288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90d230ac-b9be-454e-b061-fd3bfbd3fbe1 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:16.260280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90d230ac-b9be-454e-b061-fd3bfbd3fbe1 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:16.264795 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2931/5925] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:15:16.345925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-90d230ac-b9be-454e-b061-fd3bfbd3fbe1 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:16.364757 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90d230ac-b9be-454e-b061-fd3bfbd3fbe1 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1218 microversion: 2.1 time: 0.109259 Sep 23 04:15:16.365723 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2995/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:16 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:16.872750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbaf5911-2a6d-4c46-a0cb-b99ac9beaeca tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a5d9790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:16.982141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbaf5911-2a6d-4c46-a0cb-b99ac9beaeca tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 200 len: 345 microversion: 2.1 time: 0.120251 Sep 23 04:15:16.983078 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2932/5927] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:16 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:17.010103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea0d119e-f8c2-4d46-912c-49a19f97d422 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Action: 'create', calling method: .version_select at 0x7f0c8b18f4c0>, body: {"snapshot": {"volume_id": "3b0f829d-4115-490e-b903-c62495e6ed73", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-244503198"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:17.275183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea0d119e-f8c2-4d46-912c-49a19f97d422 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.282395 Sep 23 04:15:17.282048 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2996/5928] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Sep 23 04:15:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:17.288077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9e6d6b7-7393-4f0e-98d2-d37d02818198 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8aadfc10>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:17.352848 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9e6d6b7-7393-4f0e-98d2-d37d02818198 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 286 microversion: 2.1 time: 0.069453 Sep 23 04:15:17.354200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2933/5929] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:17 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:17.366037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72ad9eda-e585-41ce-8ec8-9f3fb2f99466 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8b735b80>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:17.388484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:17.389111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:17.401336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:17.402586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:17.405018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:17.406566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:17.407990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:17.411366 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72ad9eda-e585-41ce-8ec8-9f3fb2f99466 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.049098 Sep 23 04:15:17.412911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2997/5930] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 23 04:15:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:15:17.416540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:17.428326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78a5193c-6040-4d6a-baa8-db90b17dc1a2 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8afe6d30>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:17.475331 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78a5193c-6040-4d6a-baa8-db90b17dc1a2 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 286 microversion: 2.1 time: 0.054278 Sep 23 04:15:17.489489 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2998/5931] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:17 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:17.519202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:17.530413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17a5623e-c346-4869-97b4-2c786916ce46 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1270 microversion: 2.1 time: 0.145868 Sep 23 04:15:17.546325 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2934/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:17 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:18.489104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f50d6557-62cd-453d-9e30-17e72c74aff9 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a8d0430>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:18.545647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f50d6557-62cd-453d-9e30-17e72c74aff9 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 286 microversion: 2.1 time: 0.060863 Sep 23 04:15:18.546555 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 2999/5933] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:18 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:18.566579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:18.568154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:18.577126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:18.578488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:18.579229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:18.580804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:18.581506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:18.582147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:18.688088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:18.707980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c760f4fd-a7b9-45da-8520-cab38d23ac21 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1276 microversion: 2.1 time: 0.158086 Sep 23 04:15:18.710354 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2935/5934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:18 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:19.542155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d1e7-031d-4610-8db1-fd69745dc334", "tag": "7c4117ab-f9bd-4155-827f-9f170024d39a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:19.558544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63070576-b4d7-4939-800a-109b77578248 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a2f3430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:19.575626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:19.576429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:19.578615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:19.600940 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] Creating event network-changed:7c4117ab-f9bd-4155-827f-9f170024d39a for instance 0681d1e7-031d-4610-8db1-fd69745dc334 on n-h2-858495-2 Sep 23 04:15:19.610552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6caa35f8-c528-4660-8a64-159faf3c7e39 req-7ab11118-6e99-4377-9933-6e6a39be8065 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576024 Sep 23 04:15:19.612703 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3000/5935] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:19.621311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63070576-b4d7-4939-800a-109b77578248 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 287 microversion: 2.1 time: 0.066712 Sep 23 04:15:19.622865 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2936/5936] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:19 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:19.638755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3165ab72-b3ee-49c0-abf6-9875836fd9cd tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8afe60d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:19.732229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:19.733043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:19.736002 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3165ab72-b3ee-49c0-abf6-9875836fd9cd tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 202 len: 0 microversion: 2.1 time: 0.103535 Sep 23 04:15:19.736586 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3001/5937] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Sep 23 04:15:19 2022] DELETE /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:15:19.745838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adce2cef-4adf-41dc-b384-41ee7902348c tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8b1c90d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:19.753320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:19.755090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:19.756325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:19.758851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:19.759440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:19.766571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:19.820946 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adce2cef-4adf-41dc-b384-41ee7902348c tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 286 microversion: 2.1 time: 0.079678 Sep 23 04:15:19.821553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3002/5938] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:19 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:15:20.232102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:20.245503 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32ba3f74-0626-457b-9c04-936baea39edc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.518134 Sep 23 04:15:20.246513 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2937/5939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:19 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:15:20.842322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-39b0ea3c-1b54-42aa-af51-67884bd3828d tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a8d7dc0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:20.918536 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-39b0ea3c-1b54-42aa-af51-67884bd3828d tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 200 len: 286 microversion: 2.1 time: 0.086393 Sep 23 04:15:20.924591 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3003/5940] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:20 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:21.279071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:21.281804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:21.293116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:21.294298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:21.294902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:21.295920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:21.296569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:21.297280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:21.451150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:21.462070 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79efbda6-bc86-42f4-8d95-c95da191b744 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.187850 Sep 23 04:15:21.462898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2938/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:21 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:21.645651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b12acf-74bb-4feb-88fd-ab527390fac4", "tag": "afb15f7b-7461-4925-a3f3-d7342d5e8919"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:21.665659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:21.666404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:21.666976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:21.682382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] Creating event network-changed:afb15f7b-7461-4925-a3f3-d7342d5e8919 for instance 04b12acf-74bb-4feb-88fd-ab527390fac4 on n-h1-858495-2 Sep 23 04:15:21.689277 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2fc717ba-1af3-4c8c-9cfb-ff3bded6c166 req-bee071ad-8f4e-46b4-9f2d-9c0041102a53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049176 Sep 23 04:15:21.690516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3004/5942] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:21.938104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4c67caf-3d1b-4274-ad51-e440d1625ac3 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c89c90310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:21.980652 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b4c67caf-3d1b-4274-ad51-e440d1625ac3 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] HTTP exception thrown: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4c67caf-3d1b-4274-ad51-e440d1625ac3 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Request method failure captured: Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 HTTP/1.1 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTLRxYzGjhwJpWTgd6pR9S4wxb4coUWp7iAGL2vDd0hlH15LfJp26_GP_sgcTM0Wl8XGcanMZ_M2jOmAlOLaXaaApukuXBvHzhoh0YYCV3d83KdKbDKLvcKhsvtf2TN79srytJ1oJWUT1tmAZMdmUPqUeo3-0oobG5Jkp9eZZ7rjjtY Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b88690e434d24027982034739cc1086e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b88690e434d24027982034739cc1086e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7b9fa68ee478441cb62843a9f70e18b8 Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: exception: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '9c49e205-e256-4a18-b7a0-97849e5e37d4'} Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. (HTTP 404) (Request-ID: req-228894bf-16da-4e35-97e0-5eff37ebf57c) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:15:21.988688 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4c67caf-3d1b-4274-ad51-e440d1625ac3 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Returning 404 to user: Snapshot 9c49e205-e256-4a18-b7a0-97849e5e37d4 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b4c67caf-3d1b-4274-ad51-e440d1625ac3 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4" status: 404 len: 111 microversion: 2.1 time: 0.057015 Sep 23 04:15:21.992624 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2939/5943] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 04:15:21 2022] GET /compute/v2.1/os-snapshots/9c49e205-e256-4a18-b7a0-97849e5e37d4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:22.000442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-476030e5-fb2f-4a27-82fb-0b9181456401 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a8e2a60>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:22.072793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-476030e5-fb2f-4a27-82fb-0b9181456401 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 202 len: 0 microversion: 2.1 time: 0.077140 Sep 23 04:15:22.077202 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3005/5944] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:15:21 2022] DELETE /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:15:22.082164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-610f0443-453e-4a18-9d00-9ff3bd3c786b tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a3510d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:22.135799 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-610f0443-453e-4a18-9d00-9ff3bd3c786b tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 200 len: 344 microversion: 2.1 time: 0.057800 Sep 23 04:15:22.141741 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2940/5945] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:22 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:15:22.493779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:22.494418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:22.501754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:22.502340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:22.502785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:22.503498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:22.503961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:22.504395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:22.660539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:22.679766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-af2abcbd-1ea1-4919-9758-a5bfe84b55ee tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.194706 Sep 23 04:15:22.681075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3006/5946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:22 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:23.164858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7f1dc65-0e9a-4183-8690-be8830fb6366 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a630700>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:23.320331 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7f1dc65-0e9a-4183-8690-be8830fb6366 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 200 len: 344 microversion: 2.1 time: 0.167459 Sep 23 04:15:23.322677 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2941/5947] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:23 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:23.703763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:23.704374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:23.711774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:23.712261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:23.712886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:23.713638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:23.714097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:23.714688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:23.855386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:23.864594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e7e4a14-b965-41a9-adc2-e85fe952616c tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.164777 Sep 23 04:15:23.865181 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3007/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:23 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:24.337651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e92d7994-cb77-428a-9fcb-7ee871fb45cb tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a645790>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:24.373579 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-e92d7994-cb77-428a-9fcb-7ee871fb45cb tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] HTTP exception thrown: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e92d7994-cb77-428a-9fcb-7ee871fb45cb tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Request method failure captured: Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 HTTP/1.1 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTLRxYzGjhwJpWTgd6pR9S4wxb4coUWp7iAGL2vDd0hlH15LfJp26_GP_sgcTM0Wl8XGcanMZ_M2jOmAlOLaXaaApukuXBvHzhoh0YYCV3d83KdKbDKLvcKhsvtf2TN79srytJ1oJWUT1tmAZMdmUPqUeo3-0oobG5Jkp9eZZ7rjjtY Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b88690e434d24027982034739cc1086e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b88690e434d24027982034739cc1086e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7b9fa68ee478441cb62843a9f70e18b8 Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: exception: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3b0f829d-4115-490e-b903-c62495e6ed73'} Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. (HTTP 404) (Request-ID: req-47b79091-410d-409e-a7b0-b44e3cd92d58) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:15:24.375766 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.379611 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.383381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e92d7994-cb77-428a-9fcb-7ee871fb45cb tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Returning 404 to user: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:24.384440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e92d7994-cb77-428a-9fcb-7ee871fb45cb tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 404 len: 109 microversion: 2.1 time: 0.052248 Sep 23 04:15:24.385531 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2942/5949] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:24 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:24.397337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47bc9f3c-b0e6-4938-b442-6a890d456736 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a8cb310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:24.428714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-47bc9f3c-b0e6-4938-b442-6a890d456736 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] HTTP exception thrown: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47bc9f3c-b0e6-4938-b442-6a890d456736 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Request method failure captured: Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 HTTP/1.1 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTLRxYzGjhwJpWTgd6pR9S4wxb4coUWp7iAGL2vDd0hlH15LfJp26_GP_sgcTM0Wl8XGcanMZ_M2jOmAlOLaXaaApukuXBvHzhoh0YYCV3d83KdKbDKLvcKhsvtf2TN79srytJ1oJWUT1tmAZMdmUPqUeo3-0oobG5Jkp9eZZ7rjjtY Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b88690e434d24027982034739cc1086e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b88690e434d24027982034739cc1086e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7b9fa68ee478441cb62843a9f70e18b8 Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: method: Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: exception: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3b0f829d-4115-490e-b903-c62495e6ed73'} Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. (HTTP 404) (Request-ID: req-8b3a6521-4e11-4c7e-80bc-a403d55b6a78) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:15:24.430829 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.434464 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.438459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47bc9f3c-b0e6-4938-b442-6a890d456736 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Returning 404 to user: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:24.439517 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47bc9f3c-b0e6-4938-b442-6a890d456736 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 404 len: 109 microversion: 2.1 time: 0.047717 Sep 23 04:15:24.440563 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3008/5950] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 23 04:15:24 2022] DELETE /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:24.448568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3efd639a-02f4-4b99-94a9-156a7450f9c7 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Calling method '.version_select at 0x7f0c8a7e1310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:24.494189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3efd639a-02f4-4b99-94a9-156a7450f9c7 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] HTTP exception thrown: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3efd639a-02f4-4b99-94a9-156a7450f9c7 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Request method failure captured: Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 HTTP/1.1 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTLRxYzGjhwJpWTgd6pR9S4wxb4coUWp7iAGL2vDd0hlH15LfJp26_GP_sgcTM0Wl8XGcanMZ_M2jOmAlOLaXaaApukuXBvHzhoh0YYCV3d83KdKbDKLvcKhsvtf2TN79srytJ1oJWUT1tmAZMdmUPqUeo3-0oobG5Jkp9eZZ7rjjtY Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b88690e434d24027982034739cc1086e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b88690e434d24027982034739cc1086e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b88690e434d24027982034739cc1086e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: b88690e434d24027982034739cc1086e Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115134015 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7b9fa68ee478441cb62843a9f70e18b8 Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115134015-project Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: method: Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: exception: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3b0f829d-4115-490e-b903-c62495e6ed73'} Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. (HTTP 404) (Request-ID: req-3c0e97ee-bbda-4869-abfb-ebd55b4438f4) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:15:24.496300 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. Sep 23 04:15:24.501025 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:24.505917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3efd639a-02f4-4b99-94a9-156a7450f9c7 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] Returning 404 to user: Volume 3b0f829d-4115-490e-b903-c62495e6ed73 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:24.506981 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3efd639a-02f4-4b99-94a9-156a7450f9c7 tempest-VolumesSnapshotsTestJSON-2115134015 tempest-VolumesSnapshotsTestJSON-2115134015-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73" status: 404 len: 109 microversion: 2.1 time: 0.062459 Sep 23 04:15:24.507731 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2943/5951] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 23 04:15:24 2022] GET /compute/v2.1/os-volumes/3b0f829d-4115-490e-b903-c62495e6ed73 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:24.891511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:24.892733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:24.906566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:24.907159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:24.907596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:24.908300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:24.908754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:24.909181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:25.191597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:25.203178 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d8640b2-a259-47ce-9d0e-d2cb5d12cecf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.317972 Sep 23 04:15:25.205510 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3009/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:24 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:25.293752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b12acf-74bb-4feb-88fd-ab527390fac4", "name": "network-vif-plugged", "status": "completed", "tag": "afb15f7b-7461-4925-a3f3-d7342d5e8919"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:25.324445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:25.325107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:25.325759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:25.339676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] Creating event network-vif-plugged:afb15f7b-7461-4925-a3f3-d7342d5e8919 for instance 04b12acf-74bb-4feb-88fd-ab527390fac4 on n-h1-858495-2 Sep 23 04:15:25.347363 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e33bcfc2-8497-407b-bf68-df290d32a17d req-0b55c093-120e-47f3-97dc-7b860e9bda6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059709 Sep 23 04:15:25.348256 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2944/5953] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:26.227839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:26.228522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:26.237747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.238271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.238913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:26.239632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.240101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.240697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:26.349194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.350616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.362587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.512644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:26.536032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1488efa9-ab67-465f-8690-b86d3d7beae5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1318 microversion: 2.1 time: 0.310761 Sep 23 04:15:26.538899 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3010/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:26 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:26.800966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:26.801590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:26.803649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.811935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.812630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.813074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:26.813808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.814416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.814995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:26.819620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=86 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.854903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:15:26.944740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b09738e6-67b0-4e94-b1ba-134f19c2c1a8 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 204 len: 0 microversion: 2.1 time: 0.597445 Sep 23 04:15:26.957515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2945/5955] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:15:26 2022] DELETE /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:15:26.959418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:26.962258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:26.970011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=39 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:26.971929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.972433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.972876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:26.973625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:26.974399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:26.974973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:27.007370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=71 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:15:27.160853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:27.170421 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a62cd75d-b9e8-44e3-8cb6-323ee6596d79 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1733 microversion: 2.1 time: 0.215091 Sep 23 04:15:27.171901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3011/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:26 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:27.566598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:27.569148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:27.578701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:27.579336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:27.580128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:27.582639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:27.583379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:27.583906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:27.790594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:27.799567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85d9d1c4-30c7-4c61-9170-8714875e0253 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1508 microversion: 2.1 time: 0.240176 Sep 23 04:15:27.800331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2946/5957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:27 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:28.195338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:28.195918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:28.203140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:28.203633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:28.204079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:28.204792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:28.205254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:28.205717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:28.534133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:28.545042 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab91381e-57f2-4e63-b05b-22953f681958 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1733 microversion: 2.1 time: 0.353414 Sep 23 04:15:28.546901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3012/5958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:28 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1733 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:29.568971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:29.571204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:29.588693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:29.589235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:29.589708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:29.592588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:29.593597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:29.594454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:29.767160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:29.775943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cb49ec98-9613-46cd-8ba1-a2de65b810d7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1665 microversion: 2.1 time: 0.211700 Sep 23 04:15:29.781373 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2947/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:29 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1665 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:30.619214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2789b6-fc1d-4ae8-99d4-43719f865d99", "name": "network-vif-deleted", "tag": "8407317e-0415-434b-8811-5ffa6eb47047"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:15:30.630524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:30.631778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:30.632537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:30.658363 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] Creating event network-vif-deleted:8407317e-0415-434b-8811-5ffa6eb47047 for instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 on n-h1-858495-2 Sep 23 04:15:30.678377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-11fb5cc6-d7f3-4252-89cf-dc3a0012c35a req-6ea8628e-dba2-4fd1-bc4e-fb211d202940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062809 Sep 23 04:15:30.682017 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3013/5960] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:15:30.813059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:30.813740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:30.829509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:30.830006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:30.830446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:30.831167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:30.840037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:30.846824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:30.897471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:30.898293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:30.899875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:30.900414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lazy-loading 'fault' on Instance uuid 0b2789b6-fc1d-4ae8-99d4-43719f865d99 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:15:30.994312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de743dbd1f94ab48b992d9696a710ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da0fb42f40b42a086a4ae7e2e6473de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:15:31.008797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd07a474-f4b9-43c2-88af-3b311be09d57 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 200 len: 1388 microversion: 2.1 time: 0.205670 Sep 23 04:15:31.010210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2948/5961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:30 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 1388 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:15:32.034656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:32.035643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:32.053475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:32.056020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:32.058128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:32.059676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:32.063512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:32.066306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:32.086733 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] HTTP exception thrown: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Request method failure captured: Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 HTTP/1.1 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTGe7tIU9tYwktGQdNSxFbOW9KqDUW7vbYYsG5SoXfZ0Jc2gSqdU1n4JooyEFmh_v_gzFV67ZRB17IOmpRxiSUrIzLjb09KSclFfTOL5vFs-xOzxJoUS875NEZkFXWs5olQBEzXB6leTxd2LiGpHBtfAicTBdaQwQfKO44oig87-1jA Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestServerBasicOps-428829600 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7de743dbd1f94ab48b992d9696a710ab Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0b2789b6-fc1d-4ae8-99d4-43719f865d99'} Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:32.088628 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:32.094180 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:32.096481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Returning 404 to user: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:32.098964 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f717d4c-6629-4205-8c31-7ceacd66bd87 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 404 len: 111 microversion: 2.1 time: 0.070576 Sep 23 04:15:32.100091 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3014/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:32 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:33.126987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:33.128337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:33.145187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:33.148230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:33.149180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:33.152795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:33.153869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:33.157375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:33.192065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] HTTP exception thrown: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Request method failure captured: Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 HTTP/1.1 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTGe7tIU9tYwktGQdNSxFbOW9KqDUW7vbYYsG5SoXfZ0Jc2gSqdU1n4JooyEFmh_v_gzFV67ZRB17IOmpRxiSUrIzLjb09KSclFfTOL5vFs-xOzxJoUS875NEZkFXWs5olQBEzXB6leTxd2LiGpHBtfAicTBdaQwQfKO44oig87-1jA Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 7de743dbd1f94ab48b992d9696a710ab Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '0b2789b6-fc1d-4ae8-99d4-43719f865d99'} Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:15:33.199497 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.204769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Returning 404 to user: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:33.207253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3018770-c094-4cbd-a39c-e1900fafa660 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 404 len: 111 microversion: 2.1 time: 0.078838 Sep 23 04:15:33.210934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2949/5963] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:15:33 2022] DELETE /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:33.228329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:33.229413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] [instance: 0b2789b6-fc1d-4ae8-99d4-43719f865d99] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:15:33.243472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:33.245829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:33.249816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:33.251464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:15:33.252095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:15:33.252704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:15:33.287989 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] HTTP exception thrown: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Request method failure captured: Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 HTTP/1.1 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTGe7tIU9tYwktGQdNSxFbOW9KqDUW7vbYYsG5SoXfZ0Jc2gSqdU1n4JooyEFmh_v_gzFV67ZRB17IOmpRxiSUrIzLjb09KSclFfTOL5vFs-xOzxJoUS875NEZkFXWs5olQBEzXB6leTxd2LiGpHBtfAicTBdaQwQfKO44oig87-1jA Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8da0fb42f40b42a086a4ae7e2e6473de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 8da0fb42f40b42a086a4ae7e2e6473de Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestServerBasicOps-428829600 Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7de743dbd1f94ab48b992d9696a710ab Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestServerBasicOps-428829600-project Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0b2789b6-fc1d-4ae8-99d4-43719f865d99'} Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:15:33.294378 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. Sep 23 04:15:33.301138 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:15:33.303993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Returning 404 to user: Instance 0b2789b6-fc1d-4ae8-99d4-43719f865d99 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:15:33.305517 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1eb20ec9-39e6-42c3-94b0-3e886929b2aa tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99" status: 404 len: 111 microversion: 2.1 time: 0.082757 Sep 23 04:15:33.310176 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3015/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:15:33 2022] GET /compute/v2.1/servers/0b2789b6-fc1d-4ae8-99d4-43719f865d99 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:15:33.685158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-739f0ad2-9a70-4ee5-aeb1-9798b8c544f7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] Calling method '.version_select at 0x7f0c8a5bf4c0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:15:33.738440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-739f0ad2-9a70-4ee5-aeb1-9798b8c544f7 tempest-TestServerBasicOps-428829600 tempest-TestServerBasicOps-428829600-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1254601521" status: 202 len: 0 microversion: 2.1 time: 0.056509 Sep 23 04:15:33.740342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2950/5965] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Sep 23 04:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1254601521 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:16:03.429849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5387a317-4097-4aaf-bd86-d096739ad5d5", "device": "/dev/sdb"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:03.433508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:03.453043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:03.461672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=17 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:03.469599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:03.470775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:03.471381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:03.472299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:03.474820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:03.475963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:04.265125 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47573efc-454c-472b-9a66-f045cf34bff8 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "POST /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839744 Sep 23 04:16:04.278173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3016/5966] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:16:03 2022] POST /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:16:13.753398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-919262526", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c78e90c3-eb1e-4194-8ad3-a28f1ccb34c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:13.790806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:13.791496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:13.891967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:16:14.742143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:16:14.743337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:16:14.743952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:16:14.744521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:16:14.751907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:16:14.772922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:14.776940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:14.777997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:14.779330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:14.780161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:14.784887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:14.857586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:16:14.874547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:16:15.022022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:16:15.025318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c78e90c3-eb1e-4194-8ad3-a28f1ccb34c2',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:16:15.270056 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-355eac3d-933d-4682-ad47-a1c5e54e3d91 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520452 Sep 23 04:16:15.277334 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2951/5967] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:16:15.284479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c31b36fd-cde4-438b-b39b-5b8300455d19 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:15.285195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c31b36fd-cde4-438b-b39b-5b8300455d19 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:15.304913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:15.311351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:15.513115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c31b36fd-cde4-438b-b39b-5b8300455d19 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:15.525473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c31b36fd-cde4-438b-b39b-5b8300455d19 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1056 microversion: 2.1 time: 0.245208 Sep 23 04:16:15.528687 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3017/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:15 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1056 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:16.572723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:16.573965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:16.602925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:16.604193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:16.620279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:16.623549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:16.624232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:16.624835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:16.818797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:16.844118 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-767c9fac-75b1-498d-9a06-fec97996802a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1154 microversion: 2.1 time: 0.282484 Sep 23 04:16:16.845736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2952/5969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:16 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1154 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:17.872560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:17.873917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:17.883700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:17.884408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:17.885019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:17.886279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:17.886885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:17.888050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:18.014921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:18.027206 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c10c36b-be70-4c5a-b858-b89d65099eb6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1172 microversion: 2.1 time: 0.159607 Sep 23 04:16:18.031944 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3018/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:17 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1172 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:19.062829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:19.064231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:19.078420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:19.081553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:19.083922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:19.084793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:19.086015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:19.086451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:19.212707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:19.229311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1a6fea6-685e-4444-8da9-b205044cdf49 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1172 microversion: 2.1 time: 0.171097 Sep 23 04:16:19.229939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2953/5971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:19 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1172 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:20.255503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:20.256377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:20.266530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:20.267196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:20.268451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:20.269516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:20.270461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:20.271577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:20.559549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:20.570091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-41acced6-a715-4ea1-9a0e-1c8bdb772857 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1214 microversion: 2.1 time: 0.320789 Sep 23 04:16:20.571172 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3019/5972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:20 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:21.211835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc33401c-81b2-4b17-8049-f58a161892e4", "tag": "6e49e733-6308-4d80-931c-a9f45759e4e8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:21.229576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:21.230236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:21.231410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:21.246972 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] Creating event network-changed:6e49e733-6308-4d80-931c-a9f45759e4e8 for instance fc33401c-81b2-4b17-8049-f58a161892e4 on n-h1-858495-2 Sep 23 04:16:21.252471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-16f39e09-9325-4893-8cef-f890889069e1 req-c08b687b-d3d4-4042-ae91-a51443efdc3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044146 Sep 23 04:16:21.253874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2954/5973] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:21.594164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:21.595570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:21.607359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:21.611231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:21.611739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:21.612623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:21.614417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:21.615121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:22.216320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:22.227982 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b726770c-822e-4ca2-b469-da25228ff968 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1214 microversion: 2.1 time: 0.637972 Sep 23 04:16:22.231530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3020/5974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:21 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1214 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:23.254621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:23.255597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:23.270138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:23.273397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:23.274203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:23.277295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:23.278024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:23.279764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:23.767418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:23.781039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c45498ff-34dd-443d-882a-870d9b948550 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1214 microversion: 2.1 time: 0.531824 Sep 23 04:16:23.811531 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2955/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:23 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1214 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:24.826288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:24.827535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:24.867665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:24.875077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:24.880667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:24.882427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:24.885744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:24.889070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:25.518015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:25.703622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:25.727957 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-285df96b-fe94-4772-b407-b75c1af87ea6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1214 microversion: 2.1 time: 0.906369 Sep 23 04:16:25.733507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3021/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:24 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1214 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:26.753975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:26.754488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:26.769601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:26.772515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:26.776883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:26.780283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:26.780808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:26.782445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:26.782988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:26.787851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:27.514155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:27.529193 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-840afaef-8b38-4e80-948d-1cda1c89549a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1214 microversion: 2.1 time: 0.776423 Sep 23 04:16:27.542412 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2956/5977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:26 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1214 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:28.563817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:28.564484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:28.584508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:28.588458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:28.592021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:28.597433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:28.599188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:28.599836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:29.128344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:29.144309 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cca89815-edc7-44cb-902d-e677a83837bf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 0.584613 Sep 23 04:16:29.144926 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3022/5978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:28 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:30.171687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:30.173291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:30.184800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:30.189252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:30.189759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:30.190524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:30.190990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:30.193928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:30.710393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:30.721508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-79e44492-516d-47da-ad23-1b45bc23867a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 0.553789 Sep 23 04:16:30.722641 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2957/5979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:30 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:31.758695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:31.760623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:31.788393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:31.789199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:31.791503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:31.792451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:31.794253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:31.796855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:32.492272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:32.523764 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-56c7ea80-809a-4380-ab43-5ceb4b21667d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 0.774038 Sep 23 04:16:32.541743 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3023/5980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:31 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:33.548210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:33.549043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:33.557922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:33.559346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:33.560298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:33.561315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:33.562049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:33.562707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:34.491273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:34.529546 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f303a670-5722-4248-b948-509f2cf2b290 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 0.985995 Sep 23 04:16:34.530859 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2958/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:33 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:35.553056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:35.553724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:35.577956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:35.587100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:35.587576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:35.588346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:35.588818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:35.589249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:36.541143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:36.559830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d6b3c73d-f727-433a-ab6d-e008e0eadd0e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 1.010932 Sep 23 04:16:36.561259 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3024/5982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:35 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:37.584776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:37.585600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:37.611100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:37.611777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:37.612328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:37.614883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:37.616660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:37.617212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:38.286267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1738004455", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "112194db-f0b1-4930-b577-53909c2b74a7"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:38.359972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] validate_networks() for [('112194db-f0b1-4930-b577-53909c2b74a7', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:16:38.631094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:38.654142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b27ca839-f885-4e1f-9782-1fef41b321b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1202 microversion: 2.1 time: 1.073668 Sep 23 04:16:38.658015 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2959/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:37 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1202 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:38.679644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc33401c-81b2-4b17-8049-f58a161892e4", "name": "network-vif-plugged", "status": "completed", "tag": "6e49e733-6308-4d80-931c-a9f45759e4e8"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:38.693638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:38.694401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:38.695041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:38.720979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] Creating event network-vif-plugged:6e49e733-6308-4d80-931c-a9f45759e4e8 for instance fc33401c-81b2-4b17-8049-f58a161892e4 on n-h1-858495-2 Sep 23 04:16:38.730994 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d1aa06da-989a-4dfd-92cc-6c4fe69a811f req-2c599041-066c-4699-b610-3c3f9d5f294d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070488 Sep 23 04:16:38.733665 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2960/5984] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:39.017679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1866095313", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "2dcbe5de-99f7-4bca-877e-b7170d119d7e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-308477467", "security_groups": []}, "os:scheduler_hints": {"different_host": ["0681d1e7-031d-4610-8db1-fd69745dc334"]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:39.145770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] validate_networks() for [('2dcbe5de-99f7-4bca-877e-b7170d119d7e', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:16:40.247981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:16:40.248575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:16:40.248874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:16:40.249287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:16:40.249730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:16:40.270782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:40.271277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:40.271721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:40.272456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:40.272916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:40.273374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:40.319489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Getting quotas for project b6ec634f59004b23867be72f4da1850c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:16:40.332626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Getting quotas for user a58e0e29c5ff4a4bb875604e8aac339d and project b6ec634f59004b23867be72f4da1850c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:16:40.347609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:16:40.350103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:16:40.427401 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a2f885f-00d5-414d-8207-b0d1d231ba62 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.411577 Sep 23 04:16:40.436137 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3025/5985] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:16:40.446946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:40.447909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:40.489296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:40.489837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:40.490279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:40.490999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:40.491462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:40.491896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:40.967056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:40.985667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-950b2bea-ee23-4dc2-90a0-5147373ba9c3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1389 microversion: 2.1 time: 0.547439 Sep 23 04:16:40.994924 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3026/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:40 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1389 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:41.017265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df43a345-5cda-4cb6-af6c-f47e7380241c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:41.019432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df43a345-5cda-4cb6-af6c-f47e7380241c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:41.161437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df43a345-5cda-4cb6-af6c-f47e7380241c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:41.169386 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df43a345-5cda-4cb6-af6c-f47e7380241c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1215 microversion: 2.1 time: 0.170456 Sep 23 04:16:41.169998 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3027/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:40 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:41.184796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:41.184796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:41.192598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:16:41.193265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:16:41.193978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:16:41.194533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:16:41.195074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:16:41.207425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.207862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.213312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.214943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:41.216561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.217225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.217852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:41.220925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.221588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.223551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:41.226100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.226868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:41.297062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:16:41.311721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Getting quotas for user 9cb91664432b427eadcec9f0da90b21b and project dafa3d1a58594c61aeb53df74a237ed1. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:16:41.346625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:16:41.352308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:16:41.429439 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e1dab5c5-6dfb-4c20-b0ec-838ecbee8471 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.416332 Sep 23 04:16:41.430444 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2961/5988] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:16:39 2022] POST /compute/v2.1/servers => generated 361 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:16:41.441653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59fed396-b2f8-495f-b920-6de62b45e4c3 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:41.442276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-59fed396-b2f8-495f-b920-6de62b45e4c3 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:41.616632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-59fed396-b2f8-495f-b920-6de62b45e4c3 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:41.632327 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-59fed396-b2f8-495f-b920-6de62b45e4c3 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1241 microversion: 2.1 time: 0.194065 Sep 23 04:16:41.636520 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2962/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:41 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:41.675088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:41.699036 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-63681754-eaf8-49d6-8256-de7936e251e6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1389 microversion: 2.1 time: 0.519100 Sep 23 04:16:41.713977 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3028/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:41 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1389 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:41.744523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:41.756392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:41.756392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.765056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.766503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:41.769465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:41.770083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:41.770823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.194160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:42.195132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:42.217417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:42.232466 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d85445a9-6a33-4e00-adf3-5350ae9b6261 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1389 microversion: 2.1 time: 0.492736 Sep 23 04:16:42.233920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.234428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.234881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.235612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.235808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2963/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:41 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1389 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:42.237445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.237892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.266517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:42.267022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:42.283811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.284306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.299187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.301293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.303502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.309796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.371774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:16:42.564658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:42.578185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcd31141-9352-47d4-88f3-6b52b1406602 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 204 len: 0 microversion: 2.1 time: 0.315533 Sep 23 04:16:42.582076 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2964/5992] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:16:42 2022] DELETE /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:16:42.588073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:42.589440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:42.596353 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0a280e62-be66-402d-a2bc-b94fbd9d44fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1275 microversion: 2.1 time: 0.405004 Sep 23 04:16:42.599295 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3029/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:42 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:42.599697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.600410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.601965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.608465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.609127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.609788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.627970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:42.631915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:42.668589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.674295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.675050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.679213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:42.687137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:42.687954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:42.828181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lazy-loading 'services' on Instance uuid 04b12acf-74bb-4feb-88fd-ab527390fac4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:16:43.001902 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b2954ba-fd8c-4a78-b17b-f2a6088c7bc7 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4/os-volume_attachments/5387a317-4097-4aaf-bd86-d096739ad5d5" status: 202 len: 0 microversion: 2.1 time: 0.414419 Sep 23 04:16:43.003357 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2965/5994] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:16:42 2022] DELETE /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4/os-volume_attachments/5387a317-4097-4aaf-bd86-d096739ad5d5 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:16:43.014572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:43.016270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:43.029244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:43.030887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:43.031506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:43.034782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:43.036828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:43.037584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:43.213382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:43.226678 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9730ca6d-ddbd-4ffd-9bec-724a16432c73 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1293 microversion: 2.1 time: 0.220574 Sep 23 04:16:43.229109 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2966/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:43 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:43.341980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:43.358823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1199a236-5943-4662-816f-43aff53ddee0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1395 microversion: 2.1 time: 0.757284 Sep 23 04:16:43.359440 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3030/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:42 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1395 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:43.623942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:43.624945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:43.640394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:43.641234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:43.641925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:43.643407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:43.643846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:43.646429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:43.783287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:43.800412 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13e1919b-e469-4a04-b8f8-9fcca5cd727c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1273 microversion: 2.1 time: 0.180955 Sep 23 04:16:43.801251 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2967/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:43 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:44.259507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:44.260666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:44.269646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.270544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.271206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:44.274712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.299596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.300465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:44.388112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:44.388842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:44.400720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:44.403849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.404597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.408686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:44.413403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.414271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.417409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:44.455266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:44.500683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:44.505079 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ada56845-1a77-4ce7-87c5-5df67af770a1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1293 microversion: 2.1 time: 0.241080 Sep 23 04:16:44.530651 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3031/5998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:44 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1293 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:44.830222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:44.831175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:44.841202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.845435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.846166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:44.847191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:44.854574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:44.855661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:45.144159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:45.156963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dee6ab6f-1be1-48fc-a5f6-f7bd58c7efdf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1395 microversion: 2.1 time: 0.773585 Sep 23 04:16:45.158196 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2968/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:44 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1395 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:45.361314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:45.376153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07d98128-d2c1-4149-8faa-153ee54d0a41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.549937 Sep 23 04:16:45.376940 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3032/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:44 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:45.533747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:45.535456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:45.547245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:45.547791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:45.548210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:45.548931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:45.549415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:45.549856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.144579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:46.165732 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f90c7586-4a7c-49ed-8677-507a7517a8b8 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.626810 Sep 23 04:16:46.176065 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2969/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:45 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:46.186107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:46.187074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:46.192974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:46.194709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:46.195434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:46.196161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.197145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:46.197776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:46.198390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.206747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=81 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:46.375545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:46.403416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:46.404092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:46.416305 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72919a68-a731-4961-8c13-5e34cc0cb05a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1353 microversion: 2.1 time: 0.235188 Sep 23 04:16:46.427942 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3033/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:46 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:46.438608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:46.439476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:46.440036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.443407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc33401c-81b2-4b17-8049-f58a161892e4", "name": "network-vif-deleted", "tag": "6e49e733-6308-4d80-931c-a9f45759e4e8"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:46.446705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:46.448095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:46.454477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.483593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:46.487323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:46.487819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:46.531377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] Creating event network-vif-deleted:6e49e733-6308-4d80-931c-a9f45759e4e8 for instance fc33401c-81b2-4b17-8049-f58a161892e4 on n-h1-858495-2 Sep 23 04:16:46.571656 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e06dc211-0a69-4691-b5ee-7ece2f4e2ff8 req-8883e00f-1b13-448e-b82a-040ccb936868 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135129 Sep 23 04:16:46.576095 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3034/6003] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:47.039439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:47.052782 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a17be5de-026e-4760-8ba0-64372bfd7000 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.655995 Sep 23 04:16:47.074377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2970/6004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:46 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:47.201539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:47.202256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:47.231173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:47.232643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:47.232643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:47.233033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:47.233470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:47.233911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:47.444904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:47.446019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:47.470101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:47.477392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:47.478512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:47.480075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:47.481042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:47.481777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:47.482744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:47.494590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a43a06b7-515d-406e-b5f9-4cb18266f303 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.298036 Sep 23 04:16:47.512934 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3035/6005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:47 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:47.797006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:47.817942 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2c5e28c6-e7b5-45aa-9682-60d54cb36aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.370915 Sep 23 04:16:47.822908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2971/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:47 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:48.088392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:48.090443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:48.115129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.115744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.122809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.124622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.127940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.129515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.143421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f207aca-a5eb-40e1-a510-3af0c769546a", "tag": "2facbffe-eedd-4782-b66f-ae04016611c0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:48.158917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.159605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.159826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.188795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] Creating event network-changed:2facbffe-eedd-4782-b66f-ae04016611c0 for instance 3f207aca-a5eb-40e1-a510-3af0c769546a on n-h2-858495-2 Sep 23 04:16:48.203468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8d03f678-8f8c-40d7-94f7-ba128e68bd8e req-44dccb69-49c6-4b23-9b1d-fd169e6c36cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321711 Sep 23 04:16:48.204318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3036/6007] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:16:48.413548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:48.425101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ea545a0-2712-4522-9d73-582260ebb73e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.341075 Sep 23 04:16:48.431167 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2972/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:48 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:48.520203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:48.521668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:48.536754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.537307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.537724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.540974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.541531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.542162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.723571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:48.740407 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da075531-2852-49f7-8c0e-d2fdb08ab272 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.224567 Sep 23 04:16:48.746745 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3037/6009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:48 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:48.868302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:48.869498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:48.889889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.896570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.900595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:48.908152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:48.912139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:48.913718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.035317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:49.044673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29ede675-45da-4df4-b2bb-25da6228a85f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.180308 Sep 23 04:16:49.059899 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2973/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:48 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:49.459666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:49.460633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:49.471926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:49.473528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:49.474337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.479099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:49.481645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:49.482358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.722693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:49.733629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3a3aa50-35f6-48fd-b72a-6843e44f188e tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.289142 Sep 23 04:16:49.734810 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3038/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:49 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:49.760095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2700c-e6ee-47b9-a3f7-2c3a7930b665", "tag": "473ba0ea-541c-414d-80f3-3d654eed7a70"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:49.781426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:49.782424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:49.787195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:49.787682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:49.788124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.811829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:49.812746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:49.813747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.814894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:49.816443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:49.817155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:49.824319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] Creating event network-changed:473ba0ea-541c-414d-80f3-3d654eed7a70 for instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 on n-h1-858495-2 Sep 23 04:16:49.829747 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c4eda50c-2b0d-4fb7-add5-c97b9540c62b req-79ef0042-adb4-4cd1-929e-cca46f93ca3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074355 Sep 23 04:16:49.830750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2974/6012] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:16:49.995497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:50.003350 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-415a3594-8359-4cfd-b83b-e94e11201104 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.231587 Sep 23 04:16:50.003917 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3039/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:49 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:50.071516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:50.072475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:50.080381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:50.081100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:50.083213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:50.083213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:50.083213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:50.083688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:50.186672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:50.206884 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e615c762-f420-45c8-b397-a332c5ebdea8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.139204 Sep 23 04:16:50.209750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2975/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:50 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:50.760676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:50.762538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:50.765517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:50.785376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:50.786136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:50.786765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:50.787683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:50.788292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:50.789007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.025926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:51.026685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:51.040342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.040991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.041781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.043321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.044019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.044610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.112154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:51.124176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10bf7365-b0e9-4e91-8621-3404d38f505d tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.367787 Sep 23 04:16:51.125397 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3040/6015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:50 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:51.235252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:51.236275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:51.239115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:51.253410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:51.260580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.261092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.261711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:51.261936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.265081 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a89a3fe9-3084-4395-8e48-1bb64726e215 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.242901 Sep 23 04:16:51.266455 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2976/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:51 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:51.267372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.268020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.268479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.408720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:51.409552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:51.416480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.417286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.417920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.419661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.420540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.421257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.445120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:51.462413 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9391362d-80e1-4f43-8eeb-6eb18032271f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.230200 Sep 23 04:16:51.464365 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3041/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:51 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:51.465146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:16:51.589260 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-baa10860-07a7-4e7c-a1fb-16da8f72c493 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 204 len: 0 microversion: 2.1 time: 0.184299 Sep 23 04:16:51.590650 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2977/6018] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:16:51 2022] DELETE /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:16:51.598482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:51.599162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:51.607445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.622035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.622610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:51.623400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:51.623919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:51.624358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.040149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:52.049579 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e3bee94-7e79-4c77-83db-aef180932cd2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1514 microversion: 2.1 time: 0.454911 Sep 23 04:16:52.050477 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3042/6019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:51 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:52.152338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:52.153309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:52.163759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:52.173804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.175282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.175851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.178436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.181030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.182135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.291549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:52.292930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:52.299516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.300217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.300824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.301744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.302357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.303306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.845114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:52.861232 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ff99266-a121-48f6-a4bb-c3f0f5102269 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.573503 Sep 23 04:16:52.861429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:52.878499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fe2476f-0c86-4ac0-b8e5-df982fd6b56f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.727569 Sep 23 04:16:52.878499 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2978/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:52 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:52.880706 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3043/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:52 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:52.885498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:52.887305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:52.900694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.901243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.903507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:52.904267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:52.904835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:52.905153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.047265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:53.056649 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbb7cfa6-d907-45f1-8d03-7643ca7946b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.180423 Sep 23 04:16:53.059845 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2979/6022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:52 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:53.085049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:53.085863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:53.103748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.107506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.109391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.110701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.112732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.113188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.735560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:53.748043 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20ee088c-76ce-4437-bc50-6e70be021831 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1514 microversion: 2.1 time: 0.667365 Sep 23 04:16:53.766209 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3044/6023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:53 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1514 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:53.886248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:53.887733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:53.902438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:53.903110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:53.909332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.909909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.910368 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.918431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.918992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.919318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.919630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.920398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.921186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:53.922484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:53.923332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:53.924113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.109509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:54.122787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d7fd3f8-2b8e-4732-80ef-63b215774622 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.239847 Sep 23 04:16:54.135017 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2980/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:53 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:54.151711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:54.152524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:54.179700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.180612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.185967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.186727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.187193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.187644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.299723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:54.314444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a70914fc-d39f-45bb-989b-db79bcaa98ff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.177577 Sep 23 04:16:54.315805 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2981/6025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:54 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:54.418386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b12acf-74bb-4feb-88fd-ab527390fac4", "name": "network-vif-deleted", "tag": "afb15f7b-7461-4925-a3f3-d7342d5e8919"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:54.448681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.449627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.450365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.490155 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] Creating event network-vif-deleted:afb15f7b-7461-4925-a3f3-d7342d5e8919 for instance 04b12acf-74bb-4feb-88fd-ab527390fac4 on n-h1-858495-2 Sep 23 04:16:54.497169 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d2799ea6-792d-4a7e-95e3-adf0d9b76c4d req-b57a9487-5ee6-4716-8ad1-84120701c844 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082340 Sep 23 04:16:54.498605 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2982/6026] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:54.580455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:54.591574 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c1f0b2a-187d-4b5c-8dcf-799090c1da1b tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.695105 Sep 23 04:16:54.592389 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3045/6027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:53 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:54.772943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:54.773831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:54.780421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.781069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.781671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.782483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.783052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.783671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.818144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:54.818527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:54.818973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:54.819489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lazy-loading 'fault' on Instance uuid 04b12acf-74bb-4feb-88fd-ab527390fac4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:16:54.881010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:54.890764 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eef690d6-4942-4a92-a2d3-e296ccfde0f5 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 200 len: 1308 microversion: 2.1 time: 0.122440 Sep 23 04:16:54.891528 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2983/6028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:54 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:55.119316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f207aca-a5eb-40e1-a510-3af0c769546a", "name": "network-vif-plugged", "status": "completed", "tag": "2facbffe-eedd-4782-b66f-ae04016611c0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:55.142775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.143848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.144625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.148809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:55.149451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:55.159524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.163814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] Creating event network-vif-plugged:2facbffe-eedd-4782-b66f-ae04016611c0 for instance 3f207aca-a5eb-40e1-a510-3af0c769546a on n-h2-858495-2 Sep 23 04:16:55.164718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.165225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.166167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.167406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.168520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.174385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-dd2cf4ce-c2e3-4618-a261-9954a934fc35 req-0ef0a2d1-a956-4ac0-a400-c692e13b7288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061502 Sep 23 04:16:55.175022 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3046/6029] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:55.177483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:55.309615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:55.326651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1e33c811-b391-4606-90d9-ef976fee35d4 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.182221 Sep 23 04:16:55.327458 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2984/6030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:55 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:55.343311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:55.344259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:55.355525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.355968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.356418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.357160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.359815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.365340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.493288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:55.508953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-34bc9046-6cc5-446f-9770-176fa826a02e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.169662 Sep 23 04:16:55.509807 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3047/6031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:55 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:55.620917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:55.622005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:55.628970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.629883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.630585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.631556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.633559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.634475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.824543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:55.836373 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2857aac-cb7e-44e7-8e3a-19dc3354c2f7 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.219757 Sep 23 04:16:55.838183 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2985/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:55 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:55.916258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:55.917666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 04b12acf-74bb-4feb-88fd-ab527390fac4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:55.927439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.928287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.929268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.930480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:55.931213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:55.931840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:55.959754 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] HTTP exception thrown: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Request method failure captured: Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 HTTP/1.1 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTJ_4DNzhQ2QdvujZbxd7T4cZ_PxEs-ZjxUex29HAR4hQ8ScAp-SWgekmjpwLdq6I1ruUVqd6Gyer3UrOvutbKIpR6FYt6lbqVnInWW9t7BeBvOeqesNOeUulAz-Oni78f3qoBWJRSANUi0GobTd0eD1rtRKaFoFyiE1cm_sdEP0I4M Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: edde974c6d3c419e9bdee21add07c419 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edde974c6d3c419e9bdee21add07c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: edde974c6d3c419e9bdee21add07c419 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesSnapshotTestJSON-1142295672-project Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 56b373ae88da41f2afacd87082d047d5 Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesSnapshotTestJSON-1142295672-project Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '04b12acf-74bb-4feb-88fd-ab527390fac4'} Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:16:55.977000 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. Sep 23 04:16:55.982132 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:55.988209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Returning 404 to user: Instance 04b12acf-74bb-4feb-88fd-ab527390fac4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:16:55.989744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6790db50-e522-43f8-a96e-7c091b840cbf tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4" status: 404 len: 111 microversion: 2.1 time: 0.078419 Sep 23 04:16:55.990559 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3048/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:55 2022] GET /compute/v2.1/servers/04b12acf-74bb-4feb-88fd-ab527390fac4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:16:56.355001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:56.356206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:56.366656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.371509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.372200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:56.373134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.373918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.374705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:56.513136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:56.521653 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec52647b-c4c6-4716-bcff-c173667026ff tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.171030 Sep 23 04:16:56.522250 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2986/6034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:56 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:56.532176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:56.533190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:56.545707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.546345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.546907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:56.552442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.553425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.554005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:56.697527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:56.714665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad5d2a47-4cfb-4e41-955b-6a8abebfb95f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 200 len: 1187 microversion: 2.1 time: 0.186284 Sep 23 04:16:56.715262 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3049/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:56 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 1187 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:56.860907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:56.861955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:56.870962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.873592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.874267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:56.876760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:56.879122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:56.879855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.056231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:57.077531 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-294e307e-27ed-4444-a553-722dcbe9834c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1315 microversion: 2.1 time: 0.220306 Sep 23 04:16:57.096779 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2987/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:56 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:57.191580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2700c-e6ee-47b9-a3f7-2c3a7930b665", "name": "network-vif-plugged", "status": "completed", "tag": "473ba0ea-541c-414d-80f3-3d654eed7a70"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:57.202326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:57.203073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:57.203697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.217542 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] Creating event network-vif-plugged:473ba0ea-541c-414d-80f3-3d654eed7a70 for instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 on n-h1-858495-2 Sep 23 04:16:57.223396 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1524dee8-2ae3-4bb0-8e95-d1d0ccdeab5a req-98297c0b-ec52-4834-94d1-e868d15684ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035484 Sep 23 04:16:57.224631 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3050/6037] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:16:57.544467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:57.545803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:57.552804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:57.553736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:57.554393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.555307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:57.555991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:57.556626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.648123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:57.656339 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fcd7c4e-fb2b-4499-8415-9f22c1555f0b tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1299 microversion: 2.1 time: 0.115791 Sep 23 04:16:57.657259 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2988/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:57 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:57.745409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:57.746267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: fc33401c-81b2-4b17-8049-f58a161892e4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:57.765237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:57.766125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:57.766779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.767763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:57.768426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:57.770152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:57.786973 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 HTTP/1.1 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'fc33401c-81b2-4b17-8049-f58a161892e4'} Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:16:57.789037 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. Sep 23 04:16:57.792767 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:16:57.794758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance fc33401c-81b2-4b17-8049-f58a161892e4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:16:57.795829 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-771f8b46-f6ba-4027-a233-9ee98840d699 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4" status: 404 len: 111 microversion: 2.1 time: 0.056500 Sep 23 04:16:57.800167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3051/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:57 2022] GET /compute/v2.1/servers/fc33401c-81b2-4b17-8049-f58a161892e4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:16:58.144663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:58.146469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:58.158811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.160466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.161289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.162279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.162961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.163873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.499379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:58.510980 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87880c4b-c176-4bb6-81c3-24b2dd2de4c0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1502 microversion: 2.1 time: 0.404558 Sep 23 04:16:58.530439 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2989/6040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:58 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:58.535566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:58.539441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:58.561545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.562317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.563938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.564855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.568737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.569476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.681853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:58.683117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:58.696821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.698701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.699358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.700577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.701218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.701891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.882327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:58.897103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5cb70a8-09ac-445a-9ab7-4a426f56752c tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1472 microversion: 2.1 time: 0.216794 Sep 23 04:16:58.909375 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2990/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:58 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:58.924972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:58.925970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:58.937077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:58.951490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.953129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.954032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.955386 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc0fc613-e578-431b-b7d4-06d200c11c41 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1502 microversion: 2.1 time: 0.420950 Sep 23 04:16:58.956767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:58.973003 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3052/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:58 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:58.974060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:58.974863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:58.992141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:16:58.996009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:59.017103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.017631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.024901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.026210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.026697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.027138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.091878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lazy-loading 'flavor' on Instance uuid 3f207aca-a5eb-40e1-a510-3af0c769546a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:16:59.119107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:16:59.158756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:59.173299 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2a8f8b6-cbcd-4725-883b-9550347b64d6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1472 microversion: 2.1 time: 0.251651 Sep 23 04:16:59.185448 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2991/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:58 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:59.200262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:59.201459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:59.208176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.209167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.209942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.211062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.211776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.212422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.274747 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5e71bf0-32b3-433e-b0b9-17c840e04a1c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action" status: 202 len: 0 microversion: 2.1 time: 0.286971 Sep 23 04:16:59.276942 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3053/6044] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:16:58 2022] POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:16:59.295047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:59.296071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:59.303789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.304844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.305579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.306554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.307941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.309101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.446492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e779123f-975d-4216-b0fb-bc9ae779fc56 tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1623 microversion: 2.1 time: 0.250122 Sep 23 04:16:59.449878 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2992/6045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:59 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1623 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:59.471037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:59.471775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:59.483087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.483827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.484280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.486600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:16:59.488375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:16:59.488986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:16:59.684622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:16:59.696325 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a370031a-8d21-4ca2-b5e2-6f363508d3fb tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1510 microversion: 2.1 time: 0.412072 Sep 23 04:16:59.697011 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3054/6046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:59 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:16:59.878714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0d95c97-45f7-4bc3-8e53-79c78d592f1e tempest-TestSecurityGroupsBasicOps-197300783 tempest-TestSecurityGroupsBasicOps-197300783-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1911 microversion: 2.1 time: 0.412140 Sep 23 04:16:59.884243 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2993/6047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:16:59 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1911 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:16:59.986658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:16:59.987280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:16:59.999930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.000830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.001504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.002410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.003030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.003618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.036822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:17:00.258935 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bd9aca1a-23be-4b02-95bb-f3b744551db6 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 204 len: 0 microversion: 2.1 time: 0.280333 Sep 23 04:17:00.261663 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3055/6048] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:16:59 2022] DELETE /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:17:00.270193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:00.271195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:00.289169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.290194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.293277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.298808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.302514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.303213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.669315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:00.694962 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09b932b7-f5ac-4e48-9318-313472fec2cb tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1478 microversion: 2.1 time: 0.429244 Sep 23 04:17:00.713447 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2994/6049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:00 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1478 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:00.729320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:00.730172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:00.737977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.738499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.738932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.739716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:00.740804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:00.741376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:00.970995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:00.980435 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-35407abf-5526-44ba-be08-034798b38708 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1493 microversion: 2.1 time: 0.257172 Sep 23 04:17:00.988116 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3056/6050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:00 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1493 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:01.011869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:01.013020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:01.027931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.028670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.029290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.030228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.030854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.031448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.171283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-691a4e2c-c51f-48c6-a62f-47a9f71f3a7c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action" status: 202 len: 0 microversion: 2.1 time: 0.163958 Sep 23 04:17:01.175110 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2995/6051] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:17:01 2022] POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:17:01.180717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:01.181613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:01.192368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.196112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.196939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.199023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.202450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.203089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.562894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:01.573670 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-59cb4607-21eb-4050-89f8-4a2a63689bd8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1499 microversion: 2.1 time: 0.397141 Sep 23 04:17:01.593908 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3057/6052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:01 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1499 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:01.731079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:01.732459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:01.747630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.749039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.752382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.753402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:01.754063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:01.754699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:01.973396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:01.993471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be270ff7-d6fd-44de-a54a-cdddf8248f61 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1478 microversion: 2.1 time: 0.264996 Sep 23 04:17:01.995525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2996/6053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:01 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:02.606366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2700c-e6ee-47b9-a3f7-2c3a7930b665", "name": "network-vif-deleted", "tag": "473ba0ea-541c-414d-80f3-3d654eed7a70"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:02.608808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:02.609483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:02.626006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:02.627903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:02.628357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:02.631062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:02.635469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:02.637507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:02.643460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:02.658166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:02.659092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:02.723404 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] Creating event network-vif-deleted:473ba0ea-541c-414d-80f3-3d654eed7a70 for instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 on n-h1-858495-2 Sep 23 04:17:02.736482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d662a309-bd28-4636-8bea-1aeb66dfff4e req-4d819ed8-2fb4-422c-a6b0-ea1e6e45c467 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133034 Sep 23 04:17:02.738895 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2997/6054] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:03.015308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:03.018773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:03.019688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:03.027091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5997eb9-8cb5-4697-8f11-8443fbc0f4c4 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1499 microversion: 2.1 time: 0.429624 Sep 23 04:17:03.029631 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3058/6055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:02 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:03.051290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:03.053371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:03.054402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:03.056112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:03.057966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:03.059794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:03.161339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:03.162162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:03.163889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:03.167501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lazy-loading 'fault' on Instance uuid 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:17:03.262174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:03.270294 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38688078-e7f8-493d-b454-8db03256235f tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 200 len: 1331 microversion: 2.1 time: 0.255768 Sep 23 04:17:03.292923 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2998/6056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:03 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 1331 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:04.054766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:04.055725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:04.075219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.076005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.076630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.077564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.078200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.078877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.300474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:04.301427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:04.321765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.324248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.324757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.325560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.326209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.326973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.364508 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] HTTP exception thrown: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Request method failure captured: Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 HTTP/1.1 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTKx13fDmcxT3Y9tw3aT430UULd-S6VWV9Ok9gtdCXihWYw_u7Ggtrh3PKZdK8itH1DQZtjuC8yDDi0DmhXskMye_IZypWSupAyibEl1xIwxG1Mn3qNSbyhbMRlT9DxqH5X1W_Mr9ei6JruJga9Du4eIZxP3gz-An-JCNwucZcNgmBc Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: dafa3d1a58594c61aeb53df74a237ed1 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: dafa3d1a58594c61aeb53df74a237ed1 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestSecurityGroupsBasicOps-478174934-project Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 9cb91664432b427eadcec9f0da90b21b Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestSecurityGroupsBasicOps-478174934-project Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7bc2700c-e6ee-47b9-a3f7-2c3a7930b665'} Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:04.371761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. Sep 23 04:17:04.376448 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:17:04.377861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Returning 404 to user: Instance 7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:17:04.393781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2d17952d-3e8f-4916-abd8-012b0f3db6b1 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665" status: 404 len: 111 microversion: 2.1 time: 0.088195 Sep 23 04:17:04.394761 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 2999/6057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:04 2022] GET /compute/v2.1/servers/7bc2700c-e6ee-47b9-a3f7-2c3a7930b665 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:17:04.431308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:04.441836 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cf950fc-6283-44a1-acff-b21086bbae8f tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1502 microversion: 2.1 time: 0.390943 Sep 23 04:17:04.445615 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3059/6058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:04 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:04.475332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:04.476109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:04.489504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.496884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.501317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.502569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.503243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.503889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.539995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lazy-loading 'flavor' on Instance uuid 3f207aca-a5eb-40e1-a510-3af0c769546a {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:17:04.563334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:04.740045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b78f7069-45c2-4d06-ab61-7160e7ca6e78 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action" status: 202 len: 0 microversion: 2.1 time: 0.267863 Sep 23 04:17:04.742995 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3000/6059] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:17:04 2022] POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:17:04.750660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:04.751291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:04.759259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.766134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.766830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:04.767761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:04.768548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:04.769640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:05.203054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:05.224286 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-241580e2-19cc-4583-8835-488b31b026a8 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1510 microversion: 2.1 time: 0.477412 Sep 23 04:17:05.225077 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3060/6060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:04 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:06.139912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1870651582", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6d229ca0-4a47-452a-8ac4-2caa8162b462", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:06.216709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:17:06.252694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:06.254242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:06.262814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.263343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.264003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:06.264924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.265427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.266254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:06.629786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:06.645476 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1bdd38c7-cdb7-4677-96d4-e6464b4840b0 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1493 microversion: 2.1 time: 0.397051 Sep 23 04:17:06.658088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3061/6061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:06 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1493 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:06.676182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:06.677024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:06.685112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.685908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.686610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:06.687536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.688204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.688854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:06.789605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d84749e-d085-4e93-af15-0d58c98ffb6a tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action" status: 202 len: 0 microversion: 2.1 time: 0.122784 Sep 23 04:17:06.795676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3062/6062] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:17:06 2022] POST /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:17:06.802539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:06.803865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:06.812231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.813598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.814611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:06.818994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:06.820060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:06.820587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:07.189032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:17:07.189618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:17:07.190107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:17:07.190593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:17:07.191871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:17:07.203655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:07.212545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d9998075-ddb2-449b-9fe6-4758d4c4b517 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1499 microversion: 2.1 time: 0.414404 Sep 23 04:17:07.216265 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3063/6063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:06 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1499 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:07.217888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:07.218393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:07.218842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:07.219637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:07.220037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:07.220466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:07.226389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1110749065", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "bc40aa02-f8a1-4477-a792-3d58fcf04658"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:07.296282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:17:07.309716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] validate_networks() for [('bc40aa02-f8a1-4477-a792-3d58fcf04658', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:17:07.314625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:17:07.432986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:17:07.436721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d229ca0-4a47-452a-8ac4-2caa8162b462',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:17:07.774198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75a75720-ed64-4752-b5c4-b97c075d0443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637790 Sep 23 04:17:07.784009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3001/6064] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:17:07.806134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8bd82c66-8a29-4c04-a8ed-8d3c8cffc8cb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:07.807653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8bd82c66-8a29-4c04-a8ed-8d3c8cffc8cb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:07.978611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8bd82c66-8a29-4c04-a8ed-8d3c8cffc8cb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:08.003967 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8bd82c66-8a29-4c04-a8ed-8d3c8cffc8cb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1057 microversion: 2.1 time: 0.209466 Sep 23 04:17:08.004611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3002/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:07 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1057 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:08.086621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:17:08.087589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:17:08.088687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:17:08.089405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:17:08.090329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:17:08.107515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:08.108027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:08.108480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:08.109235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:08.112151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:08.112606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:08.153304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Getting quotas for project edde974c6d3c419e9bdee21add07c419. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:17:08.158716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Getting quotas for user 56b373ae88da41f2afacd87082d047d5 and project edde974c6d3c419e9bdee21add07c419. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:17:08.172181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:17:08.174832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:17:08.234794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b248ecc-5aee-4898-9c39-a8634cb0c769 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017070 Sep 23 04:17:08.235776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3064/6066] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:17:08.242832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:08.245284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:08.259582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:08.261250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:08.261683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d89cf0d-4066-4972-9c81-b8333a8799ba tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:08.262558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d89cf0d-4066-4972-9c81-b8333a8799ba tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:08.263268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:08.264568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:08.265887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:08.267554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:08.366338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d89cf0d-4066-4972-9c81-b8333a8799ba tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:08.385180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d89cf0d-4066-4972-9c81-b8333a8799ba tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1219 microversion: 2.1 time: 0.134127 Sep 23 04:17:08.385829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3065/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:08 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:08.583792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:08.594016 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-64138ff6-0ccf-4165-b6fb-34ceb132661c tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1499 microversion: 2.1 time: 0.355108 Sep 23 04:17:08.610724 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3003/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:08 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1499 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:09.035732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:09.036522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:09.053175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.066588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.069903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.075530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.076689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.084659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.243415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:09.264439 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-623801f5-52c2-4f18-8a24-585d6e12e6fc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1155 microversion: 2.1 time: 0.230294 Sep 23 04:17:09.269129 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3066/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:09 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1155 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:09.413663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:09.414232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:09.424578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.425095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.425822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.426574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.427010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.427622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.562322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:09.576952 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e64c1fc-7223-44b8-a8ea-a3a821d747fc tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1215 microversion: 2.1 time: 0.168480 Sep 23 04:17:09.605153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3004/6070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:09 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:09.618970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:09.619600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:09.628354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.629479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.631510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.632671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.633748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.634631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.851227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:09.855587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:09.864007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b580852-b999-4154-932a-b6473e211187 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1502 microversion: 2.1 time: 0.249965 Sep 23 04:17:09.865247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3067/6071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:09 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:09.893204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:09.893836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:09.899818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:09.902686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.903400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.903926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.904715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:09.905249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:09.905832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:09.940146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:17:10.077628 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b085da6a-dc29-42e6-9f80-848b42a9c138 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 204 len: 0 microversion: 2.1 time: 0.188506 Sep 23 04:17:10.089306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:10.090490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:10.094838 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3005/6072] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:17:09 2022] DELETE /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:17:10.102626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.104537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.105310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.106275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.107036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.107734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.294510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:10.295225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:10.317436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:10.327159 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0ef378b-68cc-47c9-8258-10163aa3fd59 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1508 microversion: 2.1 time: 0.242858 Sep 23 04:17:10.329089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.345595 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3068/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:10 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:10.346867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.347737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.348657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.349270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.349876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.430226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:10.441100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c79662ef-9c0d-49c7-bdda-cdb2db688868 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1173 microversion: 2.1 time: 0.152094 Sep 23 04:17:10.443385 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3006/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:10 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1173 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:10.606833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:10.607556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:10.614683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.615850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.616523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.617531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:10.618228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:10.618926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:10.700568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:10.708403 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e84bdba-1e74-421c-8c46-1542b0ae9639 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1277 microversion: 2.1 time: 0.108193 Sep 23 04:17:10.709408 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3069/6075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:10 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:11.355145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:11.357896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:11.370281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.373152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.375028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:11.376026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.376789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.378248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:11.469861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:11.471006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:11.486521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.487402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.488091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:11.489056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.492187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.492925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:11.677901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:11.701100 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-929990d6-40df-4ba5-bccc-71e1f3307ffd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1173 microversion: 2.1 time: 0.234653 Sep 23 04:17:11.702079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3070/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:11 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1173 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:11.734143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:11.734769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:11.744635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.745179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.745668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:11.750467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:11.751397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:11.751860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:12.240739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:12.250562 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40b0b112-3c00-4dee-8632-a768880817f1 tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1508 microversion: 2.1 time: 0.902303 Sep 23 04:17:12.253096 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3007/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:11 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1508 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:12.269313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:12.286948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2849771a-392f-43d1-890e-82ae0af8d749 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1277 microversion: 2.1 time: 0.558320 Sep 23 04:17:12.287660 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3071/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:11 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1277 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:12.723664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:12.724335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:12.743056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:12.743561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:12.744626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:12.745379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:12.745902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:12.746332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.118344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:13.130965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad72d329-7674-4f03-9f08-655e31a65785 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1215 microversion: 2.1 time: 0.411038 Sep 23 04:17:13.133146 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3008/6079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:12 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:13.279761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:13.280979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:13.284070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:13.296890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:13.297678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:13.298307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.299415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:13.300175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:13.300756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.313801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:13.314988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:13.325605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:13.326899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:13.327497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.333789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:13.334562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:13.338861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.677487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58e0e29c5ff4a4bb875604e8aac339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ec634f59004b23867be72f4da1850c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:13.686614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6dcfd3cd-41d2-4f74-8fdc-34c18a7344bd tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 200 len: 1466 microversion: 2.1 time: 0.412417 Sep 23 04:17:13.691385 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3072/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:13 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 1466 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:13.699849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f207aca-a5eb-40e1-a510-3af0c769546a", "name": "network-vif-deleted", "tag": "2facbffe-eedd-4782-b66f-ae04016611c0"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:13.729786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:13.730713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:13.731416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:13.758399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] Creating event network-vif-deleted:2facbffe-eedd-4782-b66f-ae04016611c0 for instance 3f207aca-a5eb-40e1-a510-3af0c769546a on n-h2-858495-2 Sep 23 04:17:13.773044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-cb9a90f5-9786-4916-a5eb-aa05e3d77c5f req-3eb5ab51-f873-4b54-b18e-b561024b122d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078185 Sep 23 04:17:13.776961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3073/6081] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:13.996654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:14.006001 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c90edf6b-6feb-4362-a7cf-a4f4b8608634 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.696355 Sep 23 04:17:14.007008 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3009/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:13 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:14.155872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:14.156619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:14.170042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.170594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.171042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.171767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.172229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.172668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.235298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:14.236247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:14.244775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.246158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.246773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.247658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.248746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.249711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.341953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:17:14.542565 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b49fd83-a6c2-4a70-8d43-6644825950f9 tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 204 len: 0 microversion: 2.1 time: 0.311731 Sep 23 04:17:14.548811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3010/6083] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:17:14 2022] DELETE /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:17:14.555917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:14.564148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:14.575369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.577267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.580299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.583084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.583808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.584421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.662189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:14.677378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38001e51-efff-46ce-b820-1c102e08adc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1215 microversion: 2.1 time: 0.521786 Sep 23 04:17:14.680186 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3074/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:14 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1215 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:14.719405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:14.719405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] [instance: 3f207aca-a5eb-40e1-a510-3af0c769546a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:14.731305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.731797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.732230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.732944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:14.737395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:14.738097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:14.771877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] HTTP exception thrown: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Request method failure captured: Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a HTTP/1.1 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTMhV5YF8RnHBQ9OEhOOihfk_UHhFeEt-HNNfCxn2r4Fj3zPZ89e8M6ZDbqZmzXOr4gdEJ4IDcKLCZwtDJj6udBefeAmuj4mjdRny8D2_yh-D3Cm0_DoLe-zAy8F8KWDAOCFqm54mAj0jPfA0gkhXwsx_xEY8ITMsHxzvjQZdnSfwEg Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b6ec634f59004b23867be72f4da1850c Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestServerAdvancedOps-193098520 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6ec634f59004b23867be72f4da1850c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6ec634f59004b23867be72f4da1850c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6ec634f59004b23867be72f4da1850c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6ec634f59004b23867be72f4da1850c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestServerAdvancedOps-193098520 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b6ec634f59004b23867be72f4da1850c Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestServerAdvancedOps-193098520 Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestServerAdvancedOps-193098520-project Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a58e0e29c5ff4a4bb875604e8aac339d Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestServerAdvancedOps-193098520-project Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3f207aca-a5eb-40e1-a510-3af0c769546a'} Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:14.777516 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. Sep 23 04:17:14.781838 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:14.784090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] Returning 404 to user: Instance 3f207aca-a5eb-40e1-a510-3af0c769546a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:17:14.786377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9481b7a0-2ce2-49b5-ba88-ff0476de8eba tempest-TestServerAdvancedOps-193098520 tempest-TestServerAdvancedOps-193098520-project] 10.222.0.25 "GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a" status: 404 len: 111 microversion: 2.1 time: 0.073536 Sep 23 04:17:14.791983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3075/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:14 2022] GET /compute/v2.1/servers/3f207aca-a5eb-40e1-a510-3af0c769546a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:17:15.013533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:15.026292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bfefa394-34a0-4bf7-a275-5f602d173bef tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1766 microversion: 2.1 time: 0.474966 Sep 23 04:17:15.029127 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3011/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:14 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1766 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:15.035466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:15.036090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:15.047780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.049639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.051333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.055184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.056048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.058533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.544562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:15.557889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3823ab76-dd31-4bd1-ab81-2ef80b08e9d6 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.527315 Sep 23 04:17:15.563188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3076/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:15 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:15.706137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:15.710971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:15.722769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.730078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.730700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.732456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.742116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eeb9795-0ebc-4f08-8d24-2e96d36455c4", "tag": "1d9de1ae-3067-46aa-8643-10584393660b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:15.750964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.751707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.777457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.782321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.789309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.833676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] Creating event network-changed:1d9de1ae-3067-46aa-8643-10584393660b for instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 on n-h1-858495-2 Sep 23 04:17:15.849224 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-58c206dc-360e-4be6-a345-613b1d9f09ee req-81170a54-61f8-4c4a-8603-20d97058463d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110465 Sep 23 04:17:15.851888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3077/6088] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:15.864754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d1e7-031d-4610-8db1-fd69745dc334", "tag": "7c4117ab-f9bd-4155-827f-9f170024d39a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:15.894806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:15.896609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:15.900214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:15.938199 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] Creating event network-changed:7c4117ab-f9bd-4155-827f-9f170024d39a for instance 0681d1e7-031d-4610-8db1-fd69745dc334 on n-h2-858495-2 Sep 23 04:17:15.948741 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-98bf1321-4bae-47db-82bb-e7ef667a7141 req-4cbb247b-b21d-4089-95fb-f05c2e483e62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093782 Sep 23 04:17:15.950126 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3078/6089] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:16.051889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:16.052970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:16.069487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:16.080259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:16.081860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:16.083675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:16.085498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:16.088136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:16.635664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:16.654379 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-64bdde99-3ff6-4400-9013-1505384e893e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1766 microversion: 2.1 time: 0.603836 Sep 23 04:17:16.660247 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3079/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:16 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1766 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:16.678384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:16.679508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:16.697767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:16.698285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:16.698752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:16.699498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:16.700055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:16.700560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:16.889153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:16.897099 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2989bed8-a27f-4d38-8ac8-d01fa1d4dabd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1215 microversion: 2.1 time: 1.197084 Sep 23 04:17:16.897723 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3012/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:15 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1215 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:17.382807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:17.397000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-065d0835-b769-4740-ac8a-724947b241b9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.734425 Sep 23 04:17:17.400068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3080/6092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:16 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:17.684764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:17.685699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:17.692054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:17.694421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:17.695137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:17.696017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:17.696943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:17.697607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:17.698206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:17.924054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:17.924667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:17.933070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:17.933600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:17.934043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:17.934753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:17.935209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:17.935639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:17.990261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:18.139413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:18.384699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:18.638285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb91664432b427eadcec9f0da90b21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa3d1a58594c61aeb53df74a237ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:18.652127 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60aff24b-af9e-48e0-981e-72d17960fb8e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 200 len: 1766 microversion: 2.1 time: 0.970963 Sep 23 04:17:18.652767 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3013/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:17 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 1766 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:18.659758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349e70e0-11ee-4c0d-add2-3fe959a6c925", "tag": "ce1c38db-858c-49a9-95f4-a2469336399b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:18.674688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:18.675423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:18.676581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:18.688886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:18.700518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] Creating event network-changed:ce1c38db-858c-49a9-95f4-a2469336399b for instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 on n-h1-858495-2 Sep 23 04:17:18.706390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b26906a2-88cc-4768-9e2e-2294f0e64447 req-b42336f1-df23-4f35-844b-14c8879f448b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051110 Sep 23 04:17:18.707126 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3014/6094] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:18.713343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:18.714085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:18.721803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:18.722298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:18.722732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:18.723703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:18.724172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:18.724609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:18.920415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:18.934493 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f8158144-0512-4876-8098-529e2adeb21e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1203 microversion: 2.1 time: 1.012758 Sep 23 04:17:18.936201 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3081/6095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:17 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1203 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:18.944454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d1e7-031d-4610-8db1-fd69745dc334", "name": "network-vif-deleted", "tag": "7c4117ab-f9bd-4155-827f-9f170024d39a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:18.969749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:18.972562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:18.975348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:19.012619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] Creating event network-vif-deleted:7c4117ab-f9bd-4155-827f-9f170024d39a for instance 0681d1e7-031d-4610-8db1-fd69745dc334 on n-h2-858495-2 Sep 23 04:17:19.024083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-938ddf72-7413-462b-8dc5-fccb63ff5469 req-112f836d-58f8-412a-bff1-2d6a0ad2c452 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085604 Sep 23 04:17:19.026501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3082/6096] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:19.171444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:19.182766 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-096d8398-144b-4efd-8dae-3b94ac48e83d tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.474248 Sep 23 04:17:19.186831 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3015/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:18 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:19.680322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:19.682097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [instance: 0681d1e7-031d-4610-8db1-fd69745dc334] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:19.690902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:19.692317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:19.693162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:19.694747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:19.695559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:19.696212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:19.716378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] HTTP exception thrown: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Request method failure captured: Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 HTTP/1.1 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTKx13fDmcxT3Y9tw3aT430UULd-S6VWV9Ok9gtdCXihWYw_u7Ggtrh3PKZdK8itH1DQZtjuC8yDDi0DmhXskMye_IZypWSupAyibEl1xIwxG1Mn3qNSbyhbMRlT9DxqH5X1W_Mr9ei6JruJga9Du4eIZxP3gz-An-JCNwucZcNgmBc Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: dafa3d1a58594c61aeb53df74a237ed1 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dafa3d1a58594c61aeb53df74a237ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: dafa3d1a58594c61aeb53df74a237ed1 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-478174934 Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestSecurityGroupsBasicOps-478174934-project Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 9cb91664432b427eadcec9f0da90b21b Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestSecurityGroupsBasicOps-478174934-project Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '0681d1e7-031d-4610-8db1-fd69745dc334'} Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:19.719685 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. Sep 23 04:17:19.724424 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:19.727739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Returning 404 to user: Instance 0681d1e7-031d-4610-8db1-fd69745dc334 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:17:19.729690 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c25e88c-3dc6-45cc-91f9-dcdfaa72dcec tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334" status: 404 len: 111 microversion: 2.1 time: 0.054371 Sep 23 04:17:19.730576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3083/6098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:19 2022] GET /compute/v2.1/servers/0681d1e7-031d-4610-8db1-fd69745dc334 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:17:19.961344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:19.963236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:19.983065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:19.983867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:19.984496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:19.985437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:19.988143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:19.989762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:20.227350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:20.228740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:20.257094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:20.258010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:20.260496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:20.263250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:20.265201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:20.266007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:20.395356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:20.408223 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-916555ce-5f0f-4019-a2e9-88b024ac2558 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1203 microversion: 2.1 time: 0.451670 Sep 23 04:17:20.414321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3016/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:19 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1203 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:20.918431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:20.940091 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6920252f-6bbd-4b5a-b662-1e358d0e1b54 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.735266 Sep 23 04:17:20.941069 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3084/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:20 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:21.437489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:21.438203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:21.472430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:21.474478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:21.475002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:21.479240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:21.480485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:21.480949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:21.744273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349e70e0-11ee-4c0d-add2-3fe959a6c925", "name": "network-vif-plugged", "status": "completed", "tag": "ce1c38db-858c-49a9-95f4-a2469336399b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:21.758083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:21.758953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:21.759585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:21.800809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] Creating event network-vif-plugged:ce1c38db-858c-49a9-95f4-a2469336399b for instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 on n-h1-858495-2 Sep 23 04:17:21.807724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f041ee2b-1ced-4188-9513-5007c720df34 req-dfe18937-9e45-42d5-abaf-abfd87d2a24a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067854 Sep 23 04:17:21.811460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3085/6101] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:21.973882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:21.975993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:21.986022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:21.987071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:21.992434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:21.995236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:21.995964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:21.996638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:22.237521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:22.257567 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-452ebb51-905d-4d65-8032-a2f111194fcf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1203 microversion: 2.1 time: 0.823987 Sep 23 04:17:22.259916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3017/6102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:21 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1203 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:22.452936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:22.484395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2ce9a00-d3a9-4db6-b293-da88dd19df41 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1319 microversion: 2.1 time: 0.518897 Sep 23 04:17:22.496527 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3086/6103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:21 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:23.292369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:23.293788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:23.302967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.303984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.304710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.306242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.307141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.307790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.515175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:23.515832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:23.541110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.541695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.542310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.544293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.548927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.549523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.659335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:23.669461 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bbc4e5e6-fd1f-4172-a2c1-8937434aa5a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1203 microversion: 2.1 time: 0.383064 Sep 23 04:17:23.670935 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3018/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:23 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1203 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:23.771381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:23.805321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fe3c79c8-43bd-4b98-a46c-b6ff11c96ca2 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1508 microversion: 2.1 time: 0.297870 Sep 23 04:17:23.810130 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3087/6105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:23 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:23.839911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ab1f501-4505-449c-acf5-d024d36311b3", "device": "/dev/sdb"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:23.844203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:23.860056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.862488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.863190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.865723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.869542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.870161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:23.966676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb9795-0ebc-4f08-8d24-2e96d36455c4", "name": "network-vif-plugged", "status": "completed", "tag": "1d9de1ae-3067-46aa-8643-10584393660b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:23.985803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:23.986571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:23.987958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:24.016251 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] Creating event network-vif-plugged:1d9de1ae-3067-46aa-8643-10584393660b for instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 on n-h1-858495-2 Sep 23 04:17:24.029804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a15fb66e-26a9-468f-a4d8-07aab15877aa req-22930714-e70a-4a5d-a241-502f46624f58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069798 Sep 23 04:17:24.032188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3088/6106] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:24.343760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6f798d4-7da1-45be-aa8a-16672071ce02 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "POST /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506032 Sep 23 04:17:24.345944 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3019/6107] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:17:23 2022] POST /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:17:24.695503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:24.696823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:24.703611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:24.704295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:24.704892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:24.705788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:24.706398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:24.706971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:25.031050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:25.033790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:25.042666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0ec7cf1f-0374-4639-baf8-ca3b6d0d4916 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1203 microversion: 2.1 time: 0.352941 Sep 23 04:17:25.045970 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3089/6108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:24 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1203 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:26.077480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3610b447-9d9f-4330-b91c-2e945a43098e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] Calling method '.version_select at 0x7f0c8a2ad310>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:26.079033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:26.082887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:26.092129 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3610b447-9d9f-4330-b91c-2e945a43098e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:17:26.108241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.109252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.110716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.112401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.113708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.114805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.321379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:26.332163 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83ecc1d7-3ae1-4006-9e53-424d53e04779 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1390 microversion: 2.1 time: 0.265766 Sep 23 04:17:26.333117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3020/6109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:26 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:26.356052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:26.356947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:26.363810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.364494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.365167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.366085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.366709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.367294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.545585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:26.554995 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7749d4d6-1351-49b8-8f2a-7d5019943f90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1390 microversion: 2.1 time: 0.203627 Sep 23 04:17:26.556376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3021/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:26 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1390 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:26.579078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:26.579804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:26.587326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.588203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.588910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.589900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.590744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.591472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.816253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:26.826699 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-250c696c-634b-431d-8619-8753a4f066f1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1390 microversion: 2.1 time: 0.252489 Sep 23 04:17:26.830219 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3022/6111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:26 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:26.851340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:26.852129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:26.859891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.860649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.861125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.861844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:26.862319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:26.862764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:26.911045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:17:27.047320 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09251918-a0ec-4913-9f29-0c21c0339826 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 204 len: 0 microversion: 2.1 time: 0.200266 Sep 23 04:17:27.050727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3023/6112] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:17:26 2022] DELETE /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:17:27.075808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:27.079382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:27.101054 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-3610b447-9d9f-4330-b91c-2e945a43098e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41078. Sep 23 04:17:27.104649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:27.105161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:27.106128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:27.107073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:27.107539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:27.107980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:27.135416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3610b447-9d9f-4330-b91c-2e945a43098e tempest-TestSecurityGroupsBasicOps-478174934 tempest-TestSecurityGroupsBasicOps-478174934-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-308477467" status: 202 len: 0 microversion: 2.1 time: 1.062695 Sep 23 04:17:27.136561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3090/6113] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-308477467 => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:17:27.421569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:27.436182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4858e343-bedf-464a-a812-489a052bd5a4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1396 microversion: 2.1 time: 0.370658 Sep 23 04:17:27.437906 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3024/6114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:27 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1396 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:17:28.472783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:28.474303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:28.494589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:28.495547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:28.498435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:28.499332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:28.500076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:28.500727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:28.717530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:28.734482 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c46db202-0c95-465a-b055-8ff2df61b587 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1396 microversion: 2.1 time: 0.267109 Sep 23 04:17:28.735730 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3091/6115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:28 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1396 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:29.761942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:29.763169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:29.775378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:29.777992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:29.778788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:29.785508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:29.788855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:29.790758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:29.841590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb9795-0ebc-4f08-8d24-2e96d36455c4", "name": "network-vif-deleted", "tag": "1d9de1ae-3067-46aa-8643-10584393660b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:17:29.881555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:29.881555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:29.882003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:29.912801 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] Creating event network-vif-deleted:1d9de1ae-3067-46aa-8643-10584393660b for instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 on n-h1-858495-2 Sep 23 04:17:29.939473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9f9d8c0e-af80-4529-948f-58f8892c5d39 req-c4c8a22f-dfed-425f-8354-e6c58285095c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102282 Sep 23 04:17:29.940540 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3092/6116] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:17:30.041093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:30.050852 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5550296e-9b61-46fe-8596-3b69ade7821c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1354 microversion: 2.1 time: 0.293421 Sep 23 04:17:30.062662 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3025/6117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:29 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:31.085784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:31.087207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:31.093435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:31.093930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:31.094370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:31.095067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:31.095594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:31.096197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:31.162690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:31.171548 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2a198d6-36de-4270-a683-563e7353b930 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1188 microversion: 2.1 time: 0.091046 Sep 23 04:17:31.177454 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3093/6118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:31 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:32.197818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:32.198949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:32.209020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:32.209740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:32.210333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:32.211190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:32.211952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:32.212532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:32.288343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:32.298137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4d7140c-075d-45dd-b4eb-71c5313747da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1188 microversion: 2.1 time: 0.105626 Sep 23 04:17:32.307893 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3026/6119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:32 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:33.322682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:33.323906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:33.331425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:33.332214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:33.332861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:33.333818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:33.334505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:33.335239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:33.400756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:33.408949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b9b380e-af1e-4647-8e8d-efb9608c8ecb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1188 microversion: 2.1 time: 0.090117 Sep 23 04:17:33.421887 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3094/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:33 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:34.433862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:34.434910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:34.446381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:34.450703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:34.451471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:34.452435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:34.453142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:34.453811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:34.569661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:34.583815 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4a725435-ffe5-4c2f-9f47-a753faa57281 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1188 microversion: 2.1 time: 0.149862 Sep 23 04:17:34.584990 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3027/6121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:34 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1188 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:35.614995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:35.616389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:35.632965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:35.635210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:35.636724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:35.640224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:35.641038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:35.643010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:35.824801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:35.834072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fe46b30-5d98-41c3-925b-647d7d2a568e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1188 microversion: 2.1 time: 0.223339 Sep 23 04:17:35.849251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3095/6122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:35 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1188 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:36.860897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:36.862335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:36.909676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:36.910573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:36.911291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:36.912141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:36.913697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:36.914776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:36.989283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:37.062560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:37.066885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:37.067516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:37.068081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lazy-loading 'fault' on Instance uuid 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:17:37.154828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:17:37.163892 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2b286cd-5d8a-45b3-be86-d9aa7e408daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 200 len: 1193 microversion: 2.1 time: 0.308123 Sep 23 04:17:37.166870 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3028/6123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:36 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 1193 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:17:38.189722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:38.190338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3eeb9795-0ebc-4f08-8d24-2e96d36455c4] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:38.204971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:38.206281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:38.210718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:38.211737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:38.212365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:38.212951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:38.249787 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 HTTP/1.1 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3eeb9795-0ebc-4f08-8d24-2e96d36455c4'} Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:17:38.251812 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. Sep 23 04:17:38.261811 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:17:38.263560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3eeb9795-0ebc-4f08-8d24-2e96d36455c4 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:17:38.264873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f2b6615-7e9f-444a-b3c7-adc8b9f83b68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4" status: 404 len: 111 microversion: 2.1 time: 0.079001 Sep 23 04:17:38.265677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3096/6124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:17:38 2022] GET /compute/v2.1/servers/3eeb9795-0ebc-4f08-8d24-2e96d36455c4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:17:55.222322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:17:55.223441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:17:55.234475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:55.237460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=5 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:17:55.243028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:55.246506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:55.247273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:55.248897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:17:55.251626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:17:55.252476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:17:55.455109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lazy-loading 'services' on Instance uuid 349e70e0-11ee-4c0d-add2-3fe959a6c925 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:17:55.669979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1f3bc46c-d494-4058-a25d-1e864afa5833 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925/os-volume_attachments/1ab1f501-4505-449c-acf5-d024d36311b3" status: 202 len: 0 microversion: 2.1 time: 0.449872 Sep 23 04:17:55.675453 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3029/6125] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:17:55 2022] DELETE /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925/os-volume_attachments/1ab1f501-4505-449c-acf5-d024d36311b3 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:18:03.665557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:03.667262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=29 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:03.673088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:03.675352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:03.712480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:03.713082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:03.716968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:03.719399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:03.719965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:03.727680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:03.829624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:18:04.162494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fb1ea001-cd34-404a-934d-12a888c4463b tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 204 len: 0 microversion: 2.1 time: 0.500169 Sep 23 04:18:04.167703 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3097/6126] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:18:03 2022] DELETE /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:18:04.194021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:04.196194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:04.206003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:04.206626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:04.207276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:04.208178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:04.208916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:04.209596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:04.972709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:05.006189 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-318b4a61-bde7-4638-8537-93085b6e68e9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1514 microversion: 2.1 time: 0.818823 Sep 23 04:18:05.013266 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3030/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:04 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1514 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:06.047575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:06.050309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:06.085326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:06.089636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:06.090106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:06.090859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:06.091325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:06.091756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:06.520036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:06.530535 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92a00ab0-8a99-4e22-a90b-cfaddde4dd92 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1514 microversion: 2.1 time: 0.501964 Sep 23 04:18:06.531134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3098/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:06 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1514 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:07.166233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349e70e0-11ee-4c0d-add2-3fe959a6c925", "name": "network-vif-deleted", "tag": "ce1c38db-858c-49a9-95f4-a2469336399b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:07.184388 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:18:07.184901 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 04:18:07.191004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:07.192156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:07.192944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:07.260745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] Creating event network-vif-deleted:ce1c38db-858c-49a9-95f4-a2469336399b for instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 on n-h1-858495-2 Sep 23 04:18:07.278718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1e54f794-099a-4dbb-a24e-3ccc27d951dc req-6d5c2821-af9c-4cb1-8827-5c93c42e12a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112824 Sep 23 04:18:07.292487 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3031/6129] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:18:07.555746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:07.556898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:07.570159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:07.575021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:07.575735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:07.579388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:07.581341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:07.581984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:07.672673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:07.675331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:07.679760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:07.680469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lazy-loading 'fault' on Instance uuid 349e70e0-11ee-4c0d-add2-3fe959a6c925 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:18:07.779147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b373ae88da41f2afacd87082d047d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde974c6d3c419e9bdee21add07c419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:07.795978 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a992702e-0653-4473-8ea7-c285b3a1e1a9 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 200 len: 1309 microversion: 2.1 time: 0.242812 Sep 23 04:18:07.826621 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3099/6130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:07 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:08.823498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:08.824384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] [instance: 349e70e0-11ee-4c0d-add2-3fe959a6c925] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:08.832462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:08.833135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:08.833634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:08.834971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:08.835549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:08.836664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:08.854614 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] HTTP exception thrown: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Request method failure captured: Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 HTTP/1.1 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTJ_4DNzhQ2QdvujZbxd7T4cZ_PxEs-ZjxUex29HAR4hQ8ScAp-SWgekmjpwLdq6I1ruUVqd6Gyer3UrOvutbKIpR6FYt6lbqVnInWW9t7BeBvOeqesNOeUulAz-Oni78f3qoBWJRSANUi0GobTd0eD1rtRKaFoFyiE1cm_sdEP0I4M Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: edde974c6d3c419e9bdee21add07c419 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edde974c6d3c419e9bdee21add07c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edde974c6d3c419e9bdee21add07c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: edde974c6d3c419e9bdee21add07c419 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1142295672 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesSnapshotTestJSON-1142295672-project Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 56b373ae88da41f2afacd87082d047d5 Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesSnapshotTestJSON-1142295672-project Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '349e70e0-11ee-4c0d-add2-3fe959a6c925'} Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:18:08.856471 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] Returning 404 to user: Instance 349e70e0-11ee-4c0d-add2-3fe959a6c925 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05a9e38d-15e4-4ac3-886e-b52b15085291 tempest-VolumesSnapshotTestJSON-1142295672 tempest-VolumesSnapshotTestJSON-1142295672-project] 10.222.0.25 "GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925" status: 404 len: 111 microversion: 2.1 time: 0.040654 Sep 23 04:18:08.865896 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3032/6131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:08 2022] GET /compute/v2.1/servers/349e70e0-11ee-4c0d-add2-3fe959a6c925 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:18:16.801721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-944509436", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0cfaae79-4899-4bbd-8d28-786c3c6ab3b8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:16.981968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:18:17.685321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:18:17.685979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:18:17.686572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:18:17.687147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:18:17.687751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:18:17.699059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:17.704247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:17.704936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:17.706124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:17.706851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:17.708109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:17.730751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:18:17.738196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:18:17.753141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:18:17.756275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0cfaae79-4899-4bbd-8d28-786c3c6ab3b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:18:17.896434 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19c106d1-9130-42fc-92a9-b0a63a9bb30a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098133 Sep 23 04:18:17.901278 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3100/6132] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:18:17.915131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95367197-dabc-410e-a5f4-068597dd4aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:17.919233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95367197-dabc-410e-a5f4-068597dd4aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:18.047931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95367197-dabc-410e-a5f4-068597dd4aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:18.064018 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95367197-dabc-410e-a5f4-068597dd4aea tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1056 microversion: 2.1 time: 0.158919 Sep 23 04:18:18.065160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3033/6133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:17 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1056 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:19.092160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:19.093703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:19.104358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:19.106080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:19.106760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:19.109157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:19.110181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:19.110773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:19.213389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:19.245154 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f2f837ea-7563-4941-bbc6-dd3ba2827d03 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1108 microversion: 2.1 time: 0.160671 Sep 23 04:18:19.246323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3101/6134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:19 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1108 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:20.272156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:20.273032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:20.277314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:20.294629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:20.295797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:20.296460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:20.297839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:20.298681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:20.299879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:20.583310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:20.593380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8bb0f3d-6aa8-4a85-aa9e-772adb0c64e7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.327139 Sep 23 04:18:20.610105 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3034/6135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:20 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:21.629981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:21.631789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:21.651904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:21.660011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:21.660772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:21.661547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:21.662065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:21.662497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:21.954000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:21.966571 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10385c87-8697-4d1f-9914-e32ee8fd1c68 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.339601 Sep 23 04:18:21.969291 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3102/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:21 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:21.995695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497fd3eb-b44e-463f-9a42-cdc43e84dbc7", "tag": "39a6bbd9-8e00-4794-8c18-298fa8169501"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:22.054252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:22.054673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:22.056022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:22.087797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] Creating event network-changed:39a6bbd9-8e00-4794-8c18-298fa8169501 for instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 on n-h2-858495-2 Sep 23 04:18:22.113894 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a24c1a89-c3d6-4b4f-a245-fd368f4a2e32 req-4555b28a-a6c9-422c-97aa-6e8f40e6d624 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122315 Sep 23 04:18:22.118084 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3035/6137] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:18:22.994844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:22.996239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:23.017212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:23.019570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:23.020266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:23.027790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:23.028628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:23.034516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:23.640409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:23.671163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ddf1aa3c-f4d7-45cf-aedf-f1f52e246f08 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.681047 Sep 23 04:18:23.673264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3103/6138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:22 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:24.702535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:24.703284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:24.726352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:24.728482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:24.738703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:24.739901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:24.740586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:24.741200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:24.945901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:24.956987 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14cd6742-80ec-43b7-a7ae-e39e10bc85de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.260731 Sep 23 04:18:24.965678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3036/6139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:24 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:25.981955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:25.983504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:25.993101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:25.994651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:25.995726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:25.996679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:25.997308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:25.997959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:26.237812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:26.249750 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ac01268b-1a7e-4ff0-9a26-d300ef0e02e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.270500 Sep 23 04:18:26.249750 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3104/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:25 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:27.275911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:27.280011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:27.297746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=19 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:27.299626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:27.300244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:27.300580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:27.301840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:27.302364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:27.302812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:27.541556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:27.552705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7355e7f6-df4f-40de-9ad0-211ac1401cfd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.284040 Sep 23 04:18:27.566116 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3037/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:27 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:28.580221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:28.581617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:28.589210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:28.590649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:28.593239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:28.594368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:28.595092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:28.596455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:28.597566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:28.601334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:28.876548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:28.886471 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-230427b5-3224-4eaf-8b74-f0832ff6d5d3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.310942 Sep 23 04:18:28.887070 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3105/6142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:28 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:29.914529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:29.916062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:29.928326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:29.935591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:29.940279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:29.941148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:29.942321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:29.945538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:29.946437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:30.255501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:30.266673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a023b449-3fa5-48ff-bf7f-ab2e25192919 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.356050 Sep 23 04:18:30.268155 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3038/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:29 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:31.298614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:31.300574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:31.313986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:31.314680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:31.315281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:31.316289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:31.318532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:31.319145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:31.504490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:31.515683 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f77ef581-2f4e-4b36-b148-c652ffbcb099 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.222092 Sep 23 04:18:31.516615 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3106/6144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:31 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:32.540091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:32.541455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:32.554956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:32.556571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:32.559185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:32.561401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:32.562942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:32.563702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:32.794267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:32.819760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4106393-1c83-4d3e-a14e-7c388c632ad1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.281783 Sep 23 04:18:32.821000 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3039/6145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:32 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:33.851271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:33.852007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:33.858248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:33.869116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:33.871816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:33.873618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:33.874789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:33.875271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:33.878173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:33.885925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:34.126534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:34.139076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8718cfc0-02c4-4fbc-a5b8-a62535de7c3c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.293664 Sep 23 04:18:34.141856 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3107/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:33 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:35.170046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:35.170656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:35.188936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:35.189705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:35.190320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:35.191180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:35.191785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:35.192364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:35.432582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:35.446849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b93e2faa-199c-417a-92cd-27f04f238732 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.280548 Sep 23 04:18:35.447445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3040/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:35 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:36.475081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:36.478753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:36.497674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:36.499251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:36.500572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:36.514231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:36.516594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:36.518743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:36.694502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:36.703329 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-194a8d38-1bad-44b1-9745-d29498d1aa88 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.233582 Sep 23 04:18:36.704678 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3108/6148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:36 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:37.728398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:37.732187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:37.741195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:37.741954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:37.742668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:37.748211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:37.750456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:37.751136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:38.041381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:38.057235 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e745c83e-8926-434a-8e88-31a1a7ab6ec8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.333032 Sep 23 04:18:38.062803 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3041/6149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:37 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:39.089465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:39.092070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:39.112199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:39.114267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:39.118325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:39.120262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:39.120974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:39.124658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:39.350096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:39.403175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6b023c4-c7fe-40bf-890e-a60f5d5f922b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1168 microversion: 2.1 time: 0.287903 Sep 23 04:18:39.404208 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3109/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:39 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1168 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:40.426716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:40.427227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:40.434523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:40.435230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:40.435828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:40.436687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:40.437297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:40.437957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:40.601952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:40.615133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96e4ebaf-5e58-4900-9b06-d9a8d654371b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.192352 Sep 23 04:18:40.615892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3042/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:40 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:18:41.639981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:41.641375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:41.653246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:41.656306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:41.656855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:41.658131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:41.658837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:41.659490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:41.866189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:41.889567 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2903f346-ff7a-4f4a-9173-d9eec02bd690 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.253843 Sep 23 04:18:41.899004 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3110/6152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:41 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:42.924650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:42.925201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:42.938169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:42.938660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:42.939102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:42.939848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:42.940272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:42.940699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:43.134606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:43.144195 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e09cbb79-09e2-4a4e-82a0-5e7eb18e06d4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.230349 Sep 23 04:18:43.145425 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3043/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:42 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:44.168424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:44.169772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:44.184632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:44.185452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:44.186144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:44.187123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:44.187835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:44.188461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:44.415304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:44.427121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eb222f5b-b4ec-4097-b3af-d6895280cb84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.262676 Sep 23 04:18:44.428258 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3111/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:44 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:45.452443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:45.454151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:45.482586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:45.483194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:45.483746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:45.484715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:45.487605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:45.490816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:45.691275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:45.703799 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b146ffbf-f607-4d8f-ba01-b5e040c3a39b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.256541 Sep 23 04:18:45.710427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3044/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:45 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:46.733186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:46.734002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:46.752813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:46.753642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:46.754832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:46.755888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:46.756551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:46.757175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:46.915421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:46.927562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4276b265-8e7b-4aff-9e65-9e0cef692b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.197831 Sep 23 04:18:46.929049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3112/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:46 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:18:47.976453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:47.977205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:47.990161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:47.990821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:47.991397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:47.992261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:47.992872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:47.993473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:48.223143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:48.232266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb50b7b8-73da-4ee4-a819-41c7913aad29 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.271353 Sep 23 04:18:48.247433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3045/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:47 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:49.255648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:49.256258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:49.268454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:49.273335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:49.274405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:49.275699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:49.276167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:49.280953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:49.514831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:49.526081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d7bd12f-b776-4cac-a15b-5eafaa338cbe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.274559 Sep 23 04:18:49.533418 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3113/6158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:49 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:50.550226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:50.550849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:50.564738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:50.565244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:50.565723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:50.566459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:50.566958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:50.567396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:50.570229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=69 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:50.748305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:50.756862 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe14c56a-a2ad-47a0-82fb-b879935ac03e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.210616 Sep 23 04:18:50.757855 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3046/6159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:50 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:51.526787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497fd3eb-b44e-463f-9a42-cdc43e84dbc7", "name": "network-vif-plugged", "status": "completed", "tag": "39a6bbd9-8e00-4794-8c18-298fa8169501"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:51.547726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:51.548726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:51.549188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:51.572208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] Creating event network-vif-plugged:39a6bbd9-8e00-4794-8c18-298fa8169501 for instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 on n-h2-858495-2 Sep 23 04:18:51.595103 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-70fcac2a-94f3-45b8-a8a5-a06de6a3118a req-7fd9f571-da5b-4061-b87a-a03e059d08e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072600 Sep 23 04:18:51.596978 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3114/6160] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:18:51.781162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:51.782174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:51.790401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:51.792731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:51.792731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:51.793112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:51.793890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:51.794494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:51.991390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:52.000237 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b49122d5-30b0-4a80-969f-b3d41b8a0988 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.223719 Sep 23 04:18:52.015455 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3047/6161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:51 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:53.025443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:53.026741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:53.037252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:53.040694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:53.042225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:53.044623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:53.045463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:53.046046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:53.285163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:53.302993 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54fe1ce9-47c2-4d08-a229-e2f5cf6b56ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1202 microversion: 2.1 time: 0.278960 Sep 23 04:18:53.304219 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3115/6162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:53 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1202 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:54.174626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1271534433", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "ea941d03-1501-48f8-b159-8e93c4f90dc1"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:54.245614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] validate_networks() for [('ea941d03-1501-48f8-b159-8e93c4f90dc1', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:18:54.332957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:54.335169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:54.344568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.346087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.346578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.347329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.347841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.349532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.560470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:54.574983 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa06683b-4bc8-4264-875b-a5cf77d0a3c6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1389 microversion: 2.1 time: 0.248568 Sep 23 04:18:54.575588 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3116/6163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:54 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1389 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:54.600949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:54.601674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:54.607773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.608284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.608717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.609659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.610292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.610733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.888094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:54.898365 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05779c01-7628-4611-9a45-779baf88ef48 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1389 microversion: 2.1 time: 0.303651 Sep 23 04:18:54.899796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3117/6164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:54 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1389 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:18:54.918264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:18:54.918700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:18:54.919187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:18:54.919602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:18:54.920017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:18:54.921593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:54.922322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:54.928698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.929316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.929889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.930998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.931569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.932105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.939399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.939890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.940328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.941066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:54.942091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:54.942527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:54.977884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Getting quotas for project 78dd829a2d6b4f07a6b6e2ab18bcf557. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:18:54.984041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Getting quotas for user ec545d41e8e4457ebb22602d49e05f3a and project 78dd829a2d6b4f07a6b6e2ab18bcf557. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:18:55.000021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:18:55.002801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:18:55.072806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54aae29b-a1ad-4b25-933e-8a2dc8d5af4a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038051 Sep 23 04:18:55.080525 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3048/6165] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:18:55.086864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c430b5d7-81e6-4447-9197-7ca0953217ee tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:55.087616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c430b5d7-81e6-4447-9197-7ca0953217ee tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:55.098312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:55.118679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-994e0560-4eaf-4857-98de-00b96dac1ecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1389 microversion: 2.1 time: 0.201468 Sep 23 04:18:55.122214 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3118/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:54 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:18:55.180887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c430b5d7-81e6-4447-9197-7ca0953217ee tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:55.191998 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c430b5d7-81e6-4447-9197-7ca0953217ee tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1214 microversion: 2.1 time: 0.108764 Sep 23 04:18:55.192761 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3049/6167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:55 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:55.216306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:55.216490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:55.223597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:55.224268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:55.225147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:55.226076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:55.226737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:55.227319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:55.256893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:18:55.387575 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-645d0287-5e34-40b2-ba4f-0a7e209c9863 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 204 len: 0 microversion: 2.1 time: 0.175364 Sep 23 04:18:55.388185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3119/6168] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:18:55 2022] DELETE /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:18:55.396797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:55.397602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:55.403991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:55.404691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:55.405307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:55.406225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:55.408587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:55.409195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:55.600413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:55.622349 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-305b9f21-e416-4490-9a52-df3257858a79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1395 microversion: 2.1 time: 0.229650 Sep 23 04:18:55.623085 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3050/6169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:55 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1395 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:56.217785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:56.218599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:56.226234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:56.226800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:56.227313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:56.228086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:56.228626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:56.229124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:56.305302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:56.314248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-95163d8f-f27e-41d4-a87c-9bd6a6c3b8b7 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1266 microversion: 2.1 time: 0.101407 Sep 23 04:18:56.330383 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3120/6170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:56 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:18:56.649072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:56.650320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:56.661483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:56.662357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:56.663121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:56.664004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:56.664619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:56.665272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:56.867486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:56.879158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-72a1c731-666f-4006-b41e-5cef3dfe6e82 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1395 microversion: 2.1 time: 0.236059 Sep 23 04:18:56.899068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3051/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:56 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1395 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:57.349044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:57.354627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:57.387976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:57.394127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:57.400103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:57.401161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:57.401932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:57.402529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:57.740613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:57.751881 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-80e3a1d5-5f7e-4d7d-85c4-474dfc7e21e6 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.416729 Sep 23 04:18:57.753099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3121/6172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:57 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:57.910665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:57.913679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:57.922036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:57.937531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:57.942410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:57.945324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:57.946120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:57.949487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:57.949831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:58.083881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497fd3eb-b44e-463f-9a42-cdc43e84dbc7", "name": "network-vif-deleted", "tag": "39a6bbd9-8e00-4794-8c18-298fa8169501"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:58.108005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:58.117463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:58.119389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:58.121752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:58.134540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b596aa5-a3c6-4a19-80a6-c7f27f6d755c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1353 microversion: 2.1 time: 0.230942 Sep 23 04:18:58.135516 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3052/6173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:57 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:58.170698 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] Creating event network-vif-deleted:39a6bbd9-8e00-4794-8c18-298fa8169501 for instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 on n-h2-858495-2 Sep 23 04:18:58.176332 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7f94f1a4-e52f-47c0-baab-18bb1f471c0e req-0971b1c4-05bd-44bd-af42-534b9638835b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097124 Sep 23 04:18:58.177675 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3122/6174] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:18:58.767947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5284c117-b643-4722-837d-976e4fcc50e3", "tag": "48ccfbfc-1a74-4f83-a925-3f9adc3e9157"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:18:58.777288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:58.778082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:58.794919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:58.795438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:58.796001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:58.796738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:58.797210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:58.797786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:58.834492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:58.834914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:58.835386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:58.835691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:18:58.853413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] Creating event network-changed:48ccfbfc-1a74-4f83-a925-3f9adc3e9157 for instance 5284c117-b643-4722-837d-976e4fcc50e3 on n-h1-858495-2 Sep 23 04:18:58.860431 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-49191c78-2502-4e8f-bbcb-383b7ff72af7 req-706894c6-ba40-4533-8c9f-8edd1ddeef99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096906 Sep 23 04:18:58.861429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3053/6175] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:18:58.999551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:59.009246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e3bd6dd-c5bd-4834-a240-ed388dcd7780 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.236955 Sep 23 04:18:59.010079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3123/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:58 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:18:59.161283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:18:59.162766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:18:59.169787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:59.170651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:59.171310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:59.172260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:18:59.172944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:18:59.173623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:18:59.249207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:18:59.258758 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2886997-962f-4074-bdc3-6b47c2deba35 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1187 microversion: 2.1 time: 0.102727 Sep 23 04:18:59.259808 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3054/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:18:59 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:00.032696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:00.033539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:00.040643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:00.041137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:00.041617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:00.042326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:00.042998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:00.043462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:00.210450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:00.218595 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88100d2e-ca5d-48c0-8033-0e5adcc8c7d8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.190197 Sep 23 04:19:00.233881 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3124/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:00 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:00.284038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:00.285928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:00.293139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:00.293989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:00.294670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:00.295595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:00.296260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:00.296916 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:00.367240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:00.376398 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7f46a38-3fc5-455d-9bb5-d597aec98802 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1187 microversion: 2.1 time: 0.096120 Sep 23 04:19:00.394493 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3055/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:00 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:01.242503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:01.243172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:01.250178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:01.250615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:01.251042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:01.251781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:01.252262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:01.252723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:01.398917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:01.400354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:01.407785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:01.408506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:01.409127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:01.410088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:01.410912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:01.411564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:01.417069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:01.426732 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3da527d0-bdd7-435c-9d72-9dff107f56c8 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.187286 Sep 23 04:19:01.427772 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3125/6180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:01 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:01.484176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:01.493686 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a11e4194-cfba-42d5-9567-bf9759355bff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1187 microversion: 2.1 time: 0.098502 Sep 23 04:19:01.494445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3056/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:01 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:02.450399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:02.451193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:02.458549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:02.459270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:02.460448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:02.461531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:02.462147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:02.462733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:02.518449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:02.520362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:02.527917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:02.528772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:02.529480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:02.530453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:02.531133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:02.531777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:02.629008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:02.651367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3e297cc7-ef55-4971-a6f4-606d3b116566 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 200 len: 1187 microversion: 2.1 time: 0.132234 Sep 23 04:19:02.652313 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3057/6182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:02 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 1187 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:02.677857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:02.685714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f652120-6152-497c-a33e-1eb6c2700453 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.239197 Sep 23 04:19:02.686296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3126/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:02 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:03.675205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:03.676509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:03.694533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:03.694533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:03.697538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:03.698374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:03.698927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:03.699446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:03.711763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:03.713302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:03.726297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:03.727014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:03.727867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:03.728587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 HTTP/1.1 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '497fd3eb-b44e-463f-9a42-cdc43e84dbc7'} Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:03.729730 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:03.734829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:19:03.736010 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f726a3d0-0c63-4193-b243-9aa8e151339e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 404 len: 111 microversion: 2.1 time: 0.064913 Sep 23 04:19:03.737049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:03.738967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:03.739570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:03.754478 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3058/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:03 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:19:03.975010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:03.985241 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-327a83fe-090c-4850-9b00-17a7e19a6a08 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.277619 Sep 23 04:19:03.997540 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3127/6185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:03 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:04.109680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5284c117-b643-4722-837d-976e4fcc50e3", "name": "network-vif-plugged", "status": "completed", "tag": "48ccfbfc-1a74-4f83-a925-3f9adc3e9157"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:04.127671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:04.130462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:04.131041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:04.158086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] Creating event network-vif-plugged:48ccfbfc-1a74-4f83-a925-3f9adc3e9157 for instance 5284c117-b643-4722-837d-976e4fcc50e3 on n-h1-858495-2 Sep 23 04:19:04.170209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-de91c1d3-e778-4460-8ce3-66dbbe094e82 req-e626a566-d654-4a52-9ffa-15a1a0dff8f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062896 Sep 23 04:19:04.171354 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3059/6186] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:05.010919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:05.012268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:05.027853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:05.029986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:05.030736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:05.031483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:05.032542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:05.033236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:05.033984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:05.192769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:05.202638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-efd86080-efa0-4b6e-81c4-88c057ccb11a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1314 microversion: 2.1 time: 0.195186 Sep 23 04:19:05.203817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3128/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:05 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:06.227275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:06.228276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:06.231290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:06.236343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=8 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:06.248248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:06.248997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:06.258346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:06.259475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:06.260124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:06.260727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:06.456326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:06.469378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07052074-fb6b-453b-816a-9aec482a845c tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1498 microversion: 2.1 time: 0.247179 Sep 23 04:19:06.470879 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3060/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:06 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:07.059964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:07.061064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:07.086623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:07.087972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:07.090425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:07.091397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:07.092023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:07.093941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:07.123393 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 HTTP/1.1 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '497fd3eb-b44e-463f-9a42-cdc43e84dbc7'} Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:19:07.125436 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.130608 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.132076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:19:07.133158 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2fb5bd34-f58e-4c22-81a7-bd8ce8cdff80 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 404 len: 111 microversion: 2.1 time: 0.077592 Sep 23 04:19:07.134329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3129/6189] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:19:07 2022] DELETE /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:19:07.142722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:07.143643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 497fd3eb-b44e-463f-9a42-cdc43e84dbc7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:07.150498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:07.151911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:07.152543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:07.153679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:07.154322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:07.154911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:07.170861 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 HTTP/1.1 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '497fd3eb-b44e-463f-9a42-cdc43e84dbc7'} Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:07.172885 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. Sep 23 04:19:07.177456 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:07.178645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 497fd3eb-b44e-463f-9a42-cdc43e84dbc7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:19:07.179650 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dfd11d93-c99e-431a-a3ce-7c87b69ea6a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7" status: 404 len: 111 microversion: 2.1 time: 0.041376 Sep 23 04:19:07.180789 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3061/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:07 2022] GET /compute/v2.1/servers/497fd3eb-b44e-463f-9a42-cdc43e84dbc7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:19:10.403431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:10.405447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:10.413264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:10.414428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:10.415636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:10.416510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:10.417118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:10.417739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:10.455341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:19:10.570382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8fdaf3c-6be0-4cde-aa3c-ba16810d4ec4 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 204 len: 0 microversion: 2.1 time: 0.168911 Sep 23 04:19:10.574795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3130/6191] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:19:10 2022] DELETE /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:19:10.579915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:10.581877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:10.590150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:10.591103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:10.591765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:10.592706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:10.593398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:10.594045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:10.759884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:10.767785 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89a5aa30-ac95-4edc-ba63-88cf2f031fb9 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1504 microversion: 2.1 time: 0.191756 Sep 23 04:19:10.769479 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3062/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:10 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:11.793051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:11.794484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:11.808116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:11.809604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:11.810200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:11.811206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:11.811825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:11.812413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:12.126296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:12.155830 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f304c66a-cc5e-4c17-af38-8a17149f6430 tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1504 microversion: 2.1 time: 0.367325 Sep 23 04:19:12.157100 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3131/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:11 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:13.013411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5284c117-b643-4722-837d-976e4fcc50e3", "name": "network-vif-deleted", "tag": "48ccfbfc-1a74-4f83-a925-3f9adc3e9157"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:13.031850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:13.039378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:13.042312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:13.078249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] Creating event network-vif-deleted:48ccfbfc-1a74-4f83-a925-3f9adc3e9157 for instance 5284c117-b643-4722-837d-976e4fcc50e3 on n-h1-858495-2 Sep 23 04:19:13.090126 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-42b54b9c-2730-4b3f-be13-3c9acd675c0f req-6889a293-bdda-4355-ba5c-96415085dfb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079038 Sep 23 04:19:13.091651 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3063/6194] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:13.199612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:13.201305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:13.228817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:13.229279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:13.229759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:13.230487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:13.230946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:13.234250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:13.347932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:13.348439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:13.348872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:13.349328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lazy-loading 'fault' on Instance uuid 5284c117-b643-4722-837d-976e4fcc50e3 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:19:13.413593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec545d41e8e4457ebb22602d49e05f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dd829a2d6b4f07a6b6e2ab18bcf557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:13.422672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b57bc0f-2e6a-474c-8c51-032b8284860a tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 200 len: 1304 microversion: 2.1 time: 0.242434 Sep 23 04:19:13.424784 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3132/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:13 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:14.453195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:14.455634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] [instance: 5284c117-b643-4722-837d-976e4fcc50e3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:14.466168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:14.470264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:14.470937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:14.472985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:14.473653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:14.474099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:14.493939 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] HTTP exception thrown: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Request method failure captured: Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 HTTP/1.1 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTOsQaLdFX0U_XoG2F4N3gCxfs3SecWiAHxc56c-3ml8qnYuvCN-FOPCapSeC3OjK1LoMLycSmtmHQi_o7W5qcRckPGnAat1HTB1JKksh9c2VX13L1JQzVn9oaIOGQWGuC1P7Snej7F_fDBITey6Hszgik_2af1lRuWvOjZu0hzkO8g Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 78dd829a2d6b4f07a6b6e2ab18bcf557 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-VolumesActionsTest-666059893 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78dd829a2d6b4f07a6b6e2ab18bcf557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78dd829a2d6b4f07a6b6e2ab18bcf557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78dd829a2d6b4f07a6b6e2ab18bcf557"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78dd829a2d6b4f07a6b6e2ab18bcf557"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-VolumesActionsTest-666059893 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 78dd829a2d6b4f07a6b6e2ab18bcf557 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-VolumesActionsTest-666059893 Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-VolumesActionsTest-666059893-project Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: ec545d41e8e4457ebb22602d49e05f3a Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-VolumesActionsTest-666059893-project Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '5284c117-b643-4722-837d-976e4fcc50e3'} Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:19:14.497939 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. Sep 23 04:19:14.502797 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:19:14.505337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] Returning 404 to user: Instance 5284c117-b643-4722-837d-976e4fcc50e3 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:19:14.506816 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0d52e04c-d620-49fd-b910-f961c262a0ba tempest-VolumesActionsTest-666059893 tempest-VolumesActionsTest-666059893-project] 10.222.0.25 "GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3" status: 404 len: 111 microversion: 2.1 time: 0.060711 Sep 23 04:19:14.507948 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3064/6196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:14 2022] GET /compute/v2.1/servers/5284c117-b643-4722-837d-976e4fcc50e3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:19:34.219176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-978015324", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d1bee737-852a-4e02-9fbf-2b0b749fc9c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:34.231066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:34.231730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:34.297604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:19:34.754053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:19:34.754485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:19:34.755066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:19:34.755490 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:19:34.756387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:19:34.768545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:34.769382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:34.769805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:34.770551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:34.771226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:34.771667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:34.794395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:19:34.801744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:19:34.873921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:19:34.876186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1bee737-852a-4e02-9fbf-2b0b749fc9c8',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:19:35.122983 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ebe824b8-f5b9-4768-91f2-b43dca7c6492 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907475 Sep 23 04:19:35.123658 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3133/6197] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:19:35.135678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cae04221-f30f-429e-aa85-dd231c0693da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:35.136307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cae04221-f30f-429e-aa85-dd231c0693da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:35.140091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=25 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:35.142012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=79 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:35.217108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cae04221-f30f-429e-aa85-dd231c0693da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:35.226847 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cae04221-f30f-429e-aa85-dd231c0693da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1070 microversion: 2.1 time: 0.094913 Sep 23 04:19:35.242348 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3065/6198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:35 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1070 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:36.251692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:36.253285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:36.263385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:36.264126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:36.264918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:36.265877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:36.266557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:36.267278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:36.365803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:36.384684 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10b82407-584d-498e-aeed-994f8dede530 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1176 microversion: 2.1 time: 0.136878 Sep 23 04:19:36.385507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3134/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:36 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1176 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:37.409293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:37.409941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:37.424680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:37.428314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:37.430045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:37.433857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:37.434558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:37.435180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:37.633541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:37.645274 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c826dfed-9c17-4e4b-8877-758897494218 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1228 microversion: 2.1 time: 0.240253 Sep 23 04:19:37.646546 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3066/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:37 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1228 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:38.459626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd25bf1-1e75-4745-8b25-cfec83d47680", "tag": "ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:38.475542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:38.476175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:38.476586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:38.493081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] Creating event network-changed:ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76 for instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 on n-h1-858495-2 Sep 23 04:19:38.499285 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2932ec3f-4c55-437d-b4ba-f3cacb36c6cd req-3096b41a-14ca-4c25-991b-e936cf3d1c41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045774 Sep 23 04:19:38.500297 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3135/6201] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:38.671215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:38.672667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:38.680538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:38.681236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:38.686059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:38.696860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:38.697833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:38.698540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:38.874522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:38.883283 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-61e8cd53-47db-4cb5-906d-7eba264c9fe1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1228 microversion: 2.1 time: 0.219030 Sep 23 04:19:38.884497 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3067/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:38 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:39.909055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:39.910224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:39.918090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:39.918859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:39.919579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:39.920369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:39.921027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:39.921880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:40.086830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:40.094968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f2a5a75-319f-4e4c-b550-891559bcb524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1228 microversion: 2.1 time: 0.192823 Sep 23 04:19:40.096521 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3136/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:39 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:41.123397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:41.125455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:41.135178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:41.136035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:41.136709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:41.137803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:41.138549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:41.139855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:41.309947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:41.320151 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4117990-6bda-4ac0-8d05-e24b9826ba46 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1228 microversion: 2.1 time: 0.201486 Sep 23 04:19:41.321757 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3068/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:41 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:42.344332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:42.346265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:42.353976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:42.354655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:42.355437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:42.356304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:42.356921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:42.357540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:42.585293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:42.595265 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dfead075-71fa-40ee-89d9-99bcda668b06 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1228 microversion: 2.1 time: 0.254266 Sep 23 04:19:42.596725 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3137/6205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:42 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1228 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:43.619546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:43.620258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:43.628329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:43.628677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:43.629100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:43.629930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:43.630357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:43.630833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:43.776375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:43.784601 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2592e480-0f44-4429-bd34-c230e9af998e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.169480 Sep 23 04:19:43.785369 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3069/6206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:43 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:44.807976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:44.809274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:44.816016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:44.817344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:44.819250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:44.820040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:44.820887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:44.821825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:44.822689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:44.823276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:45.021498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:45.029258 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-12603a58-dcc8-4e47-bc26-a8c77a5b494f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.225217 Sep 23 04:19:45.033957 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3138/6207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:44 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:46.053644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:46.054462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:46.057741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:46.063693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:46.064697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:46.065144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:46.065892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:46.066352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:46.066787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:46.232338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:46.240410 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de4082c7-e56d-4a3d-b9a1-818717c879f9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.191750 Sep 23 04:19:46.240998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3070/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:46 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:47.264137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:47.266314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:47.287729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:47.288422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:47.289032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:47.290140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:47.290884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:47.291936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:47.457566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:47.470998 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-11567761-13e0-401f-9221-8523eb47ee2e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.210672 Sep 23 04:19:47.472314 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3139/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:47 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:48.506093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:48.510814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:48.519019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:48.523938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:48.525107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:48.526011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:48.526572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:48.527291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:48.683317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:48.693639 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-485acea3-f49f-4af3-8a04-5f6ecdb40f30 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.202531 Sep 23 04:19:48.694445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3071/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:48 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:49.182318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2044889582", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:49.242137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:19:49.543455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:19:49.543879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:19:49.544350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:19:49.544845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:19:49.545284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:19:49.555237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:49.555722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:49.556156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:49.556884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:49.557340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:49.557797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:49.575037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Getting quotas for project b3c21b70abc24db797787e75274aea14. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:19:49.580405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Getting quotas for user a464036a43fe4c11a020f5dd68ccc928 and project b3c21b70abc24db797787e75274aea14. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:19:49.592798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:19:49.595145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:19:49.643565 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4688b72c-6cee-4d5e-8578-e9c6734f42eb tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465314 Sep 23 04:19:49.644614 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3140/6211] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:19:49.656543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68a76781-17f6-4d91-ae6b-33cd88d480dc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:49.658354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68a76781-17f6-4d91-ae6b-33cd88d480dc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:49.719425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:49.720680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:49.734190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:49.734718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:49.737969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:49.738650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:49.739125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:49.739567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:49.752664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68a76781-17f6-4d91-ae6b-33cd88d480dc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:49.778261 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68a76781-17f6-4d91-ae6b-33cd88d480dc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1214 microversion: 2.1 time: 0.126518 Sep 23 04:19:49.779075 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3072/6212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:49 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:49.899162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:49.907040 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2606c0e4-85f6-477f-84b7-a6801694bd22 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.191464 Sep 23 04:19:49.908309 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3141/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:49 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:50.802564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:50.803304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:50.811051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:50.811632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:50.812167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:50.812943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:50.813704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:50.814387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:50.925152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:50.934038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:50.934795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:50.943598 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-145ddef3-47b4-40f7-9ebb-0d5f2a349146 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1274 microversion: 2.1 time: 0.144627 Sep 23 04:19:50.944359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3073/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:50 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:50.958405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:50.959227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:50.959883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:50.960826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:50.961537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:50.962184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:51.221070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:51.229724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b97a5388-7fc9-4047-8715-12660fd1fc90 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.301551 Sep 23 04:19:51.231493 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3142/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:50 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:51.975711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:51.976349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:51.986142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:51.986868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:51.987657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:51.988806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:51.989490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:51.990115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:52.212814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:52.222675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a598a629-0844-4557-84e0-7919a646a576 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.255765 Sep 23 04:19:52.224182 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3074/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:51 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:52.254572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:52.255184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:52.262756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:52.263541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:52.264179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:52.265128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:52.266220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:52.267402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:52.352569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd25bf1-1e75-4745-8b25-cfec83d47680", "name": "network-vif-plugged", "status": "completed", "tag": "ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:52.364568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:52.365296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:52.365956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:52.378733 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] Creating event network-vif-plugged:ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76 for instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 on n-h1-858495-2 Sep 23 04:19:52.384750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0133539f-59e6-4a64-9818-2ace363fa442 req-5314b077-b55c-4645-a6c0-f02b502d7fe4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Sep 23 04:19:52.386139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3075/6217] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:52.511617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:52.520017 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38be139b-0a0f-4477-8d74-fdbae3b1f545 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1216 microversion: 2.1 time: 0.269238 Sep 23 04:19:52.520940 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3143/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:52 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1216 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:52.873697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526c951b-9162-4560-be69-28ed1f6b7b44", "tag": "5daf8b0f-201e-4444-853b-d2fa3a9cc7de"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:52.884371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:52.885166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:52.885903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:52.898019 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] Creating event network-changed:5daf8b0f-201e-4444-853b-d2fa3a9cc7de for instance 526c951b-9162-4560-be69-28ed1f6b7b44 on n-h2-858495-2 Sep 23 04:19:52.903095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7a004472-db45-43b9-a1cc-82f8409361da req-2b7fc12e-aceb-401d-9074-ee9a240ef921 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Sep 23 04:19:52.903813 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3076/6219] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:53.251197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:53.251736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:53.258441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.259038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.259368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.260106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.260565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.260992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.428032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:53.435901 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ab8dc36-c6d6-4e6f-b49f-ffaa58a6a3fe tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.188705 Sep 23 04:19:53.436480 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3144/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:53 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:53.546230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:53.548039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:53.555410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.555990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.556616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.557436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.557905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.558346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.699365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:53.707452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8745d1de-321a-4eb3-8e39-a5cd979a8d2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1403 microversion: 2.1 time: 0.167438 Sep 23 04:19:53.708047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3077/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:53 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1403 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:53.730172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:53.730802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:53.737425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.737914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.738352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.739057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.739516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.739949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.870525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:53.880591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4bdf8646-ef19-4cb6-af45-51ac8b2a62a9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1403 microversion: 2.1 time: 0.154251 Sep 23 04:19:53.881258 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3145/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:53 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:53.903600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-673129982"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:53.905926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:53.912826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.913425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.913986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:53.914765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:53.915307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:53.915811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:54.010170 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Attempting to quiesce instance before volume snapshot. Sep 23 04:19:54.077103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 23 04:19:54.149068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Creating snapshot from volume d1bee737-852a-4e02-9fbf-2b0b749fc9c8. {{(pid=128723) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 23 04:19:54.459841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:54.460461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:54.475229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:54.475937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:54.476384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:54.477283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:54.477597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:54.478029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:54.637567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:54.646517 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54052848-76dc-4d39-801d-179777eceb89 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.190489 Sep 23 04:19:54.647705 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3146/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:54 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:55.097007 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8c1cc77-fcb6-479c-b70a-7b8cb26b9b70 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680/action" status: 202 len: 0 microversion: 2.1 time: 1.197421 Sep 23 04:19:55.098994 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3078/6224] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:19:53 2022] POST /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680/action => generated 0 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:19:55.669852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:55.671166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:55.724620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:55.725442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:55.728343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:55.729376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:55.730011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:55.732623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:56.012737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:56.022292 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-91a8ba2c-c4b4-44bf-ab89-2b6c352e688e tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.356624 Sep 23 04:19:56.023970 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3147/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:55 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:56.314208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-394954844", "imageRef": "e9f70464-bc99-4ea9-a139-87687c98609f", "flavorRef": "452", "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:56.368829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:19:57.018809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:19:57.019248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:19:57.019742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:19:57.020188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:19:57.020620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:19:57.029506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:57.030006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:57.030459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:57.031200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:57.031669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:57.032164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:57.045531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:57.046205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:57.050326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:19:57.054033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:57.054611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:57.055113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:57.055872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:19:57.056056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:57.056739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:57.057239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:57.069796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:19:57.072593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='acc40d53-cdf1-4493-befb-06a020f22552',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:19:57.149773 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f0e6807a-70f0-4653-84af-a87b10ffadcd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841464 Sep 23 04:19:57.150748 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3079/6226] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:19:57.162543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93af1ddc-78da-4ff9-bc8d-a7a0027a6491 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:57.163520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93af1ddc-78da-4ff9-bc8d-a7a0027a6491 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:57.234451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:57.252155 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c536664c-6165-442e-84c7-c1eeeae24c00 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.210404 Sep 23 04:19:57.253264 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3148/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:57 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:19:57.254333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93af1ddc-78da-4ff9-bc8d-a7a0027a6491 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:57.268957 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93af1ddc-78da-4ff9-bc8d-a7a0027a6491 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1229 microversion: 2.1 time: 0.109991 Sep 23 04:19:57.270389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3080/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:57 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:57.840942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526c951b-9162-4560-be69-28ed1f6b7b44", "name": "network-vif-plugged", "status": "completed", "tag": "5daf8b0f-201e-4444-853b-d2fa3a9cc7de"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:57.855137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:57.855863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:57.856547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:57.870954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] Creating event network-vif-plugged:5daf8b0f-201e-4444-853b-d2fa3a9cc7de for instance 526c951b-9162-4560-be69-28ed1f6b7b44 on n-h2-858495-2 Sep 23 04:19:57.878669 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0b8c2b22-4577-4432-9fc4-e7619f3b513a req-e76cef71-0ba5-4cda-8b2e-3710a1e7f9f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042568 Sep 23 04:19:57.880135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3149/6229] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:19:58.285312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:58.286252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:58.293566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:58.294477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:58.294946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:58.295662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:58.295970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:58.296941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:58.298190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:58.298884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:58.303442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:58.303947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:58.304389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:58.305314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:58.305817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:58.306251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:58.433219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:58.451558 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ac5b2d3-1b01-4e99-a622-89870b144687 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1289 microversion: 2.1 time: 0.161621 Sep 23 04:19:58.453659 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3150/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:58 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1289 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:58.498409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:58.508374 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18b796ef-99f7-4cae-b526-3ef12be3001b tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1314 microversion: 2.1 time: 0.227119 Sep 23 04:19:58.536141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3081/6231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:58 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:59.476654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:59.477284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:59.492636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.493427 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.497764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.498937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.499728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.502014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.537185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:19:59.537848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:59.553037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.553997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.555982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.556988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.559128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.562127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.565872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:59.600787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:19:59.869169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:59.886376 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-282f802f-48c5-456c-8c1e-25af00b7b625 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.414224 Sep 23 04:19:59.887532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:19:59.887722 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3151/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:59 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:59.897442 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ae45f8c-f8bf-406b-9adf-86fca0267631 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1464 microversion: 2.1 time: 0.365131 Sep 23 04:19:59.898787 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3082/6233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:19:59 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1464 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:19:59.921804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e47c7e0-03f0-4ce7-8328-69dcf1461640", "device": "/dev/sdb"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:19:59.925386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:19:59.932116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.932705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.933276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.934100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:19:59.934632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:19:59.935157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:19:59.941804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:00.265080 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-37e5f0d5-fe37-4dc7-b304-672a1b852de5 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "POST /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347485 Sep 23 04:20:00.265732 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3152/6234] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:19:59 2022] POST /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:00.550201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae036e7-e073-4707-91be-429cf04d5770", "tag": "d289881c-22c6-44e2-bd05-de29d3436ecf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:00.572982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:00.573834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:00.574560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:00.590534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] Creating event network-changed:d289881c-22c6-44e2-bd05-de29d3436ecf for instance aae036e7-e073-4707-91be-429cf04d5770 on n-h1-858495-2 Sep 23 04:20:00.601064 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-14125cc4-df01-4272-9ac9-91fb9fc2090e req-4a8894eb-e86d-493c-be4e-9b80f10a1405 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056877 Sep 23 04:20:00.602295 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3083/6235] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:00.910411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:00.911112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:00.930568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:00.931366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:00.932259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:00.933023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:00.933513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:00.934199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:01.174075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:01.183550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df86c1c9-633c-4ee0-b0fd-627c7f13d90b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.277361 Sep 23 04:20:01.206050 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3153/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:00 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:02.211591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:02.212683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:02.219300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:02.219876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:02.220403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:02.221208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:02.221766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:02.222659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:02.373584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:02.383107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd4ddd30-8abe-458c-a6a4-0205d3aad6b7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.176611 Sep 23 04:20:02.397966 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3084/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:02 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:03.406940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:03.408672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:03.416889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:03.417714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:03.418643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:03.419489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:03.420205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:03.420756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:03.661677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:03.694466 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c20d8bb-fc37-4bde-b71d-f8cf7421b43d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.291189 Sep 23 04:20:03.695346 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3154/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:03 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:04.721421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:04.722109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:04.729166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:04.729697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:04.730151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:04.730868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:04.731384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:04.731790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:04.739492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:04.929707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:04.938698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f2890bcf-fc0f-46bd-9fb7-4fac6bb93c95 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.221571 Sep 23 04:20:04.945662 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3085/6239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:04 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:05.962813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:05.964214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:05.972266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:05.974862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:05.975924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:05.976594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:05.977663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:05.978543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:05.979210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:06.166209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:06.177222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3dd4c0a6-2b0b-476b-9062-26c70247e3e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.218747 Sep 23 04:20:06.189980 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3155/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:05 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:07.200856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:07.201945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:07.206803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:07.208014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:07.213042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:07.213531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:07.214117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:07.214852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:07.215330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:07.215773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:07.267039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:07.360902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:07.368878 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bf1c166-88fe-42a2-8235-618b4b22fbee tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.172618 Sep 23 04:20:07.369522 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3086/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:07 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:08.400184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:08.401371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:08.413138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:08.414037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:08.414895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:08.416172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:08.417070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:08.417953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:08.584090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:08.592326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33989cb5-a012-4d58-9290-fdd7640042b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.199216 Sep 23 04:20:08.597565 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3156/6242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:08 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:09.618592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:09.619122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:09.627044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:09.627563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:09.627991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:09.628705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:09.629439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:09.629888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:09.762758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:09.770646 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6a9e1e2-8cdf-472b-ba3f-9b5f96f4d152 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.156426 Sep 23 04:20:09.771436 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3087/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:09 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:10.794460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:10.795240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:10.802880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:10.803373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:10.803812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:10.804512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:10.804970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:10.805422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:10.935268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:10.943000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-62e7874e-5f7a-4048-87fc-b6d6e0079d78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.152360 Sep 23 04:20:10.943520 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3157/6244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:10 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:11.965886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:11.966601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:11.974837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:11.975347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:11.975803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:11.976527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:11.977244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:11.977952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:12.124386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:12.283563 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-809fb82f-aaf2-4b85-87b3-5a53d7870f18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.171981 Sep 23 04:20:12.283563 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3088/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:11 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:13.158403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:13.159020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:13.166659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:13.167152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:13.167605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:13.168454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:13.168901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:13.169335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:13.370844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:13.380548 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8429f81f-7a71-4e05-b39a-228580e6e659 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.226694 Sep 23 04:20:13.381145 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3158/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:13 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:14.405796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:14.406607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:14.415224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:14.415812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:14.416268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:14.417068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:14.417575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:14.418024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:14.589472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:14.611089 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5df43546-ac02-403d-b4ad-2b03fc32a489 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1341 microversion: 2.1 time: 0.211513 Sep 23 04:20:14.611711 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3089/6247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:14 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:15.635950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:15.636860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:15.644673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:15.645328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:15.645804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:15.646516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:15.646978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:15.647409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:15.813154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:15.827719 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-947e6017-e511-4d8c-8eb8-2e0de798e824 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.197579 Sep 23 04:20:15.839617 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3159/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:15 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:16.858700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:16.860238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:16.867467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:16.868056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:16.868617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:16.869645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:16.870079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:16.870759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:17.028308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:17.038347 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52eb4ab9-1220-4443-b4e3-a76296213b3e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.183583 Sep 23 04:20:17.039264 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3090/6249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:16 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:18.061407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:18.062764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:18.070102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:18.070595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:18.071298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:18.072163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:18.072686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:18.073204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:18.226611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:18.235894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fb6e8f0-9b68-4469-90c3-0beefce41939 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.178255 Sep 23 04:20:18.236826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3160/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:18 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:19.260321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:19.261030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:19.272105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:19.272760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:19.273134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:19.274106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:19.274774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:19.275351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:19.446992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:19.456875 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eea07f52-abf0-4a20-a27f-0ca7e194b1de tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.201445 Sep 23 04:20:19.458104 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3091/6251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:19 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:20.483783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:20.485750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:20.495046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:20.495689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:20.496256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:20.497052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:20.497547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:20.498141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:20.683612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:20.699760 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f8434f1-3f9f-47b0-a29b-6cc26f838fe8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.220041 Sep 23 04:20:20.700403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3161/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:20 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:21.730945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:21.732244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:21.739258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:21.740038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:21.740689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:21.741775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:21.742258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:21.742705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:21.917271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:21.930536 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-536a3388-a6d8-4a23-9b03-b603684b0271 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.203470 Sep 23 04:20:21.931130 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3092/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:21 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:22.955738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:22.957103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:22.964836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:22.965690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:22.966564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:22.969810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:22.969810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:22.969810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:23.148057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:23.158449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46b99b67-5a1f-45bd-be35-0f2b40cedcbf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.208026 Sep 23 04:20:23.161909 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3162/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:22 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:24.191833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:24.197831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:24.218913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:24.219710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:24.220335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:24.221394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:24.222034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:24.222768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:24.454391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:24.479625 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1983c228-4578-4229-a2b7-57d120c1a5db tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.299224 Sep 23 04:20:24.481529 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3093/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:24 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:25.505611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:25.506562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:25.515921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:25.516413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:25.517123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:25.517863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:25.518537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:25.519128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:25.692390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:25.702198 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b40b8e2d-2a54-4ea7-b3fb-cc33597eab59 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.201587 Sep 23 04:20:25.710291 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3163/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:25 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:26.687414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae036e7-e073-4707-91be-429cf04d5770", "name": "network-vif-plugged", "status": "completed", "tag": "d289881c-22c6-44e2-bd05-de29d3436ecf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:26.708250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.708757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.709219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.728383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:26.729097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:26.737215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.737675 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] Creating event network-vif-plugged:d289881c-22c6-44e2-bd05-de29d3436ecf for instance aae036e7-e073-4707-91be-429cf04d5770 on n-h1-858495-2 Sep 23 04:20:26.737900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.738402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.739254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.739855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.740568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.746915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-057140ea-964b-4903-9bd5-57581be5efe8 req-ac64b317-64b3-4ae6-b722-e61b127038a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263767 Sep 23 04:20:26.749336 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3094/6257] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:26.926911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:26.942657 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-88e6d658-c564-480b-826d-6e1e60d16cac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.218660 Sep 23 04:20:26.949861 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3164/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:26 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:27.970188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:27.970812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:27.978003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:27.978599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:27.979313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:27.980216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:27.980689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:27.981544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:28.142217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:28.151021 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-601b6752-9274-45f4-b434-4070de2cd006 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1375 microversion: 2.1 time: 0.186565 Sep 23 04:20:28.151622 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3095/6259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:27 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:29.174887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:29.175406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:29.182355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.182846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.183335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.184023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.184484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.184917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.331683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:29.341473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7af25822-da95-4b5e-95c3-8289d9a4f891 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1563 microversion: 2.1 time: 0.170936 Sep 23 04:20:29.342424 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3165/6260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:29 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:29.368096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:29.369329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:29.376860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.377404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.378010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.378784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.379346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.379816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.533860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:29.543955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f5f46a6-839e-4cf3-8278-5f11bd60ee84 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1563 microversion: 2.1 time: 0.180497 Sep 23 04:20:29.544849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3096/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:29 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:29.636371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:29.637123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:29.643837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.644414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.644924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.645720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.646247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.646762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.672862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:20:29.703184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:29.755316 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7fc9afe-1df3-4994-ab6a-a8172e4b8c7b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 204 len: 0 microversion: 2.1 time: 0.122696 Sep 23 04:20:29.756282 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3166/6262] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:20:29 2022] DELETE /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:20:29.765764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:29.767046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:29.774610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.775183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.775733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.776520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:29.777179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:29.777670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:29.913660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:29.922257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2ebe57b-b82f-4979-9ecf-597520bb1daf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1569 microversion: 2.1 time: 0.160900 Sep 23 04:20:29.922841 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3097/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:29 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:30.946829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:30.947576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:30.954437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:30.954929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:30.955369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:30.956117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:30.956584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:30.957012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:31.096326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:31.104824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ee110ce-5511-46fa-87b3-3480b724939b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1569 microversion: 2.1 time: 0.162420 Sep 23 04:20:31.105655 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3167/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:30 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:32.130155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:32.131496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:32.148860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:32.149656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:32.150298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:32.151193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:32.151819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:32.152416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:32.270827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:32.270971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae036e7-e073-4707-91be-429cf04d5770", "name": "network-vif-deleted", "tag": "d289881c-22c6-44e2-bd05-de29d3436ecf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:32.280529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7567f010-a9e0-4cec-823b-c88e0bc83082 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.155342 Sep 23 04:20:32.281443 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3168/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:32 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:32.294921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:32.295515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:32.296610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:32.311602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] Creating event network-vif-deleted:d289881c-22c6-44e2-bd05-de29d3436ecf for instance aae036e7-e073-4707-91be-429cf04d5770 on n-h1-858495-2 Sep 23 04:20:32.316827 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cda2c1fe-b693-4c09-bf5b-3028e390e5a6 req-29cd2606-0ab5-4a6e-9721-316062bec773 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208444 Sep 23 04:20:32.318003 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3098/6266] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:33.304346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:33.304990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:33.312666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:33.313227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:33.313759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:33.314527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:33.315100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:33.315601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:33.381871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:33.390010 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a35c3341-8bf7-45b2-8111-99ab4e0225dd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.089916 Sep 23 04:20:33.390664 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3169/6267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:33 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:34.207569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0df369a5-a266-4d32-947b-d25395d431f2 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Action: 'create', calling method: .version_select at 0x7f0c89c38dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2040681210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpwR50UPVMr3e8SiUNRlb5MiwOIY8TkFBpjHd7i1jXaENpQLywY1Ts9JRsUXa4JMTlsSx+I6/6TkYKYlImst2+ZbY1aAuswU0lWbb3GZuOELyy/ICEMHFw1V7dOONpLng=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:34.223647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0df369a5-a266-4d32-947b-d25395d431f2 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Getting quotas for project db3f375e53ee4f9fafbf193576b10f8a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:20:34.229796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-0df369a5-a266-4d32-947b-d25395d431f2 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Getting quotas for user a3a0a52727784716a56b7f65db60e9a9 and project db3f375e53ee4f9fafbf193576b10f8a. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:20:34.260640 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0df369a5-a266-4d32-947b-d25395d431f2 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058087 Sep 23 04:20:34.261265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3099/6268] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:20:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:34.413093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:34.413990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:34.433978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:34.434665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:34.435439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:34.436476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:34.437553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:34.438066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:34.550531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:34.560696 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5fb3e5d6-e14c-44d8-89d7-f5eb270213da tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.151609 Sep 23 04:20:34.561940 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3170/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:34 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:35.452946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-988709152", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ce2df5ad-6f7f-4f6c-99f4-f4fae13ac387", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2040681210", "security_groups": [{"name": "tempest-secgroup-smoke-1791425429"}], "networks": [{"uuid": "4927c291-d324-4f6b-9de2-3499ee618de8"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:35.583636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:35.584262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:35.591602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:35.592053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:35.592498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:35.593626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:35.594091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:35.594521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:35.601011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] validate_networks() for [('4927c291-d324-4f6b-9de2-3499ee618de8', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:20:35.700344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:35.709443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-771635c2-0165-493b-b2ef-bd9d89fa9507 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.129830 Sep 23 04:20:35.710129 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3171/6270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:35 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:36.031288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:20:36.031739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:20:36.032233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:20:36.032658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:20:36.033087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:20:36.042231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:36.042734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:36.043184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:36.043964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:36.044531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:36.044977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:36.051692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=76 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:36.064923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Getting quotas for project db3f375e53ee4f9fafbf193576b10f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:20:36.071409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Getting quotas for user a3a0a52727784716a56b7f65db60e9a9 and project db3f375e53ee4f9fafbf193576b10f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:20:36.136949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:20:36.139324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce2df5ad-6f7f-4f6c-99f4-f4fae13ac387',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:20:36.279446 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c31943c1-40ad-4ece-a0aa-65698353ed34 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831509 Sep 23 04:20:36.280746 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3100/6271] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:20:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:20:36.291752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-560d6804-0916-4787-ab01-303f3709e33a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:36.292522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-560d6804-0916-4787-ab01-303f3709e33a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:36.295653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:36.355544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-560d6804-0916-4787-ab01-303f3709e33a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:36.364100 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-560d6804-0916-4787-ab01-303f3709e33a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1098 microversion: 2.1 time: 0.076161 Sep 23 04:20:36.364721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3172/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:36 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1098 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:36.733414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:36.734821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:36.741569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:36.742087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:36.742551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:36.743278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:36.743756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:36.744298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:36.824342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:36.836588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff243eef-58a9-4551-b1a9-469a51612cda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.108106 Sep 23 04:20:36.849415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3101/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:36 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:37.391560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:37.392348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:37.407407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:37.408643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:37.409636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:37.412095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:37.412598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:37.413033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:37.523754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:37.537311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f87c706-7a42-42bd-baf6-d08365d4d554 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1204 microversion: 2.1 time: 0.151525 Sep 23 04:20:37.547636 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3173/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:37 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1204 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:37.860966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:37.862380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:37.865454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:37.873800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:37.874879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:37.875600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:37.876609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:37.877290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:37.877928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:37.961386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:37.972899 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc0b019a-77b6-4437-923d-da063b6ae66c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 200 len: 1360 microversion: 2.1 time: 0.115579 Sep 23 04:20:37.989786 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3102/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:37 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 1360 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:38.565590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:38.567205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:38.576000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:38.577217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:38.578022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:38.578981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:38.579466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:38.579953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:38.764692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:38.794361 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d7ffef20-960c-451d-bff8-a8177287e5bf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.233337 Sep 23 04:20:38.795143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3174/6276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:38 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:38.997293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:38.998314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:39.007400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:39.008025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:39.008596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:39.009959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:39.010095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:39.010669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:39.026618 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 HTTP/1.1 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'aae036e7-e073-4707-91be-429cf04d5770'} Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:39.028288 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:39.033556 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-465c509b-27b2-42fa-b383-1143ad6a2dc6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 404 len: 111 microversion: 2.1 time: 0.036775 Sep 23 04:20:39.034778 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3103/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:38 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:20:39.314063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:39.351025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:39.353288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:39.354119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:39.384321 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] Creating event network-changed:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:20:39.392921 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-73832f7b-61ce-4b7e-8b68-12f7c0a3fb0f req-25d54361-8130-498c-99a3-afd8f9116e38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085868 Sep 23 04:20:39.394260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3175/6278] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:39.821096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:39.821892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:39.829716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:39.830640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:39.831224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:39.831981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:39.832459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:39.832929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:39.999096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:40.013372 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c257609c-9930-416f-b99a-f24ed5edfc28 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.195835 Sep 23 04:20:40.016136 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3104/6279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:39 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:41.039891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:41.040565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:41.048884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:41.049587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:41.050032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:41.050761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:41.051174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:41.051602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:41.188989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:41.197884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9e12fcf4-3615-4f89-8775-a2da1d0663ee tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.162260 Sep 23 04:20:41.209970 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3176/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:41 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:42.223179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:42.224009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:42.231427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:42.232054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:42.232707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:42.233706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:42.234518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:42.235183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:42.381871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:42.391996 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a807c07-1325-42df-a87a-85135e681755 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.173093 Sep 23 04:20:42.393150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3105/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:42 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:43.415631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:43.416968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:43.425415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:43.426286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:43.426971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:43.427984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:43.428658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:43.429302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:43.580447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:43.592750 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2e8ed20-0384-4b5b-b717-3374d4b1ff3a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.180105 Sep 23 04:20:43.594448 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3177/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:43 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:44.624724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:44.625387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:44.639948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:44.640637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:44.640931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:44.641697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:44.642367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:44.643276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:44.844329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:44.853157 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e2d270ea-9dad-434c-b648-6599e151f336 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1282 microversion: 2.1 time: 0.233633 Sep 23 04:20:44.854431 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3106/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:44 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:45.881822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:45.882382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:45.895508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:45.896252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:45.896883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:45.897868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:45.898483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:45.909397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:46.071014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:46.080338 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38dde921-21cf-4cfa-9ace-6e651bca8085 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.205554 Sep 23 04:20:46.081835 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3178/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:45 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:47.103703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:47.104938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:47.107722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:47.108583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:47.116089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.116603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.117062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.117813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.118356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.118746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.259304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:47.268948 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ece066c-ddad-47f7-950f-d3a72cc478ba tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.169171 Sep 23 04:20:47.269565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3107/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:47 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:47.685215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:47.686533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:47.688709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:47.695416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.695905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.696342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.697038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.697548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.697979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.723655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:20:47.807735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c84781ac-8f55-4894-9020-9ab690f534c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 204 len: 0 microversion: 2.1 time: 0.127481 Sep 23 04:20:47.808086 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3179/6286] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:20:47 2022] DELETE /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:20:47.817990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:47.818655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:47.824639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.825168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.825645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.826881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:47.827492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:47.828089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:47.967931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:47.976543 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34fde2cb-7e30-46d6-b76d-1ea7e6a90624 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1409 microversion: 2.1 time: 0.163631 Sep 23 04:20:47.977284 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3108/6287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:47 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:48.292443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:48.293171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:48.299883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:48.300377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:48.300833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:48.301547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:48.302008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:48.302436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:48.443339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:48.451745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3bcc1bff-2551-4c0f-b46f-5f14a612b80d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.163108 Sep 23 04:20:48.452428 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3180/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:48 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:49.001676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:49.002309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:49.009131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:49.009658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:49.010106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:49.010880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:49.011416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:49.011865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:49.152357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:49.160948 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-462bce13-fd39-48a8-a749-67bd251cb60f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1409 microversion: 2.1 time: 0.163787 Sep 23 04:20:49.161596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3109/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:48 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:49.484380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:49.485106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:49.492444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:49.493060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:49.493682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:49.494607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:49.495278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:49.495771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:49.637916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:49.647049 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bca9a86b-6d52-4180-8880-fa799a575f4d tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.175588 Sep 23 04:20:49.649194 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3181/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:49 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:49.800856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd25bf1-1e75-4745-8b25-cfec83d47680", "name": "network-vif-deleted", "tag": "ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:49.819379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:49.820271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:49.820822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:49.835924 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] Creating event network-vif-deleted:ff1fb6d8-a962-4cfa-b9f2-7e49cb4b2a76 for instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 on n-h1-858495-2 Sep 23 04:20:49.851095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bfd5474e-cd3b-4a32-b72f-fdb642ed4c39 req-ede9ce04-74ae-49ab-9289-62ed141f0a6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053814 Sep 23 04:20:49.854187 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3110/6291] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:50.184151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:50.184777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:50.192189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:50.192704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:50.193152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:50.193895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:50.194546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:50.195149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:50.218843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:20:50.274958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:50.284175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfd06f92-733a-4180-b5c0-636bdd1d8f25 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1201 microversion: 2.1 time: 0.103939 Sep 23 04:20:50.285648 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3182/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:50 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:50.672923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:50.674112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:50.681105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:50.681711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:50.682363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:50.683160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:50.683704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:50.684219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:50.834777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:50.844150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ac1b8da-78d2-4d30-8eab-f54749befbd4 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.176850 Sep 23 04:20:50.844746 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3111/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:50 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:51.307733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:51.308977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:51.316129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:51.316887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:51.317545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:51.318066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:51.318514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:51.318937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:51.383410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:51.393013 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54218b67-5c9c-484d-b256-239030fb90f4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1201 microversion: 2.1 time: 0.090257 Sep 23 04:20:51.393838 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3183/6294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:51 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:51.868063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:51.868688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:51.889445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:51.890202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:51.890584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:51.891301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:51.891769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:51.892213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:52.153078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:52.163703 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f4939db6-d55d-4721-9483-d93f0df5b456 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.299585 Sep 23 04:20:52.164845 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3112/6295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:51 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:52.416929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:52.420447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:52.430746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:52.431756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:52.432439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:52.433289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:52.435479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:52.435982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:52.551397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:52.564551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e9ec054-12cb-4969-a49a-45e935f39487 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1201 microversion: 2.1 time: 0.152432 Sep 23 04:20:52.581958 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3184/6296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:52 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:53.189971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:53.190388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:53.199513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:53.200444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:53.201903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:53.202949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:53.203600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:53.204207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:53.375583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:53.384566 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-98b079d9-03ea-4a9e-b234-301d926c6453 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.200227 Sep 23 04:20:53.386197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3113/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:53 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:53.588469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:53.589152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:53.596342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:53.596830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:53.597565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:53.598300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:53.598760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:53.599220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:53.668620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:53.679914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb805445-f6f9-421a-8ab2-78cbe74f4d1f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1201 microversion: 2.1 time: 0.095585 Sep 23 04:20:53.680498 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3185/6298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:53 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:54.408422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:54.409172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:54.416659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:54.417340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:54.418096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:54.418946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:54.420016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:54.420679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:54.652269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:54.671249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-776ce5f5-4610-41b0-907f-082b608ab8cb tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.264942 Sep 23 04:20:54.689915 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3114/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:54 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:54.702628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:54.703931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:54.716237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:54.717670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:54.718321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:54.721785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:54.722770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:54.723539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:54.787371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:54.788161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:54.788981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:54.789626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lazy-loading 'fault' on Instance uuid 3bd25bf1-1e75-4745-8b25-cfec83d47680 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:20:54.836379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:54.845631 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c8ce98f-142e-4368-876a-7dd26f8393e8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 200 len: 1160 microversion: 2.1 time: 0.146764 Sep 23 04:20:54.862985 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3186/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:54 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 1160 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:55.713223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:55.713986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:55.721576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:55.721796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:55.722715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:55.723652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:55.724385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:55.725009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:55.870180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:55.871504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:55.875965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:55.879877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:55.880628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:55.881278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:55.882260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:55.882937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:55.883590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:55.892006 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f756af9-e62c-4709-8d9b-b05b58ddc164 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.187986 Sep 23 04:20:55.893321 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3115/6301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:55 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:55.907355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 HTTP/1.1 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3bd25bf1-1e75-4745-8b25-cfec83d47680'} Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:55.910416 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:55.915220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6df45f95-85ab-4a7f-9f1e-1fd912534143 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 404 len: 111 microversion: 2.1 time: 0.046274 Sep 23 04:20:55.915797 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3187/6302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:55 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:20:56.715742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "name": "network-vif-plugged", "status": "completed", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:56.730525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:56.731305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:56.732207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:56.752175 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] Creating event network-vif-plugged:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:20:56.758240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-150f161b-9084-442d-9c8a-85decf373737 req-06ba85ae-a190-4fe6-8361-35cdfc02892b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050447 Sep 23 04:20:56.760669 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3116/6303] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:56.915660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:56.916418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:56.924237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:56.924731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:56.925168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:56.925922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:56.926377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:56.926807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:57.097578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:57.106092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f00269f4-9fb8-4890-8c47-08aa71645515 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1270 microversion: 2.1 time: 0.193314 Sep 23 04:20:57.120948 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3188/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:56 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:58.067605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.068212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.076559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.077311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.077994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.078906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.079667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.080297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.103100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 HTTP/1.1 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'aae036e7-e073-4707-91be-429cf04d5770'} Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:58.110646 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3a0bf5d5-cfd6-40e4-9589-a341af6f20a0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 404 len: 111 microversion: 2.1 time: 0.048791 Sep 23 04:20:58.116608 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3117/6305] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:20:58 2022] DELETE /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:20:58.122480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.124424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: aae036e7-e073-4707-91be-429cf04d5770] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.131096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.131733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.138907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.139453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.139918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.140652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.141132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.141659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.143214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.143714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.144154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.144863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.145525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.146116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.171886 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 HTTP/1.1 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'aae036e7-e073-4707-91be-429cf04d5770'} Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.176977 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance aae036e7-e073-4707-91be-429cf04d5770 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:58.182999 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c0e34c8-c54e-458d-997f-bc76c02b2c72 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770" status: 404 len: 111 microversion: 2.1 time: 0.061475 Sep 23 04:20:58.187501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3189/6306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:58 2022] GET /compute/v2.1/servers/aae036e7-e073-4707-91be-429cf04d5770 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:20:58.338064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:58.349138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6a7f2b02-62e8-46e2-88f9-189ba8609a01 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1459 microversion: 2.1 time: 0.223356 Sep 23 04:20:58.367799 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3118/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:58 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1459 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:20:58.374293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.376145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.392192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.393147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.393795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.394692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.395346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.396066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.574238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:20:58.582535 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71246e48-0dbf-4415-a7ce-1ebe9ea39217 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1459 microversion: 2.1 time: 0.213252 Sep 23 04:20:58.583109 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3190/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:58 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1459 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:20:58.753770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.754423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.760900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.761633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.762194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.763043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.763717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.764262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.778869 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 HTTP/1.1 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3bd25bf1-1e75-4745-8b25-cfec83d47680'} Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:58.780806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.785588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:58.787446 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9586800f-449b-4417-8d01-cb98c9bd3d4b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 404 len: 111 microversion: 2.1 time: 0.037711 Sep 23 04:20:58.792016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3119/6309] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:20:58 2022] DELETE /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:20:58.802435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:58.803258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3bd25bf1-1e75-4745-8b25-cfec83d47680] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:20:58.812141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.812987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.814308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.815814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:58.816535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:58.817229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:58.835770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 HTTP/1.1 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3bd25bf1-1e75-4745-8b25-cfec83d47680'} Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:20:58.837420 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3bd25bf1-1e75-4745-8b25-cfec83d47680 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f51aba6-d3dc-4e9d-870d-2efbfb93436a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680" status: 404 len: 111 microversion: 2.1 time: 0.045973 Sep 23 04:20:58.842443 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3191/6310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:20:58 2022] GET /compute/v2.1/servers/3bd25bf1-1e75-4745-8b25-cfec83d47680 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:20:58.918740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-300a2f69-33fd-4bef-a598-2b757decfecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: .version_select at 0x7f0c89c873a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1580473554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfxaBIu4b/lCioAc/JJopTtTfYnIU4ileTjnMGgaMrPiWIVWfhpQudKI5o39uU0L3YXqETPJg6nnvCw7zF3+GLJPVXKtHoRmGqdmBDU8vuEMAHgfW7yDbwgofxPozoTng=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:20:58.934370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-300a2f69-33fd-4bef-a598-2b757decfecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:20:58.940116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-300a2f69-33fd-4bef-a598-2b757decfecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:20:58.966243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-300a2f69-33fd-4bef-a598-2b757decfecd tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051425 Sep 23 04:20:58.969753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3120/6311] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:20:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:01.042477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:01.062354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:01.063155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:01.063778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:01.081169 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] Creating event network-changed:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:21:01.087554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b06eb864-f97a-400d-a41d-d7a6da316b33 req-e7387a3e-6538-48b8-b794-bf4b78abce10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047605 Sep 23 04:21:01.088550 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3192/6312] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:03.104965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}, {"name": "network-changed", "server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:03.126921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:03.127750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:03.128128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:03.140017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Creating event network-changed:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:21:03.140840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] Creating event network-changed:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:21:03.146790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0e769dae-1f37-4111-994f-60f2f197eda7 req-11515a0d-0365-41cf-889c-f9c7205622bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046787 Sep 23 04:21:03.147973 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3121/6313] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:18.211682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-442198952", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580473554", "security_groups": [{"name": "tempest-secgroup-smoke-201508079"}], "block_device_mapping_v2": [{"uuid": "2bf28dd1-30b5-4bef-b6b2-2bfe5e36a174", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:18.238849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:18.239545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=48 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:18.345765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:21:18.796008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:21:18.796436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:21:18.796911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:21:18.797323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:21:18.799388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:21:18.809135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:18.809775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:18.810321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:18.810933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:18.811386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:18.811811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:18.832900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:21:18.839487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:21:18.922789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:21:18.926652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bf28dd1-30b5-4bef-b6b2-2bfe5e36a174',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:21:19.087477 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0ae9334-2108-41db-9d2a-23e9198633c8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.879789 Sep 23 04:21:19.088159 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3193/6314] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:21:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:21:19.103019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0c5cea52-446a-4f13-b8e4-1f6f367d7655 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:19.103745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0c5cea52-446a-4f13-b8e4-1f6f367d7655 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:19.113980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:19.114742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:19.115632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=97 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:19.178966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0c5cea52-446a-4f13-b8e4-1f6f367d7655 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:19.189794 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0c5cea52-446a-4f13-b8e4-1f6f367d7655 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1094 microversion: 2.1 time: 0.092052 Sep 23 04:21:19.190396 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3122/6315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:19 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:20.038066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:20.038584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:20.045762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:20.046191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:20.046624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:20.047312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:20.047767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:20.048200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:20.128597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lazy-loading 'services' on Instance uuid 526c951b-9162-4560-be69-28ed1f6b7b44 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:21:20.204020 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b40c9f3f-b68f-4912-9f49-d498d7329736 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "DELETE /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44/os-volume_attachments/4e47c7e0-03f0-4ce7-8328-69dcf1461640" status: 202 len: 0 microversion: 2.1 time: 0.170732 Sep 23 04:21:20.204955 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3194/6316] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:21:20 2022] DELETE /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44/os-volume_attachments/4e47c7e0-03f0-4ce7-8328-69dcf1461640 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:21:20.213757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:20.214427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:20.223861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:20.224366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:20.224821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:20.225803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:20.226278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:20.226723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:20.343932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:20.352424 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01d85aca-4340-45b7-b778-8b2aef8bed5e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1200 microversion: 2.1 time: 0.143232 Sep 23 04:21:20.353008 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3123/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:20 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1200 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:21.378438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:21.379976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:21.391164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:21.392080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:21.392742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:21.394018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:21.394738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:21.395209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:21.742455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:21.751007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-49f41f97-50ba-4f75-905e-1ed1c9db0576 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.378045 Sep 23 04:21:21.753878 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3195/6318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:21 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:22.218730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afe03b6-9c26-4986-b0d6-dff930545c73", "tag": "5f3f7815-cea6-4ffd-be95-f488bad64fdf"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:22.252965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:22.254404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:22.256086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:22.274866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] Creating event network-changed:5f3f7815-cea6-4ffd-be95-f488bad64fdf for instance 3afe03b6-9c26-4986-b0d6-dff930545c73 on n-h2-858495-2 Sep 23 04:21:22.292026 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e877a760-a316-4a59-ab2d-154f648e69e8 req-441e17e8-9728-4474-8395-a2197e0e288f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078807 Sep 23 04:21:22.295247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3124/6319] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:21:22.777393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:22.779192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:22.786538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:22.787031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:22.787463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:22.788625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:22.789020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:22.789706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:23.053578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:23.062140 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-657b93ef-18f3-448d-a63d-4785688248f7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.288675 Sep 23 04:21:23.062733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3196/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:22 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:24.088889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:24.089626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:24.097581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:24.098317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:24.098774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:24.099524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:24.100254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:24.100862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:24.266170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:24.278776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7409cea0-782b-4ba9-aa57-6d6e2095390b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.195370 Sep 23 04:21:24.279876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3125/6321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:24 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:25.212898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:25.213456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:25.220725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.221219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.222111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.222888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.223356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.223790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.251580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:21:25.302809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:25.303496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:25.311284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.311829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.313160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.313974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.314903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.315800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.331767 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb51d1c6-1a34-479a-bd0a-e1ffa67b7cdc tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "DELETE /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 204 len: 0 microversion: 2.1 time: 0.122307 Sep 23 04:21:25.335817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3197/6322] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:21:25 2022] DELETE /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:21:25.342110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:25.343068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:25.349835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.350293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.350738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.351444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:25.351903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:25.352336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:25.539330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:25.542754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:25.548112 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ed53202-ad94-4042-9920-e3da753be5b2 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.249502 Sep 23 04:21:25.548715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3126/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:25 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:21:25.556087 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9781103-f69c-4beb-9591-2228540599e8 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1470 microversion: 2.1 time: 0.214600 Sep 23 04:21:25.556087 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3198/6324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:25 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:26.571197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:26.571815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:26.575680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:26.577568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:26.578747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:26.579237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:26.579837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:26.580533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:26.581135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:26.581744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:26.584417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:26.585115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:26.585708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:26.586420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:26.587175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:26.587817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:26.810751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:26.811122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:26.822778 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3527ee4-5636-40fe-b79e-05c3ebb3d7ee tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1470 microversion: 2.1 time: 0.250795 Sep 23 04:21:26.823369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-80249ac7-b060-41c9-ba2e-fa32d590f8be tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.255918 Sep 23 04:21:26.823547 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3127/6325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:26 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:21:26.831108 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3199/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:26 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:27.678926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526c951b-9162-4560-be69-28ed1f6b7b44", "name": "network-vif-deleted", "tag": "5daf8b0f-201e-4444-853b-d2fa3a9cc7de"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:27.691577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.692102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.692555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.705171 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] Creating event network-vif-deleted:5daf8b0f-201e-4444-853b-d2fa3a9cc7de for instance 526c951b-9162-4560-be69-28ed1f6b7b44 on n-h2-858495-2 Sep 23 04:21:27.711411 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cd7c04c0-16ca-4789-915d-3ea41791b047 req-18e973cf-e8b5-4c1d-a94b-4891bc173bf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Sep 23 04:21:27.713511 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3128/6327] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:27.848406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:27.849298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:27.861956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:27.862649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:27.869161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.869717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.870167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.872404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.873161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.874140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.879754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.882096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.882911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.883824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.885192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.886998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.936885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:27.937653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:27.938421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:27.939229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lazy-loading 'fault' on Instance uuid 526c951b-9162-4560-be69-28ed1f6b7b44 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:21:28.029777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a464036a43fe4c11a020f5dd68ccc928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c21b70abc24db797787e75274aea14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:28.040324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47991893-dbe2-41d0-8f65-7e27a5304b40 tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 200 len: 1304 microversion: 2.1 time: 0.196690 Sep 23 04:21:28.046289 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3200/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:27 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:28.104612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:28.120168 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-161c6cf3-2b7b-4ac0-b1ed-3e82958a1b0f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.266386 Sep 23 04:21:28.120914 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3129/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:27 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:29.066069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:29.066779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] [instance: 526c951b-9162-4560-be69-28ed1f6b7b44] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:29.068659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:29.069513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:29.077086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:29.077607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:29.078047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:29.078750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:29.079209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:29.079640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:29.093951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] HTTP exception thrown: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Request method failure captured: Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 HTTP/1.1 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTPjcB8K8CKU-qbLl70aa_vhSjIR296fe1tzGaEWOZJW7SDUULdh2-hsePlTE4CPXd2pk6QqkZMY_turClPWl0Ca8mZt_5nMGxandt9j1jQbAuYOyR4iPKywGcXOgteucNOoN6GPV7OGSi2Z_6Zr41Rl_kczmeBr_8fc3Uzmv9WfvG4 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: b3c21b70abc24db797787e75274aea14 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-VolumesBackupsTest-1758760273 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3c21b70abc24db797787e75274aea14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3c21b70abc24db797787e75274aea14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3c21b70abc24db797787e75274aea14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3c21b70abc24db797787e75274aea14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-VolumesBackupsTest-1758760273 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: b3c21b70abc24db797787e75274aea14 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-VolumesBackupsTest-1758760273 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-VolumesBackupsTest-1758760273-project Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a464036a43fe4c11a020f5dd68ccc928 Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-VolumesBackupsTest-1758760273-project Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '526c951b-9162-4560-be69-28ed1f6b7b44'} Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:21:29.095620 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] Returning 404 to user: Instance 526c951b-9162-4560-be69-28ed1f6b7b44 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a38d6597-b635-4ff6-9a85-67bd85ed9abd tempest-VolumesBackupsTest-1758760273 tempest-VolumesBackupsTest-1758760273-project] 10.222.0.25 "GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44" status: 404 len: 111 microversion: 2.1 time: 0.035143 Sep 23 04:21:29.101199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3201/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:29 2022] GET /compute/v2.1/servers/526c951b-9162-4560-be69-28ed1f6b7b44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:21:29.144773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:29.145595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:29.153195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:29.153750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:29.154215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:29.154946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:29.155560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:29.156223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:29.190102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:29.319465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:29.329301 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-26afe27a-3d7f-4f66-8978-e52b02eb5169 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1277 microversion: 2.1 time: 0.188366 Sep 23 04:21:29.330124 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3130/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:29 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:30.355594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:30.356793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:30.363442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:30.363934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:30.364376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:30.365072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:30.365560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:30.365992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:30.514160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:30.522010 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7680b0a0-afb5-4813-b89e-122eadd07393 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.170354 Sep 23 04:21:30.522592 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3202/6332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:30 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:31.546060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:31.546621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:31.553710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:31.554219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:31.554689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:31.555407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:31.555882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:31.556331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:31.687778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:31.695624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf121acc-73da-4366-880b-7adcca4c347a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.154243 Sep 23 04:21:31.696211 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3131/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:31 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:32.719277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:32.719895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:32.727407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:32.727894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:32.728390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:32.729094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:32.729631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:32.730059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:32.903227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:32.913719 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e42a3d48-92e0-4235-a90d-3143feee022b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.198066 Sep 23 04:21:32.914547 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3203/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:32 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:33.936812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:33.937468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:33.948265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:33.948803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:33.949268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:33.950337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:33.950843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:33.951359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:34.095118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:34.103557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a9d0c61d-5c97-4d0f-81ca-9bd9cb7c14e3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.171321 Sep 23 04:21:34.104151 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3132/6335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:33 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:35.127678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:35.128280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:35.135417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:35.135908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:35.136349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:35.137658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:35.138112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:35.138534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:35.273828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:35.281873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50c6260f-7480-44dc-a2d1-01a3db954a2c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.158135 Sep 23 04:21:35.282460 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3204/6336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:35 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:36.304760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:36.305310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:36.312432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:36.312938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:36.313556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:36.314358 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:36.314834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:36.315273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:36.459066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:36.468815 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9f0d2644-65ae-40b2-a2a9-c75f9790b852 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.168158 Sep 23 04:21:36.481704 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3133/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:36 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:37.492683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:37.493415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:37.500797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:37.501396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:37.501921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:37.502686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:37.503342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:37.503702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:37.649933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:37.658170 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c19d1f6-b9a7-41e8-8a54-b219ae005753 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.169306 Sep 23 04:21:37.658687 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3205/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:37 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:38.680827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:38.681817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:38.690122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:38.690635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:38.691103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:38.691826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:38.692305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:38.692753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:38.832405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:38.833660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:38.841943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:38.842688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:38.843386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:38.844351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:38.845008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:38.845478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:38.873535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:21:38.912942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:38.923306 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f9571f91-df41-4583-8aa6-d2b62b17d466 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.246310 Sep 23 04:21:38.923909 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3134/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:38 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:38.928879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:38.940178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:38.940924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:38.941079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:38.941958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:38.956246 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] Creating event network-changed:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:21:38.964101 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-291ac4ac-b9a1-47e9-9c43-2b3907e85e9b req-0319174e-1e33-4226-8e89-c9afb69a3ee4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038564 Sep 23 04:21:38.965271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3135/6340] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:38.991496 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-12ac7043-c568-4011-af46-deb975d4752a tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 204 len: 0 microversion: 2.1 time: 0.162381 Sep 23 04:21:38.993041 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3206/6341] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:21:38 2022] DELETE /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:21:39.008176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:39.008921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:39.026036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:39.026547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:39.027006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:39.028523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:39.029795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:39.030998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:39.200330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:39.217738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d8ef11b4-a1fa-4108-89c6-6f19245f90f6 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1584 microversion: 2.1 time: 0.220008 Sep 23 04:21:39.233382 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3136/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:38 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1584 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:39.951929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:39.952576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:39.960967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:39.962103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:39.962552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:39.963278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:39.963741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:39.964175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:40.149076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:40.157659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c0c8420-f837-498a-99fe-5798b5f27d58 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.210369 Sep 23 04:21:40.158818 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3207/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:39 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:40.245045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:40.245045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:40.256204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:40.256733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:40.257207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:40.258010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:40.258497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:40.259006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:40.328666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afe03b6-9c26-4986-b0d6-dff930545c73", "name": "network-vif-plugged", "status": "completed", "tag": "5f3f7815-cea6-4ffd-be95-f488bad64fdf"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:40.343404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:40.344816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:40.345131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:40.362311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] Creating event network-vif-plugged:5f3f7815-cea6-4ffd-be95-f488bad64fdf for instance 3afe03b6-9c26-4986-b0d6-dff930545c73 on n-h2-858495-2 Sep 23 04:21:40.367247 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-118f1d51-b74c-4f7b-862e-8e4bcda92bab req-e9a52f02-7add-4ea4-8254-625e4fd689bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042382 Sep 23 04:21:40.368118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3208/6344] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:40.427605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:40.436361 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ef63528-cef5-4d4d-a9e4-df1cdddc5856 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1584 microversion: 2.1 time: 0.196694 Sep 23 04:21:40.447212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3137/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:40 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1584 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:41.109412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf570978-3b30-428d-a602-0fb791293da5", "name": "network-vif-deleted", "tag": "9c9c200f-e1d2-49a5-97d4-ecbc59436031"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:41.124297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:41.128580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:41.130109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:41.146610 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] Creating event network-vif-deleted:9c9c200f-e1d2-49a5-97d4-ecbc59436031 for instance bf570978-3b30-428d-a602-0fb791293da5 on n-h1-858495-2 Sep 23 04:21:41.158235 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-216cf9ac-f72d-41e1-a3d3-df510468b27d req-980a42ce-0abf-400c-bd6c-6f0d3f0e677a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052369 Sep 23 04:21:41.159533 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3209/6346] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:41.182071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:41.183863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:41.193472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:41.193472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:41.193472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:41.197399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:41.197399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:41.197399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:41.362930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:41.372110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3e3f4d4-d2dd-4820-a5ef-f66f9daf1c83 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1265 microversion: 2.1 time: 0.194121 Sep 23 04:21:41.381435 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3138/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:41 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:21:41.475949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:41.476884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:41.488858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:41.489548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:41.490098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:41.490923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:41.491638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:41.492181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:41.567759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:41.576394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1333bc3-ac4f-4c5f-8e52-66a1ce03ed98 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1229 microversion: 2.1 time: 0.109282 Sep 23 04:21:41.577416 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3210/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:41 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:42.396171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:42.396953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:42.406444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.407437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.408466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.409824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.410768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.411524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.568707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:42.578284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e084a4d-8392-4634-a634-1b9e7983c7c9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1452 microversion: 2.1 time: 0.186337 Sep 23 04:21:42.579270 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3139/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:42 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:42.600626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:42.601230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:42.611792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:42.612445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:42.615705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.616405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.616846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.617583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.618205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.618801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.629190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.629751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.630342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.631074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:42.631570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:42.632004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:42.694328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:42.702855 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea6e24f9-6424-4be2-9371-7e1cb434f4d0 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1229 microversion: 2.1 time: 0.106231 Sep 23 04:21:42.703441 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3211/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:42 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:43.094353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:43.103223 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b5f56a8-93eb-4d59-a282-b287b45133fb tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1452 microversion: 2.1 time: 0.497002 Sep 23 04:21:43.103904 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3140/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:42 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1452 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:43.727281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:43.728443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:43.738547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:43.739242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:43.739900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:43.742658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:43.745714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:43.745714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:43.826802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:43.837673 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e85e0a57-4bca-4e1d-a8d3-5e7978aa34cf tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1229 microversion: 2.1 time: 0.115140 Sep 23 04:21:43.839235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3212/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:43 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:44.864104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:44.864741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:44.880786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:44.882049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:44.882768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:44.883720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:44.884379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:44.885009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:44.911646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:44.961634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:44.971001 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b65e0de0-a34c-495f-9b7e-a0082ee5e954 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1229 microversion: 2.1 time: 0.112209 Sep 23 04:21:44.972750 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3141/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:44 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:45.409160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afe03b6-9c26-4986-b0d6-dff930545c73", "tag": "5f3f7815-cea6-4ffd-be95-f488bad64fdf"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:45.426839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:45.427381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:45.427818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:45.440524 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] Creating event network-changed:5f3f7815-cea6-4ffd-be95-f488bad64fdf for instance 3afe03b6-9c26-4986-b0d6-dff930545c73 on n-h2-858495-2 Sep 23 04:21:45.446136 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-105f259a-fff5-4d80-8fec-82f6b53d9d06 req-9f123481-7336-4327-8dbe-422572180674 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042965 Sep 23 04:21:45.450042 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3213/6354] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:45.995373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:45.996652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:46.006111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:46.006876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:46.007524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:46.008644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:46.009282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:46.010798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:46.047899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:46.048764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:46.049466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:46.050168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lazy-loading 'fault' on Instance uuid bf570978-3b30-428d-a602-0fb791293da5 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:21:46.131218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a0a52727784716a56b7f65db60e9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3f375e53ee4f9fafbf193576b10f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:21:46.141937 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6f2ee21-735f-4eb7-9c12-69fa802e293f tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 200 len: 1234 microversion: 2.1 time: 0.149987 Sep 23 04:21:46.143195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3142/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:45 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 1234 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:47.167193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:47.168484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] [instance: bf570978-3b30-428d-a602-0fb791293da5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:21:47.175734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:47.176218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:47.176660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:47.177489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:21:47.177836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:21:47.178263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:21:47.191545 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] HTTP exception thrown: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Request method failure captured: Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 HTTP/1.1 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTN1x_K_E4uAtI4gjOqWtRZYt59Z-ckhS30EM7oHFD6lefQDccy4dLgNBYCiD_Fe8HuX1IsqN2mnD-qV88iXg-hPLQkL7SiO2TPLpmqn5FNCesP7fkCzfAdzckvoQBO3_kXLdtnpIwzpzD1HijD_ewwaqT0sdPmi1e9DAO8XEjnujCo Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: db3f375e53ee4f9fafbf193576b10f8a Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBackupRestore-1996108614 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db3f375e53ee4f9fafbf193576b10f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db3f375e53ee4f9fafbf193576b10f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db3f375e53ee4f9fafbf193576b10f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db3f375e53ee4f9fafbf193576b10f8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBackupRestore-1996108614 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: db3f375e53ee4f9fafbf193576b10f8a Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1996108614 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBackupRestore-1996108614-project Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: a3a0a52727784716a56b7f65db60e9a9 Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBackupRestore-1996108614-project Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'bf570978-3b30-428d-a602-0fb791293da5'} Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:21:47.193187 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Returning 404 to user: Instance bf570978-3b30-428d-a602-0fb791293da5 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79a47011-38ee-4ba8-85a9-719be15cb39b tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5" status: 404 len: 111 microversion: 2.1 time: 0.031927 Sep 23 04:21:47.197981 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3214/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:21:47 2022] GET /compute/v2.1/servers/bf570978-3b30-428d-a602-0fb791293da5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:21:47.379054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08dd3e0a-27d0-41ce-a452-dafb2acd2523 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] Calling method '.version_select at 0x7f0c89b8aaf0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:47.416345 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08dd3e0a-27d0-41ce-a452-dafb2acd2523 tempest-TestVolumeBackupRestore-1996108614 tempest-TestVolumeBackupRestore-1996108614-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2040681210" status: 202 len: 0 microversion: 2.1 time: 0.043828 Sep 23 04:21:47.416981 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3143/6357] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 23 04:21:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2040681210 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:23:43.164762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:23:43.165578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:23:43.166725 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:23:43.166931 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 (ip 10.222.0.25) !!! Sep 23 04:23:43.168011 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:23:43.168366 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 (ip 10.222.0.25) !!! Sep 23 04:23:43.174999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:43.175507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:43.186144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:43.186629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:43.187070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:43.187771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:43.188228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:43.188657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:43.216593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:23:43.295965 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-676cdad2-ef68-44eb-97e5-2ce96e9211ac tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 204 len: 0 microversion: 2.1 time: 0.133159 Sep 23 04:23:43.296748 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3215/6358] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:23:43 2022] DELETE /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:23:43.305540 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 04:23:43.306377 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:23:43.306971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:23:43.307727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:23:43.310053 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:23:43.310187 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 (ip 10.222.0.25) !!! Sep 23 04:23:43.322993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:43.323624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:43.332025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:43.334256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:43.334718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:43.335440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:43.335914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:43.336360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:43.704459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:43.712312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-807d3a10-4700-4171-94a9-968e0f4a34f8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1577 microversion: 2.1 time: 0.410779 Sep 23 04:23:43.725756 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3144/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:43 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1577 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:23:44.737717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:44.738416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:44.745789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:44.746326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:44.746752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:44.747642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:44.748740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:44.749330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:44.961420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:44.970625 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8608a47b-016a-4854-8d2b-0f53cd428f7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1577 microversion: 2.1 time: 0.237365 Sep 23 04:23:44.971255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3216/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:44 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:45.994451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:45.995105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:46.006319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:46.006921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:46.007306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:46.008054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:46.008535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:46.008989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:46.034989 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48158. Sep 23 04:23:46.039523 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48156. Sep 23 04:23:46.234262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:46.242398 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c06e8bb-3f40-400b-a1c0-cedc3c9a1bf1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1577 microversion: 2.1 time: 0.252036 Sep 23 04:23:46.243001 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3145/6361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:45 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:46.815609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afe03b6-9c26-4986-b0d6-dff930545c73", "name": "network-vif-deleted", "tag": "5f3f7815-cea6-4ffd-be95-f488bad64fdf"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:46.840370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:46.845499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:46.846163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:46.881681 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] Creating event network-vif-deleted:5f3f7815-cea6-4ffd-be95-f488bad64fdf for instance 3afe03b6-9c26-4986-b0d6-dff930545c73 on n-h2-858495-2 Sep 23 04:23:46.887749 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8660a24b-f4ba-4cfb-901a-d127f2bac23c req-9eae5fbc-da9e-413f-939d-1e280daefbc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188540 Sep 23 04:23:46.889594 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3217/6362] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:47.267954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:47.277889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:47.286020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:47.286544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:47.287006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:47.287737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:47.288216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:47.288862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:47.359304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:47.368609 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bf646769-1e93-48d3-8112-595449221961 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1225 microversion: 2.1 time: 0.105899 Sep 23 04:23:47.371450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3146/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:47 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:48.395155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:48.395927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:48.416557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:48.417282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:48.418389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:48.419195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:48.419795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:48.420352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:48.496892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:48.507839 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-adde93d2-01bb-4952-b1e3-833d55df2de8 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1225 microversion: 2.1 time: 0.116769 Sep 23 04:23:48.508698 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3218/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:48 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:49.532019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:49.532622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:49.540828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:49.541383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:49.541911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:49.543365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:49.543959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:49.544777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:49.618689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:49.628562 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-54cec466-3079-423b-a0bc-c5d0d3015ebe tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1225 microversion: 2.1 time: 0.100435 Sep 23 04:23:49.644309 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3147/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:49 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:50.652400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:50.652986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:50.665326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:50.665623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:50.666003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:50.666735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:50.667187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:50.667866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:50.736950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:50.745032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f234fff3-9f57-459a-ba62-55f322ff90b1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 200 len: 1225 microversion: 2.1 time: 0.097070 Sep 23 04:23:50.745676 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3219/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:50 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:51.768523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:51.769159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:51.776167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:51.776669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:51.777704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:51.778412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:51.778886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:51.779338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:51.792832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 HTTP/1.1 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3afe03b6-9c26-4986-b0d6-dff930545c73'} Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:23:51.794553 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-72052f93-e739-40b4-858b-02474f2207b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 404 len: 111 microversion: 2.1 time: 0.031453 Sep 23 04:23:51.799612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3148/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:51 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:23:51.895211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-285357273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580473554", "security_groups": [{"name": "tempest-secgroup-smoke-201508079"}], "block_device_mapping_v2": [{"uuid": "2bf28dd1-30b5-4bef-b6b2-2bfe5e36a174", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:52.018398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:23:52.458742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:23:52.459190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:23:52.459867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:23:52.460851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:23:52.461312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:23:52.470930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:52.471426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:52.471866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:52.472595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:52.473130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:52.473495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:52.491722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:23:52.498287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:23:52.558224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:23:52.560451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bf28dd1-30b5-4bef-b6b2-2bfe5e36a174',volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:23:52.700793 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17215687-1891-4eca-af2c-80e9ec2aa11a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809577 Sep 23 04:23:52.701485 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3220/6368] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:23:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:23:52.713267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-96f31c76-a7d7-4412-93c5-2d2faa1035b6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:52.714749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-96f31c76-a7d7-4412-93c5-2d2faa1035b6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:52.774454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-96f31c76-a7d7-4412-93c5-2d2faa1035b6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:52.785570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-96f31c76-a7d7-4412-93c5-2d2faa1035b6 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1094 microversion: 2.1 time: 0.076377 Sep 23 04:23:52.801108 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3149/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:52 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:53.810512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:53.811244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:53.820028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:53.820840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:53.821453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:53.822371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:53.823027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:53.823581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:53.904922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:53.914568 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ec359ab-d03e-49e8-affd-206fbacda524 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1210 microversion: 2.1 time: 0.110312 Sep 23 04:23:53.916242 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3221/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:53 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:54.945451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:54.946208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:54.955452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:54.956555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:54.975636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:54.976951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:54.977643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:54.978099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:55.140322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:55.151394 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-22001bef-cee8-4da2-b103-03fa9e7807c0 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1277 microversion: 2.1 time: 0.209837 Sep 23 04:23:55.153662 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3150/6371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:54 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:55.409067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a84db8-4efb-461f-8363-89b99a95bfa0", "tag": "77092c93-4bc8-4681-8ad0-089415f4e36f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:55.438871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:55.439518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:55.444554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:55.475449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] Creating event network-changed:77092c93-4bc8-4681-8ad0-089415f4e36f for instance a0a84db8-4efb-461f-8363-89b99a95bfa0 on n-h1-858495-2 Sep 23 04:23:55.489413 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-49a9361e-c602-4a10-9904-c073d137fe8a req-1f6df73c-718f-4cbf-948a-45cf68cf5fab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079481 Sep 23 04:23:55.491597 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3222/6372] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:56.177782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:56.179170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:56.187976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:56.188780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:56.189617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:56.190633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:56.191098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:56.191856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:56.391375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:56.400107 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f8c06190-b84a-4b19-a2d6-9449a23d2460 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1277 microversion: 2.1 time: 0.227770 Sep 23 04:23:56.416825 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3151/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:56 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:57.424618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:57.425413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:57.432689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:57.433184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:57.433670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:57.434370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:57.434828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:57.435259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:57.591577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:57.599646 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-299a90d2-9a80-44be-8ff9-927333e65bef tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1277 microversion: 2.1 time: 0.179269 Sep 23 04:23:57.600439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3223/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:57 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:58.623709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:58.624516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:58.631510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:58.632018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:58.632477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:58.633209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:58.633790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:58.634273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:58.798680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:58.807226 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d385fbc4-2461-4ffb-a65d-20bb3cf5fd7f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1277 microversion: 2.1 time: 0.188427 Sep 23 04:23:58.808390 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3152/6375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:58 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:23:59.830956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:59.831563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:23:59.838551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:59.839843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:59.840284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:59.840975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:23:59.841456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:23:59.842037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:23:59.980023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:23:59.987835 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f62a863d-7e87-4a4a-9fa1-ab80ef59b3e4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.160833 Sep 23 04:23:59.988408 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3224/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:23:59 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:01.010947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:01.011722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:01.019448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:01.019964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:01.020431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:01.021170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:01.021676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:01.022126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:01.158608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:01.168834 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8eff798a-5aa7-4a33-91c7-c11d0069f33e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.162000 Sep 23 04:24:01.169598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3153/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:01 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:02.191941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:02.192565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:02.199288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:02.199911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:02.200486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:02.201190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:02.201676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:02.202105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:02.359986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:02.367853 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97c4fb00-ee45-40bb-90e3-3381c0a49443 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.180438 Sep 23 04:24:02.368456 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3225/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:02 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:03.391416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.392052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:03.394855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:03.400372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:03.400877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:03.401436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:03.402092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:03.402567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:03.403014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:03.538841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:03.547363 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a7e0d69-8f68-418b-a1be-a932676f63a1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.159748 Sep 23 04:24:03.547955 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3154/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:04.571100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:04.571719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:04.574367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:04.575156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:04.582140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:04.582637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:04.583082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:04.583788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:04.584249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:04.584681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:04.729820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:04.738112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0b39334a-513f-4867-8bce-bce92374b34c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.171020 Sep 23 04:24:04.738696 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3226/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:04 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:05.762617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:05.763248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:05.770238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:05.770740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:05.771210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:05.771945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:05.772428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:05.772876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:05.909071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:05.917137 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf6611d4-c6cb-4739-b8f4-340697e2025c tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.159096 Sep 23 04:24:05.917765 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3155/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:05 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:06.939617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:06.940239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:06.948843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:06.949323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:06.949787 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:06.950486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:06.950947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:06.951379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:07.085760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:07.093974 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65f212f9-cca0-4268-b060-ab203ea85be7 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.157862 Sep 23 04:24:07.094554 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3227/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:06 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:08.116474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:08.117411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:08.124909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:08.125771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:08.126326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:08.127371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:08.128133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:08.129088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:08.271546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:08.280073 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ce7e34e-787a-45e0-ad5e-3a50279e0dda tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.167627 Sep 23 04:24:08.280663 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3156/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:08 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:09.302541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:09.303233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:09.310459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:09.310952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:09.311391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:09.312100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:09.312749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:09.313176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:09.461688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:09.472274 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-492b7a66-dc29-479e-89e2-8f90cc414e7d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.173443 Sep 23 04:24:09.473538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3228/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:09 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:09.756684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a84db8-4efb-461f-8363-89b99a95bfa0", "name": "network-vif-plugged", "status": "completed", "tag": "77092c93-4bc8-4681-8ad0-089415f4e36f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:24:09.774071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:09.776742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:09.776742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:09.788534 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] Creating event network-vif-plugged:77092c93-4bc8-4681-8ad0-089415f4e36f for instance a0a84db8-4efb-461f-8363-89b99a95bfa0 on n-h1-858495-2 Sep 23 04:24:09.795618 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-76bbd8d7-4162-4808-ad9f-4ce45cddcb4b req-9bb6e76d-33a3-4bb7-a9c1-21550f72cf9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043367 Sep 23 04:24:09.796405 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3157/6385] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:24:10.497190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:10.497881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:10.505014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:10.505544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:10.505993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:10.506695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:10.507168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:10.507602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:10.644319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:10.652120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f971f6a6-7a95-43ff-ae26-d7288554424a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1265 microversion: 2.1 time: 0.158880 Sep 23 04:24:10.652701 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3229/6386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:10 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:11.675140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:11.675858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:11.683155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:11.683659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:11.684110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:11.684819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:11.685287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:11.685753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:11.818745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:11.827159 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ecc0832b-cadc-40f1-963d-bc4af1eaa8d1 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1452 microversion: 2.1 time: 0.156215 Sep 23 04:24:11.827739 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3158/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:11 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:11.849637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:11.850254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:24:11.858835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:11.859328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:11.859788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:11.860606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:11.861162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:11.861624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:12.005551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:24:12.014435 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f55b96f-404d-4c99-bccc-5b33b80e959d tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1452 microversion: 2.1 time: 0.168562 Sep 23 04:24:12.015232 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3230/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:24:11 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:13.690622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a84db8-4efb-461f-8363-89b99a95bfa0", "tag": "77092c93-4bc8-4681-8ad0-089415f4e36f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:24:13.697735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=33 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:13.702461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:24:13.702959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:24:13.703401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:24:13.708862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=77 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:13.717613 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] Creating event network-changed:77092c93-4bc8-4681-8ad0-089415f4e36f for instance a0a84db8-4efb-461f-8363-89b99a95bfa0 on n-h1-858495-2 Sep 23 04:24:13.723780 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f4e3043e-0053-4097-a948-e01f3d2dae1d req-e0fdf265-785c-49c6-8b90-2aceebca3248 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 Sep 23 04:24:13.724494 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3159/6389] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:25:40.066325 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 04:25:40.067167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:40.067930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:40.234941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c0c04e7b-9471-4c58-9cc8-97e84a716d78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: .version_select at 0x7f0c89e75b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-254796195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcz0yZFbmBqSsmuFLiy14Upfksgs+05S2NctkrVOWhIGypF0R/raDnpm54EhyQfoFlXiD/0wuGLKqkPPCtMaUN+y7vnHuRbseSZ/o1JQA261VdGHRxoN4/ZE1OeN6Zc+A=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:25:40.250740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c0c04e7b-9471-4c58-9cc8-97e84a716d78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:25:40.255790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-c0c04e7b-9471-4c58-9cc8-97e84a716d78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:25:40.282883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c0c04e7b-9471-4c58-9cc8-97e84a716d78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.218533 Sep 23 04:25:40.283494 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3231/6390] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:25:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:25:46.210981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:46.212625 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:25:46.212766 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 23 04:25:46.218289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1110001782", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "73b1a849-fd50-4899-aa79-c69cb451c557"}], "key_name": "tempest-TestNetworkAdvancedServerOps-254796195", "security_groups": [{"name": "tempest-secgroup-smoke-41319066"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:25:46.336187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] validate_networks() for [('73b1a849-fd50-4899-aa79-c69cb451c557', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:25:46.873966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:25:46.874402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:25:46.874891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:25:46.875994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:25:46.876475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:25:46.886531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:46.887266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:46.887793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:46.888791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:46.889334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:46.889873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:46.909515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:25:46.915705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:25:46.933971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:25:46.936529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:25:46.989182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88713d44-fe9a-4736-bc2e-0485160235c1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.781276 Sep 23 04:25:46.990490 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3160/6391] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:25:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:25:47.002877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d57df6f-9d13-4052-8df2-492be181325d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:47.003496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d57df6f-9d13-4052-8df2-492be181325d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:47.050803 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49774. Sep 23 04:25:47.090628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d57df6f-9d13-4052-8df2-492be181325d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:47.098002 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d57df6f-9d13-4052-8df2-492be181325d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1266 microversion: 2.1 time: 0.100299 Sep 23 04:25:47.098896 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3232/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:46 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:25:48.124027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:48.124849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:48.132215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:48.132708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:48.133411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:48.134136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:48.134830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:48.135339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:48.203614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:48.213521 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88e93855-14a2-443e-b992-801738446a3c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1318 microversion: 2.1 time: 0.095053 Sep 23 04:25:48.214150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3161/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:48 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:49.238226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:49.239125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:49.248133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:49.248631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:49.249069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:49.249814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:49.250265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:49.250687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:49.485525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:49.494611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ea7376b-0ee5-4685-8253-38d791698793 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.260295 Sep 23 04:25:49.495826 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3233/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:49 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:50.023943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:25:50.035760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:50.036259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:50.036711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:50.048115 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] Creating event network-changed:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h2-858495-2 Sep 23 04:25:50.053133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1b0b7d57-d68d-4e41-af3b-30ba3794b228 req-519bda1f-81c9-4562-9ee4-37699ac8679f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034446 Sep 23 04:25:50.053767 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3162/6395] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:25:50.519169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:50.519796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:50.527188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:50.527675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:50.528112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:50.528814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:50.529265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:50.529727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:50.742985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:50.750791 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-57d5ffb6-f4c9-48ad-86fc-d0e183c827ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.235691 Sep 23 04:25:50.751370 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3234/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:50 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:51.775492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:51.776133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:51.782398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:51.782899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:51.783356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:51.784059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:51.784533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:51.784980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:51.916766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:51.924419 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d4023f0-5b1a-4ffe-bb1a-d4aa1340cec5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.154138 Sep 23 04:25:51.925006 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3163/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:51 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:52.947272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:52.947883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:52.965411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:52.967458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:52.967995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:52.972418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:52.972902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:52.974310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:53.220871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:53.229300 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad2b423f-6c75-411c-917c-5467a35ec035 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.285833 Sep 23 04:25:53.230048 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3235/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:52 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:54.254649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:54.255396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:54.273076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:54.274018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:54.274739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:54.275737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:54.276444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:54.277139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:54.418800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:54.427100 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-37986d6b-f6e2-4817-b650-bdfe9e984648 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.178341 Sep 23 04:25:54.427892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3164/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:54 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:55.450723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:55.451338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:55.458514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:55.459652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:55.460135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:55.461063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:55.461547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:55.462168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:55.589184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "name": "network-vif-plugged", "status": "completed", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:25:55.600601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:55.601204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:55.601807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:55.613493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] Creating event network-vif-plugged:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h2-858495-2 Sep 23 04:25:55.619659 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e3e75e54-053e-4deb-a5aa-7da3180b9b06 req-a1d9fb32-68e6-4dc0-8d32-13713f782461 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117601 Sep 23 04:25:55.620473 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3165/6400] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:25:55.630060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:55.638589 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3a0d44bc-424e-4283-9eab-a42b19ee6c56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.191898 Sep 23 04:25:55.639168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3236/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:55 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:25:56.664335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:56.665055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:56.671426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:56.671934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:56.672394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:56.673153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:56.673625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:56.674064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:56.815304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:56.823117 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-636ab031-6fd9-438a-9a3b-f2fa155761ff tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1390 microversion: 2.1 time: 0.164612 Sep 23 04:25:56.823694 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3166/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:56 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:57.846301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:57.846893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:57.850163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:57.855833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:57.856317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:57.856754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:57.857548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:57.858010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:57.858449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:58.009040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:58.017776 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a053e9bb-79cd-4859-9e32-dd2f606ddf33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1563 microversion: 2.1 time: 0.175244 Sep 23 04:25:58.033668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3237/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:57 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:25:58.041641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:25:58.042298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:25:58.044288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:58.045028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:25:58.052243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:58.053331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:58.053816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:58.054540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:25:58.055021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:25:58.055468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:25:58.192485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:25:58.200615 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-59325f9a-a2aa-4f7e-8415-c6344ec6e67d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1563 microversion: 2.1 time: 0.162983 Sep 23 04:25:58.201150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3167/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:25:58 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:00.290039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:00.291583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:00.295079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:00.302167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:00.303587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:00.304214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:00.307867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:00.308373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:00.308834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:00.309533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:00.310169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:00.310804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:00.321213 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] Creating event network-changed:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h2-858495-2 Sep 23 04:26:00.328176 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-02ac3e8d-0660-47d9-a949-4b61dbd85ab9 req-94cc2dab-d31c-49c9-b303-5c2cb5cd206d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038747 Sep 23 04:26:00.334340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3168/6405] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:26:00.610582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:00.629508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c4d6ebb-b0ac-4716-9cfe-ab9623c23376 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1563 microversion: 2.1 time: 0.343953 Sep 23 04:26:00.639242 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3238/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:00 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1563 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:04.156092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1018789044", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580473554", "security_groups": [{"name": "tempest-secgroup-smoke-201508079"}], "block_device_mapping_v2": [{"uuid": "7be175d2-bcb3-4d84-9693-d1ef96d9c006", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72e042fd-3bd5-4632-a8f8-ba34c2d78dcd"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:04.270811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] validate_networks() for [('72e042fd-3bd5-4632-a8f8-ba34c2d78dcd', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:26:04.637251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:26:04.637750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:26:04.638249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:26:04.638706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:26:04.639141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:26:04.648599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:04.649099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:04.649601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:04.650351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:04.650821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:04.651266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:04.668471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:26:04.673745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Getting quotas for user f91f6388ec684133bbcae3db83293f8b and project 24437bb66a4a4b2b9534037a59000a29. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:26:04.731774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:26:04.734105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7be175d2-bcb3-4d84-9693-d1ef96d9c006',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:26:04.863319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2220d898-237e-480f-a088-78ea4225015a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712360 Sep 23 04:26:04.864062 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3169/6407] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:26:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:26:04.875093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4f1e6a2b-7990-4975-9f82-0b9c17874aff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:04.875706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4f1e6a2b-7990-4975-9f82-0b9c17874aff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:04.928491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4f1e6a2b-7990-4975-9f82-0b9c17874aff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:04.935398 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4f1e6a2b-7990-4975-9f82-0b9c17874aff tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1095 microversion: 2.1 time: 0.064232 Sep 23 04:26:04.935977 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3239/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:04 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:05.960037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c5f8d56-0427-4458-8ab0-76b6e733c9cf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:05.960676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c5f8d56-0427-4458-8ab0-76b6e733c9cf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:06.021779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c5f8d56-0427-4458-8ab0-76b6e733c9cf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:06.028968 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c5f8d56-0427-4458-8ab0-76b6e733c9cf tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1095 microversion: 2.1 time: 0.074446 Sep 23 04:26:06.029574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3170/6409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:05 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:07.051829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a396a86d-0e53-4dc4-b554-9db62e386d43 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:07.053038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a396a86d-0e53-4dc4-b554-9db62e386d43 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:07.111233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a396a86d-0e53-4dc4-b554-9db62e386d43 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:07.118790 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a396a86d-0e53-4dc4-b554-9db62e386d43 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1095 microversion: 2.1 time: 0.070801 Sep 23 04:26:07.119847 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3240/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:07 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:26:08.142514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42ffd144-f94a-463b-9a87-259987e1007a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:08.143805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42ffd144-f94a-463b-9a87-259987e1007a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:08.200112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42ffd144-f94a-463b-9a87-259987e1007a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:08.209878 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42ffd144-f94a-463b-9a87-259987e1007a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1095 microversion: 2.1 time: 0.071203 Sep 23 04:26:08.211061 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3171/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:08 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:09.234152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:09.234768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:09.242133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:09.242623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:09.243069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:09.243771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:09.244232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:09.244668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:09.307544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:09.315666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc4257f7-5723-44aa-b28f-ef67ff147c96 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1145 microversion: 2.1 time: 0.085474 Sep 23 04:26:09.316470 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3241/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:09 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:10.343132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:10.343923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:10.353315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:10.353852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:10.354301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:10.355016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:10.355765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:10.356596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:10.431781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:10.439956 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c65d0b9d-3ac7-4822-9d12-b61fe768af10 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1211 microversion: 2.1 time: 0.103788 Sep 23 04:26:10.440550 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3172/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:10 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:11.555936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:11.556620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:11.563423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:11.563942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:11.564397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:11.565119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:11.565669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:11.566194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:11.602401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9073997f-2d28-43cb-beed-b3488a2f15f3", "tag": "aa07d805-60c2-491f-b244-0409284b0c72"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:11.619966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:11.626210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:11.627147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:11.627794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:11.635255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=43 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:11.643986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] Creating event network-changed:aa07d805-60c2-491f-b244-0409284b0c72 for instance 9073997f-2d28-43cb-beed-b3488a2f15f3 on n-h1-858495-2 Sep 23 04:26:11.648425 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] [7a2a6b4b-0dd9-4a17-8bb8-cf9c76a75fbc] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:26:11.717322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:11.725911 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-33aae8b0-baf3-462a-bfbb-77173db2b219 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1278 microversion: 2.1 time: 0.264361 Sep 23 04:26:11.726598 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3173/6414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:11 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:26:12.655830 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] [7a2a6b4b-0dd9-4a17-8bb8-cf9c76a75fbc] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49914. Sep 23 04:26:12.659407 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8d928394-6406-461e-bbba-94a3c8e7a7bb req-14987c19-167e-4ea8-9ac5-220f49a403f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.237050 Sep 23 04:26:12.660215 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3242/6415] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:26:12.749514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:12.750767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:12.760177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:12.760683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:12.761133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:12.762122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:12.762603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:12.763045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:12.920039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:12.927823 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51c6c42b-5220-41f9-b61d-aba178e33a98 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1278 microversion: 2.1 time: 0.182194 Sep 23 04:26:12.928657 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3174/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:12 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:13.953699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:13.954412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:13.960803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:13.961337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:13.961820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:13.962538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:13.963074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:13.963519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:14.106594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:14.114446 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e2425678-fd77-4c0b-a01c-f983920cf8a5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1278 microversion: 2.1 time: 0.165993 Sep 23 04:26:14.115121 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3243/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:13 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:15.138375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:15.139267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:15.142305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:15.154254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:15.154724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:15.155291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:15.156153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:15.156667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:15.157126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:15.297437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:15.305763 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d80b135e-7bb7-4720-b24f-5f3661215095 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1278 microversion: 2.1 time: 0.171900 Sep 23 04:26:15.306339 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3175/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:15 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:16.328190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:16.328816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:16.335659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:16.336756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:16.337203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:16.337929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:16.338391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:16.338824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:16.471451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:16.479222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-baab7eaa-3efc-475b-891d-8e0fcd72ae79 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.154983 Sep 23 04:26:16.479795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3244/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:16 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:17.507973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:17.508767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:17.510884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:17.516307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:17.516843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:17.517296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:17.518021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:17.518485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:17.518923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:17.522472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=66 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:17.657265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:17.667640 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d774909-c610-4d4b-b637-fb7be8133dd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.163818 Sep 23 04:26:17.668231 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3176/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:17 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:18.691738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:18.692337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:18.694496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:18.700679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:18.701169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:18.701656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:18.702354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:18.702822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:18.703259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:18.831069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:18.839276 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e92e377-bef7-4e51-9414-710dc4824e18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.151459 Sep 23 04:26:18.839845 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3245/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:18 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:19.862177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:19.862723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:19.864810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:26:19.871393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:19.871904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:19.872363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:19.873093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:19.873610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:19.874050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:20.014025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:20.021989 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b966eaf6-fdab-4a93-9c93-a38586cd202a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.163825 Sep 23 04:26:20.022590 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3177/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:19 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:21.044418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:21.045030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:21.057775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:21.058266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:21.058707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:21.059411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:21.059869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:21.060299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:21.195824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:21.203585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca8aee17-6d0a-4b8f-a664-c7cffb766f40 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.163063 Sep 23 04:26:21.204156 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3246/6423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:21 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:22.229489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:22.230155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:22.237047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:22.237588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:22.238050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:22.238775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:22.239255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:22.239705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:22.373327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:22.381210 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f889e3df-5aa3-470f-8aef-d6856237859a tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.156273 Sep 23 04:26:22.381829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3178/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:22 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:23.403906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:23.404543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:23.411387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:23.411874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:23.412309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:23.412995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:23.413477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:23.413909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:23.545752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:23.553369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1552bff-f8f3-43f1-8007-d80ccd4baa9b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.153344 Sep 23 04:26:23.553955 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3247/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:23 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:24.576269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:24.576922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:24.583570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:24.584074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:24.584532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:24.585248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:24.585747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:24.586194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:24.721485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:24.730206 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e68c339c-d817-48c5-a85e-c026da19dc56 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.157952 Sep 23 04:26:24.731106 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3179/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:24 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:25.752603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:25.753204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:25.760611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:25.761099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:25.761577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:25.762268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:25.762725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:25.763155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:25.912644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:25.920865 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5293ef09-18a9-41d1-ad97-d71b76ef75ad tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.172209 Sep 23 04:26:25.921466 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3248/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:25 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:26.327457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9073997f-2d28-43cb-beed-b3488a2f15f3", "name": "network-vif-plugged", "status": "completed", "tag": "aa07d805-60c2-491f-b244-0409284b0c72"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:26.338999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:26.339500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:26.339954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:26.352138 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] Creating event network-vif-plugged:aa07d805-60c2-491f-b244-0409284b0c72 for instance 9073997f-2d28-43cb-beed-b3488a2f15f3 on n-h1-858495-2 Sep 23 04:26:26.357294 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-61d76be9-db08-4b96-a1be-271c89d9445b req-fef51172-8f14-4934-b5b7-f1c62e4fac4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Sep 23 04:26:26.357925 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3180/6428] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:26:26.943846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:26.944467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:26.951381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:26.951889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:26.952306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:26.953035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:26.953533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:26.953968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:27.082312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:27.090942 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-29bbf59c-3d4c-4044-9963-12e5894f54ca tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1266 microversion: 2.1 time: 0.150999 Sep 23 04:26:27.091535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3249/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:26 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:28.114974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:28.115726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:28.124258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:28.124775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:28.125231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:28.126060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:28.126545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:28.127014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:28.536184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:28.544732 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c26feaa3-9333-4730-a8f5-1e7a32b6d974 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1453 microversion: 2.1 time: 0.435063 Sep 23 04:26:28.545376 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3181/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:28 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1453 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:28.566705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:26:28.567327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:28.574250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:28.574741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:28.575184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:28.575911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:28.576371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:28.576800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:28.709474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:26:28.717729 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7b805ce-39b3-4ee6-a24c-8806df1ce2b4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1453 microversion: 2.1 time: 0.154813 Sep 23 04:26:28.718311 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3250/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:26:28 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:26:31.044344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9073997f-2d28-43cb-beed-b3488a2f15f3", "tag": "aa07d805-60c2-491f-b244-0409284b0c72"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:31.056239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:31.061565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:31.062211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:31.074427 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] Creating event network-changed:aa07d805-60c2-491f-b244-0409284b0c72 for instance 9073997f-2d28-43cb-beed-b3488a2f15f3 on n-h1-858495-2 Sep 23 04:26:31.079943 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8216dd07-7b53-43d8-a094-b142848fbb72 req-35d15c16-b50a-4c83-b098-d574facdb9f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039496 Sep 23 04:26:31.080560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3182/6432] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:26:33.080413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:26:33.082699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:26:33.089334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:33.089836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:33.090538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:33.091222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:26:33.091678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:26:33.092100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:26:33.157628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5dff4413-4d51-42c7-b44d-02dd4556ca82 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action" status: 200 len: 24574 microversion: 2.1 time: 0.080920 Sep 23 04:26:33.158401 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3251/6433] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:26:33 2022] POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action => generated 24574 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:27:03.574498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=13 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:03.575303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=33 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:03.579845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:03.580575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:03.587437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:03.587929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:03.588376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:03.589070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:03.589826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:03.590267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:03.811793 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5f07e40d-1c90-48a0-ab41-b258f231fe28 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1832 microversion: 2.1 time: 0.239427 Sep 23 04:27:03.812450 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3183/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:03 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1832 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:03.834323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:03.835030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:03.837917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=19 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:03.838774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=53 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:03.845104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:03.845618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:03.846060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:03.846768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:03.847224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:03.847655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:03.983340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:03.990941 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e5df966-0a73-4574-9ad3-ca0f61e05a2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1681 microversion: 2.1 time: 0.160811 Sep 23 04:27:03.992096 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3252/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:03 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:27:04.090792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:04.092998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:04.098985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:04.099488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:04.099943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:04.101269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:04.101781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:04.102232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:04.176478 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-152de8b9-d8ee-4ddb-9415-a2b45e636f8d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action" status: 200 len: 32645 microversion: 2.1 time: 0.089714 Sep 23 04:27:04.177402 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3184/6436] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:27:04 2022] POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action => generated 32645 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:27:04.313962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:04.314466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:04.321998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:04.322650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:04.323297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:04.324282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:04.324832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:04.325263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:04.367656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50c8e902d787403695a56077ac169f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd2c85d4f314315a7024165fb0773ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:04.368249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] flavor_id is None. Assuming migration. {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:27:04.368693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:27:04.533846 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [a2932ab4-9f68-4dd1-b44b-5f73abfbbbee] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:27:05.541210 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [a2932ab4-9f68-4dd1-b44b-5f73abfbbbee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50000. Sep 23 04:27:05.544355 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfd09f14-7000-4b85-99d4-81e713a2e1df tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action" status: 202 len: 0 microversion: 2.1 time: 1.234338 Sep 23 04:27:05.544985 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3253/6437] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:27:04 2022] POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action => generated 0 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:27:05.554146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:05.554958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:05.562207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:05.562714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:05.563172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:05.563885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:05.564360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:05.564806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:05.706002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:05.715377 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5fa49377-a38f-4a00-b77d-413793684e22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1690 microversion: 2.1 time: 0.166000 Sep 23 04:27:05.716052 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3185/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:05 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:27:06.739841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:06.740497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:06.746945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:06.747548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:06.748052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:06.748756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:06.749451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:06.749882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:06.918359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:06.926206 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42fe5ed0-d5dd-4e12-a1f1-3c054a8aeb78 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1690 microversion: 2.1 time: 0.191285 Sep 23 04:27:06.926781 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3254/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:06 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:07.949166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:07.949912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:07.957444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:07.957974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:07.958448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:07.959185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:07.959673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:07.960128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:08.092191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:08.100017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c40f16c-65d7-40d3-8fc9-e4ed2b9fa404 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.154910 Sep 23 04:27:08.100596 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3186/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:07 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:09.125651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:09.126203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:09.132974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:09.133501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:09.133950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:09.134644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:09.135106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:09.135541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:09.268285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:09.276550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e52174f8-b0ee-4115-a17b-ca1e79ba059c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.154988 Sep 23 04:27:09.277134 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3255/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:09 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:10.300088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:10.300712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:10.308162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:10.308662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:10.309119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:10.309859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:10.310331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:10.310777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:10.442794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:10.450698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-48ae6d15-848e-43ef-a2ef-9f9e083e45cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.154532 Sep 23 04:27:10.451307 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3187/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:10 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:11.474665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:11.475274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:11.482100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:11.482581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:11.483147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:11.483833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:11.484286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:11.484710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:11.629152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:11.637605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89b70032-fcbe-4463-9186-04661ddada56 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.166722 Sep 23 04:27:11.638196 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3256/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:11 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:12.661571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:12.662200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:12.669741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:12.670247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:12.670701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:12.671402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:12.671872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:12.672312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:12.803895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:12.812334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6f5a621-b5cb-4a43-a8c0-b674c4379181 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.154765 Sep 23 04:27:12.812920 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3188/6444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:12 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:13.835760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:13.836348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:13.843463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:13.843944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:13.844378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:13.845084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:13.845550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:13.845976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:13.979362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:13.987318 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6d1afa2-0fe3-47d9-a018-f4c9d619bf6a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.155704 Sep 23 04:27:13.987985 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3257/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:13 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:15.013587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:15.014227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:15.025654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:15.026163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:15.026649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:15.027373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:15.027849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:15.028295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:15.166974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:15.175043 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd48cea9-fce2-4632-add7-1e20f2e89dbf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.167814 Sep 23 04:27:15.175639 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3189/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:15 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:16.198418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:16.199027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:16.205822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:16.206299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:16.206729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:16.207410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:16.207862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:16.208285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:16.342295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:16.349899 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b0b8ea2-929b-459f-8cfb-7c52d1bef7b7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.155395 Sep 23 04:27:16.350475 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3258/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:16 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:17.374018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:17.374665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:17.381283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:17.381808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:17.382261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:17.382965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:17.383435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:17.383875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:17.520053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:17.527819 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f7e6e252-4f23-4155-80b7-4f159de4e3f2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.157691 Sep 23 04:27:17.528415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3190/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:17 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:18.551738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:18.552349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:18.559584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:18.560073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:18.560508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:18.561209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:18.561703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:18.562140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:18.693890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:18.702633 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-770c66af-564a-477b-9d92-6b23fc9a4fab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.154798 Sep 23 04:27:18.703227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3259/6449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:18 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:19.726440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:19.727073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:19.734042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:19.734548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:19.735007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:19.735717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:19.736195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:19.736646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:19.913911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:19.923001 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-83941bf3-7fcd-4189-8eb4-2c4fb2bc664f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1695 microversion: 2.1 time: 0.200485 Sep 23 04:27:19.923592 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3191/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:19 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:20.483664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "name": "network-vif-unplugged", "status": "completed", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:20.495062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:20.495546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:20.495978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:20.508077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Creating event network-vif-unplugged:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h1-858495-2 Sep 23 04:27:20.513590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:27:20.524864 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6effb772-9871-4889-9ee5-e08e0183bd04 req-64e85db3-47f0-47f1-a0c9-05d5d5a6f6fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044354 Sep 23 04:27:20.525514 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3260/6451] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:27:20.947405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:20.948309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:20.955353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:20.956121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:20.956648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:20.957373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:20.957874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:20.958300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:21.104242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:21.114969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-827b0304-37f9-4f18-9383-a8559a37d76e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1694 microversion: 2.1 time: 0.171983 Sep 23 04:27:21.115666 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3192/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:20 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:22.140323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:22.141029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:22.147183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:22.147671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:22.148111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:22.148802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:22.149804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:22.150230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:22.283565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:22.291872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b4f57bd-601b-4564-bfe3-4f51d19fe8f4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1692 microversion: 2.1 time: 0.156648 Sep 23 04:27:22.292439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3261/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:22 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:22.552174 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:22.562423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:22.562917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:22.563366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:22.575571 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Creating event network-changed:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h1-858495-2 Sep 23 04:27:22.580828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:27:22.592520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a5121e82-b866-493d-b671-a19a9f3de09a req-6ed82bb1-5911-4fbf-834f-544aaa15b305 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044076 Sep 23 04:27:22.593117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3193/6454] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:27:23.315430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:23.316047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:23.323063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.323529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.323995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.324755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.325213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.325679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.456023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:23.465186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0e38d7d4-a029-4702-863a-32ebf776417c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1689 microversion: 2.1 time: 0.153715 Sep 23 04:27:23.465807 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3262/6455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:23 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:23.488963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:23.489680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:23.495920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.496422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.496876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.497660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.498138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.498584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.555681 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1919cf11-7fc5-44af-aee0-88bba8d5a8e1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action" status: 204 len: 0 microversion: 2.1 time: 0.070827 Sep 23 04:27:23.556362 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3194/6456] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:27:23 2022] POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:27:23.564650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:23.565259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:23.571275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.571729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.572260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.572937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:23.573648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:23.574079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:23.810440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:23.820060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e836cd1d-10fe-492c-9da1-aca9de2e7de5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1689 microversion: 2.1 time: 0.258870 Sep 23 04:27:23.833626 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3263/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:23 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1689 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:24.845971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:24.846612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:24.853472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:24.854037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:24.854503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:24.856352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:24.856352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:24.856757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:25.004390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:25.012978 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e1f26950-8f54-4796-a70f-326e146b00ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1689 microversion: 2.1 time: 0.172240 Sep 23 04:27:25.013603 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3195/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:24 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:26.036798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:26.037792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:26.044747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:26.045238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:26.045724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:26.046424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:26.046888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:26.047328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:26.178658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:26.186924 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1adea45c-bc01-4005-8abf-e49905e127eb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1681 microversion: 2.1 time: 0.153996 Sep 23 04:27:26.187501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3264/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:26 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:26.562786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "name": "network-vif-plugged", "status": "completed", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:26.575578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:26.576083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:26.576542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:26.587065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] Creating event network-vif-plugged:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h1-858495-2 Sep 23 04:27:26.592324 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0935c176-42d7-4700-bb90-5d8bb376e008 req-1348e1a5-6f30-4cef-9596-7d4373c4e0bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Sep 23 04:27:26.593104 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3196/6460] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:27:50.381706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:50.384431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:50.386778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=28 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:50.387442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:50.393362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:50.393852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:50.394345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:50.395127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:50.395582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:50.396010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:50.456943 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf972fce-62e1-4ab5-8f37-8eea30f9cce4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action" status: 200 len: 24579 microversion: 2.1 time: 0.079317 Sep 23 04:27:50.457618 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3265/6461] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:27:50 2022] POST /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5/action => generated 24579 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:27:56.631043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=28 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:56.631809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:27:56.635874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:56.636589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:56.643956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:56.644456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:56.644909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:56.645660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:56.646131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:56.646576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:56.782963 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-46c6701d-1527-4eae-8c30-e2e4c15def65 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1832 microversion: 2.1 time: 0.153925 Sep 23 04:27:56.783560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3197/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:56 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1832 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:57.619218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:57.619909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:57.620930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:57.627840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:57.628404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:57.629070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:57.629804 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:57.630221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:57.630377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:57.630680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:57.630818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:57.631143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:57.644925 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] Creating event network-changed:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h1-858495-2 Sep 23 04:27:57.650760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-f8f16487-a25b-406e-8eb8-1f00cf271b1e req-c9daf8b2-8dfc-4bc9-9618-cbb1f39e1a0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Sep 23 04:27:57.651364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3198/6463] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:27:57.662537 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:27:57.754703 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8713b61c-3ffe-440e-8f32-d17b1f5909dc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 204 len: 0 microversion: 2.1 time: 0.138880 Sep 23 04:27:57.755943 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3266/6464] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:27:57 2022] DELETE /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:27:57.764695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:57.765553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:57.771904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:57.772425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:57.772873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:57.773766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:57.774524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:57.775208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:57.918686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:57.926501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e77f8d7-59d3-4929-846d-43c543737e47 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1687 microversion: 2.1 time: 0.166219 Sep 23 04:27:57.927098 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3199/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:57 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:58.951705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:58.952420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:58.960746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:58.961245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:58.961712 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:58.962421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:58.962877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:58.963585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.326755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:59.338475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1182225f-53f1-49f9-bcaf-95ca3aac3839 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1687 microversion: 2.1 time: 0.390625 Sep 23 04:27:59.354916 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3267/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:58 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1687 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:27:59.499307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:59.500972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:59.508275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.509024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.509684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.510581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.511212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.511804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.542245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:27:59.621917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fba4df-e018-41a6-90b9-0a08868fc7e5", "name": "network-vif-deleted", "tag": "700cdbd5-ac9f-4d2a-b304-5be5fade73c5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:59.632385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.632907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.633605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.646432 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] Creating event network-vif-deleted:700cdbd5-ac9f-4d2a-b304-5be5fade73c5 for instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 on n-h1-858495-2 Sep 23 04:27:59.664023 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-473aa1bc-085f-4244-b819-70a0d48593bc req-761bf7fc-195c-4129-a10f-0e181837f00e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044591 Sep 23 04:27:59.668093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc5129f9-6ab7-4f6c-8ace-a92acafe8302 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 204 len: 0 microversion: 2.1 time: 0.172583 Sep 23 04:27:59.669320 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3268/6468] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:27:59.672124 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3200/6468] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:27:59 2022] DELETE /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:27:59.676214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9073997f-2d28-43cb-beed-b3488a2f15f3", "tag": "aa07d805-60c2-491f-b244-0409284b0c72"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:27:59.680426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:27:59.681443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:27:59.689019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.689562 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.689703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.690010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.690143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.690626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.691580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:27:59.692229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:27:59.693396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:27:59.701629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] Creating event network-changed:aa07d805-60c2-491f-b244-0409284b0c72 for instance 9073997f-2d28-43cb-beed-b3488a2f15f3 on n-h1-858495-2 Sep 23 04:27:59.706631 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-dc8f3e33-971e-4454-8f09-04f019d5d50f req-2d45834a-d811-462c-aebf-1660c7f9cef3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Sep 23 04:27:59.707560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3269/6469] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:27:59.843253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:27:59.851266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e5c531de-69bd-488b-9e7d-e958cbbab976 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1578 microversion: 2.1 time: 0.177984 Sep 23 04:27:59.851897 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3201/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:27:59 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:00.363113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:00.364649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:00.373599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:00.373599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:00.374056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:00.374687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:00.375151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:00.375590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:00.443831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:00.452352 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c18c2c8-a4e3-4dcd-8811-e1b4e4de921f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 200 len: 1351 microversion: 2.1 time: 0.093714 Sep 23 04:28:00.465399 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3270/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:00 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:00.877160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:00.877816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:00.887634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:00.888043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:00.888496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:00.889230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:00.889723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:00.890483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:01.032344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:01.042563 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88b98ca7-aa65-439c-a7af-b642844c6026 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1578 microversion: 2.1 time: 0.170581 Sep 23 04:28:01.043408 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3202/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:00 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:01.480980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:01.481803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: e4fba4df-e018-41a6-90b9-0a08868fc7e5] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:01.489331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:01.489849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:01.490288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:01.490998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:01.491450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:01.491879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:01.508015 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] HTTP exception thrown: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Request method failure captured: Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 HTTP/1.1 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTVDxP1tPrvtvarx50dHt1SV-31nRvuZp9W9UVzgwK_PTsCLxPAb7zLfOklDDHstaA0yVqu5iO79JMhRm6WVLEZ7AYJQRANaBeauhU5dN2hQc4Bfg4OgDChzYXPP40SCIT58M9RYb6ZbsTJyR6KCEMSInPUntxoPqTMKRTVqjwmGvco Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 65ffb703d321467db51326505107a168 Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e4fba4df-e018-41a6-90b9-0a08868fc7e5'} Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:01.509722 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Returning 404 to user: Instance e4fba4df-e018-41a6-90b9-0a08868fc7e5 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67e7cc00-6af2-411f-9233-55eb1dc7ec76 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5" status: 404 len: 111 microversion: 2.1 time: 0.034888 Sep 23 04:28:01.515652 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3271/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:01 2022] GET /compute/v2.1/servers/e4fba4df-e018-41a6-90b9-0a08868fc7e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:28:02.067677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:02.068459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:02.078421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:02.078935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:02.079393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:02.080120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:02.080590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:02.081030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:02.314732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9073997f-2d28-43cb-beed-b3488a2f15f3", "name": "network-vif-deleted", "tag": "aa07d805-60c2-491f-b244-0409284b0c72"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:02.318402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:02.326898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:02.327680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:02.328300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:02.328444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f00f458-27e3-4d59-b224-4971562e836e tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1578 microversion: 2.1 time: 0.265471 Sep 23 04:28:02.329396 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3203/6474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:02 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:02.342990 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] Creating event network-vif-deleted:aa07d805-60c2-491f-b244-0409284b0c72 for instance 9073997f-2d28-43cb-beed-b3488a2f15f3 on n-h1-858495-2 Sep 23 04:28:02.349116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ebbd11fa-afb7-4b84-b5fa-85c3b65f9e5b req-7ccf69b7-d6b2-420e-998d-6ee7b2380827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038074 Sep 23 04:28:02.350098 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3272/6475] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:28:03.355522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:03.358015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:03.368572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:03.369448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:03.370938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:03.372188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:03.372936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:03.373701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:03.468989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:03.479027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d643aee-2312-46c2-b6a0-2448b3251c36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1226 microversion: 2.1 time: 0.129740 Sep 23 04:28:03.480046 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3204/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:03 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1226 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:04.502338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:04.503771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:04.510132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:04.510657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:04.511103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:04.511805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:04.512262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:04.512885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:04.632146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:04.641123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1647ba7f-36c0-4ba0-9ccb-3b48e24486e9 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1226 microversion: 2.1 time: 0.143783 Sep 23 04:28:04.642101 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3273/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:04 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:05.011983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06c133ea-4623-4770-9d05-7dd75676906c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '.version_select at 0x7f0c8a2aeaf0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:05.055227 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06c133ea-4623-4770-9d05-7dd75676906c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254796195" status: 202 len: 0 microversion: 2.1 time: 0.047045 Sep 23 04:28:05.055831 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3205/6478] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Sep 23 04:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254796195 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:28:05.086576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: .version_select at 0x7f0c89e1f280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1070327804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd4TtS9yAlOYavOltnb981nd0wfAnmdXdVlWjitzijv+d4vmubfJcAfn6h5t4C1ZpD3FiwZHHcBjwtwkidXKwuVakrj670t+sXrZV1wT/Jzv0JoZfhRfmQJDJ54pFKY2A=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:05.109749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:28:05.115090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:28:05.128773 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:28:05.664624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:05.665248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:05.672089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:05.672640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:05.673041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:05.673849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:05.674321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:05.674766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:05.737827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:05.746224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9614d183-b0f9-424a-a96b-408ae19f8ebc tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1226 microversion: 2.1 time: 0.086061 Sep 23 04:28:05.746804 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3206/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:05 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:28:06.137997 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50170. Sep 23 04:28:06.153337 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-153fbf2c-055d-4a49-80b7-055899de8b7a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.070985 Sep 23 04:28:06.159855 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3274/6480] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:28:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:28:06.769670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:06.770337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:06.777934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:06.778720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:06.779811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:06.780971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:06.781511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:06.782141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:06.823291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:06.823815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:06.824276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:06.824802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lazy-loading 'fault' on Instance uuid 9073997f-2d28-43cb-beed-b3488a2f15f3 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:28:06.877160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:06.886123 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3ae080d-811b-4b87-b8ea-cf97bf979888 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 200 len: 1231 microversion: 2.1 time: 0.120493 Sep 23 04:28:06.886858 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3207/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:06 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:07.910172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:07.912360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 9073997f-2d28-43cb-beed-b3488a2f15f3] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:07.919972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:07.920469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:07.920927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:07.921676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:07.922328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:07.922766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:07.936303 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 HTTP/1.1 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '9073997f-2d28-43cb-beed-b3488a2f15f3'} Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:07.938001 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 9073997f-2d28-43cb-beed-b3488a2f15f3 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea060bd3-a325-48b5-ab56-e0403e150af3 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3" status: 404 len: 111 microversion: 2.1 time: 0.034432 Sep 23 04:28:07.944243 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3275/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:07 2022] GET /compute/v2.1/servers/9073997f-2d28-43cb-beed-b3488a2f15f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:28:12.289199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-35749854", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "a36c2dff-e111-4ad0-b9d1-7fcc89ee4e17"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1070327804", "security_groups": [{"name": "tempest-secgroup-smoke-1283943922"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:12.512218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] validate_networks() for [('a36c2dff-e111-4ad0-b9d1-7fcc89ee4e17', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:28:12.981669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:28:12.983013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:28:12.984371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:28:12.985445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:28:12.986299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:28:13.006663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:13.007175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:13.013948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:13.014755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:13.015244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:13.015709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:13.052449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:28:13.058866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:28:13.074959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:28:13.078024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:28:13.132602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9af7e49c-cd35-4ea7-978e-b6542ca011be tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.848538 Sep 23 04:28:13.133553 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3208/6483] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:28:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:28:13.144910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7060c5c-abe0-4ee1-acef-7265385aa23f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:13.145715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7060c5c-abe0-4ee1-acef-7265385aa23f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:13.241034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7060c5c-abe0-4ee1-acef-7265385aa23f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:13.251341 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7060c5c-abe0-4ee1-acef-7265385aa23f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1265 microversion: 2.1 time: 0.110119 Sep 23 04:28:13.252804 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3276/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:13 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:28:14.276204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:14.276771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:14.286172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.286680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.287383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.288112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.288589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.289039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.365117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:14.374779 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1fecad0-98ec-4e26-af34-ae91e222dc19 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1317 microversion: 2.1 time: 0.103033 Sep 23 04:28:14.375564 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3209/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:14 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:14.543295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a84db8-4efb-461f-8363-89b99a95bfa0", "tag": "77092c93-4bc8-4681-8ad0-089415f4e36f"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:14.544225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:14.546415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:14.571808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.572883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.574373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.575013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.576684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.577680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.578063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.579478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.582538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.608559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] Creating event network-changed:77092c93-4bc8-4681-8ad0-089415f4e36f for instance a0a84db8-4efb-461f-8363-89b99a95bfa0 on n-h1-858495-2 Sep 23 04:28:14.620698 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d257b311-e398-4e16-9fcd-130a0553e30d req-5da99953-3013-4586-b154-840c5bd6cffe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088861 Sep 23 04:28:14.624158 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3210/6486] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:28:14.633276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:28:14.814446 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-228c9c59-624e-4c68-bac9-20b6450a3ae4 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 204 len: 0 microversion: 2.1 time: 0.288168 Sep 23 04:28:14.825295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:14.826338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:14.826550 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3277/6487] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:28:14 2022] DELETE /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:28:14.833999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.835310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.835972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:14.837490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:14.838422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:14.839202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:15.124927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:15.142520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cd391710-ba83-49df-9ddb-65843a43dcd5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1577 microversion: 2.1 time: 0.322116 Sep 23 04:28:15.143229 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3211/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:14 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1577 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:15.400911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:15.401973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:15.409269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:15.410295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:15.410919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:15.411864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:15.412494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:15.413155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:15.505757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:15.515601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b8ee493-7da9-4704-9770-1c5bd4b37275 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1323 microversion: 2.1 time: 0.120378 Sep 23 04:28:15.516442 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3278/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:15 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1323 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:16.171279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:16.172192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:16.182602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:16.183121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:16.183574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:16.184302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:16.184784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:16.185226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:16.541149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:16.542568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:16.559759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:16.562284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:16.563180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:16.564139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:16.569815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:16.570585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:16.858692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:16.867845 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c59f96bc-72e2-427f-ad25-51971cffdd78 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1577 microversion: 2.1 time: 0.704004 Sep 23 04:28:16.884643 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3212/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:16 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1577 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:16.900152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:16.911418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:16.912028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:16.912801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:16.913519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:16.928337 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a0ae2b43-d6ec-4e80-9c2e-ac834aab7bc6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.391861 Sep 23 04:28:16.934725 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] Creating event network-changed:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:28:16.938792 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3279/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:16 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:16.946965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8226883f-5dec-494c-8275-31ab93a00548 req-ad1530c5-415f-4e16-af63-f1e6ecd8fd95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060577 Sep 23 04:28:16.947728 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3213/6492] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:28:17.346347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a84db8-4efb-461f-8363-89b99a95bfa0", "name": "network-vif-deleted", "tag": "77092c93-4bc8-4681-8ad0-089415f4e36f"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:17.359032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:17.359509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:17.360136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:17.374222 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] Creating event network-vif-deleted:77092c93-4bc8-4681-8ad0-089415f4e36f for instance a0a84db8-4efb-461f-8363-89b99a95bfa0 on n-h1-858495-2 Sep 23 04:28:17.380862 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3412c86f-327e-4cd1-b084-f7fc064aab4c req-f8fe16cd-7209-43f9-8b7f-5d2b792adcde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 Sep 23 04:28:17.381365 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3280/6493] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:28:17.892591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:17.893228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:17.899587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:17.900095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:17.900556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:17.901270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:17.901774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:17.902231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:17.951653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:17.952371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:17.958913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:17.959406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:17.959919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:17.960631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:17.961128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:17.961596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:17.966224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:17.974651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5829f52d-7d64-4698-addf-9de0f3bd333f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1225 microversion: 2.1 time: 0.087215 Sep 23 04:28:17.975633 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3214/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:17 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:18.122423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:18.130582 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e6bb9ac-a028-4f16-bb9b-0a797e2005d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.183360 Sep 23 04:28:18.131162 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3281/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:17 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:28:19.002181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:19.002818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:19.010684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:19.011197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:19.011708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:19.012463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:19.012939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:19.013601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:19.018238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:19.078391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:19.086549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4fe5d876-a984-466d-a944-6b198204ad18 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1225 microversion: 2.1 time: 0.088230 Sep 23 04:28:19.087171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3215/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:18 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:19.153659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:19.154404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:19.161394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:19.161877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:19.162311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:19.163000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:19.163449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:19.163871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:19.300654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:19.309340 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f0c65594-376a-4074-b532-638b0bfb23b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.159661 Sep 23 04:28:19.310313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3282/6497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:19 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:28:20.111024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:20.111746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:20.118802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:20.119308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:20.119766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:20.120869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:20.121376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:20.121937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:20.194234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:20.203705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2427492d-6761-4108-8294-57b5d01cc676 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1225 microversion: 2.1 time: 0.097523 Sep 23 04:28:20.204433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3216/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:20 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:20.332322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:20.333064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:20.341114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:20.341630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:20.342081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:20.342821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:20.343285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:20.343719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:20.476240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:20.478589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:20.486067 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-305f6dd0-b749-423d-9353-82f9593aa6b6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.157913 Sep 23 04:28:20.486662 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3283/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:20 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:21.229582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:21.230263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:21.237545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:21.238407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:21.238866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:21.239587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:21.240068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:21.240511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:21.307510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91f6388ec684133bbcae3db83293f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24437bb66a4a4b2b9534037a59000a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:21.316440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-253d81b7-5459-4107-9f65-db4d4707a45f tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 200 len: 1225 microversion: 2.1 time: 0.091481 Sep 23 04:28:21.317254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3217/6500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:21 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:21.509697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:21.510352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:21.513517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:21.519520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:21.520225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:21.520441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:21.521105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:21.521589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:21.522026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:21.959079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:21.967233 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50230a79-9925-4af5-914d-daf96dd21fa9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.461794 Sep 23 04:28:21.967809 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3284/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:21 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:22.193038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-plugged", "status": "completed", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:22.204884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.205421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.205876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.219522 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] Creating event network-vif-plugged:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:28:22.224590 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-294684e2-9be1-4d2a-ba40-0d94615656a9 req-0568107d-2c24-40a0-97c0-c11870167d83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Sep 23 04:28:22.225461 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3218/6502] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:28:22.338925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:22.339456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: a0a84db8-4efb-461f-8363-89b99a95bfa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:22.345506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.346011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.346453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.347165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.347630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.348066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.362399 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 HTTP/1.1 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'a0a84db8-4efb-461f-8363-89b99a95bfa0'} Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.364067 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance a0a84db8-4efb-461f-8363-89b99a95bfa0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-096ceca6-e5db-4a3d-9530-eb67768bcb8b tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0" status: 404 len: 111 microversion: 2.1 time: 0.030974 Sep 23 04:28:22.369453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3285/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:22 2022] GET /compute/v2.1/servers/a0a84db8-4efb-461f-8363-89b99a95bfa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:28:22.850048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:22.850677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:22.859524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.860018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.860538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.861256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.861988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.862798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.880657 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 HTTP/1.1 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '3afe03b6-9c26-4986-b0d6-dff930545c73'} Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:28:22.882435 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-12fbf295-ea7a-4c6d-9607-896f1da24ba5 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 404 len: 111 microversion: 2.1 time: 0.039484 Sep 23 04:28:22.935848 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3219/6504] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:28:22 2022] DELETE /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] [instance: 3afe03b6-9c26-4986-b0d6-dff930545c73] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] HTTP exception thrown: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Request method failure captured: Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 HTTP/1.1 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTL-fZo0IoS_i5T4t0km2RVyXy874qfPUL6e6EKz_Ablh8PI76GoIn6lrO7EDB5v7AT_pWjBUL18E9FuJGTpJnrghECApEjxwCRKZ_CMXMSALxCXBzU_EOqVYgu3bl1oqblszqtqUyzInos7fPmk_-Co-GVY_k1yUPE3Hs4KGXSgrk4 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:28:22.937531 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24437bb66a4a4b2b9534037a59000a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 24437bb66a4a4b2b9534037a59000a29 Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestVolumeBootPattern-2090765988 Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: f91f6388ec684133bbcae3db83293f8b Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestVolumeBootPattern-2090765988-project Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '3afe03b6-9c26-4986-b0d6-dff930545c73'} Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:28:22.939392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Returning 404 to user: Instance 3afe03b6-9c26-4986-b0d6-dff930545c73 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:28:22.941596 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17c34ade-a859-4dc5-b110-e467dd61b155 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73" status: 404 len: 111 microversion: 2.1 time: 0.033796 Sep 23 04:28:22.941596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3286/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:22 2022] GET /compute/v2.1/servers/3afe03b6-9c26-4986-b0d6-dff930545c73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:28:22.991421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:22.992057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:22.998935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:22.999443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:22.999898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:23.000627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:23.001098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:23.001585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:23.037605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:23.066005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:23.150197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:23.158473 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f19087e0-00ec-477d-b201-b9e8e42425cf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1391 microversion: 2.1 time: 0.171470 Sep 23 04:28:23.159381 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3220/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:22 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:24.179680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:24.185851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:24.186472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:24.193835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:24.194329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:24.194773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:24.195491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:24.196539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:24.196932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:24.335638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:24.344160 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-30365da9-5689-40e2-9cb1-1e2e35e60970 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1562 microversion: 2.1 time: 0.165282 Sep 23 04:28:24.344739 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3287/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:24 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:24.367101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:24.367794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:24.375467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:24.375987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:24.376472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:24.377207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:24.377739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:24.378185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:24.542512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:24.550577 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-feaa383f-cf61-467d-bbb7-9e9d10a71b07 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1562 microversion: 2.1 time: 0.187478 Sep 23 04:28:24.551164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3221/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:24 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:26.254624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:26.255702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:26.256316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:26.271235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:26.272160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:26.272753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:26.273768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:26.275135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:26.275783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:26.283138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:26.283859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:26.284323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:26.303788 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] Creating event network-changed:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:28:26.311161 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fce0e81c-08fe-4ad8-9f9b-88d02aef2744 req-3a336f29-7d38-43c1-ae1b-790205c6bc97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060240 Sep 23 04:28:26.313567 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3222/6509] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:28:26.500797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f0f797a-b04e-4a50-ae03-404a7e75ce36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] Calling method '.version_select at 0x7f0c882d50d0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:28:26.521766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:28:26.560817 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9ac81b4-5bb3-46aa-a9ce-b404f3f095b2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1562 microversion: 2.1 time: 0.314824 Sep 23 04:28:26.561953 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5f0f797a-b04e-4a50-ae03-404a7e75ce36 tempest-TestVolumeBootPattern-2090765988 tempest-TestVolumeBootPattern-2090765988-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580473554" status: 202 len: 0 microversion: 2.1 time: 0.064949 Sep 23 04:28:26.563618 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3223/6510] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 23 04:28:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580473554 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:28:26.563945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3288/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:28:26 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1562 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:28:58.094413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=34 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:58.095108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:28:58.099732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:28:58.102612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:28:58.111938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:58.112447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:58.112901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:58.113656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:28:58.114132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:28:58.114739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:28:58.183849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5e48d40e-76e3-41a1-a3e2-7055ce8fcf2d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action" status: 200 len: 24571 microversion: 2.1 time: 0.091333 Sep 23 04:28:58.185075 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3224/6512] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:28:58 2022] POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action => generated 24571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:29:37.208792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=9 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:29:37.209710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=23 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:29:37.211725 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 23 04:29:37.220823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:37.221472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:37.227936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.228422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.228861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:37.229581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.230037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.230467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:37.593262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ffed84c-feac-42bd-8487-9ef05a67afd4 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1831 microversion: 2.1 time: 0.386437 Sep 23 04:29:37.593876 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3289/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:37 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1831 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:37.617331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:37.618074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:37.621323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:29:37.621996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:29:37.629102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.629618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.630075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:37.630781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.631251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.631695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:37.820237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:37.828003 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3200cc3-ec77-4b91-81af-43a27ceed174 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1680 microversion: 2.1 time: 0.214848 Sep 23 04:29:37.828585 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3225/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:37 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:37.926534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:29:37.928765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:37.934739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.935227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.935669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:37.936375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:37.936835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:37.937270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:38.012494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-22fb8b4b-8433-4423-99c0-5e0a79f98800 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action" status: 200 len: 32641 microversion: 2.1 time: 0.089653 Sep 23 04:29:38.013961 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3290/6515] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:29:37 2022] POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action => generated 32641 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:29:38.151431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:29:38.152024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:38.158085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:38.158590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:38.159046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:38.159749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:38.160232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:38.160678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:38.199356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50c8e902d787403695a56077ac169f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd2c85d4f314315a7024165fb0773ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:38.199978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 2f096d78-7ead-4402-bc29-c91454491257] flavor_id is None. Assuming migration. {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:29:38.200443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:29:38.424559 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-acd55656-a824-401c-9ac9-2cb6b7da3f8f tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action" status: 202 len: 0 microversion: 2.1 time: 0.279290 Sep 23 04:29:38.425464 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3226/6516] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:29:38 2022] POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:29:38.433868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:38.434575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:38.443266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:38.443757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:38.444260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:38.445235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:38.445600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:38.446389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:38.587579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:38.596532 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-444243f5-1330-4620-b635-903cca24b39a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1689 microversion: 2.1 time: 0.166868 Sep 23 04:29:38.597111 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3291/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:38 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:39.621463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:39.622104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:39.631403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:39.631922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:39.632382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:39.633110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:39.633612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:39.634063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:39.875844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:39.884769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6cc1f01-36b7-4a06-9bbd-66f35fcef7d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1689 microversion: 2.1 time: 0.268225 Sep 23 04:29:39.885383 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3227/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:39 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:40.908975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:40.909524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:40.916184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:40.916664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:40.917120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:40.917846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:40.918320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:40.918795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:41.057755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:41.066441 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b97ab45d-2285-4074-a269-b746344361c5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.162114 Sep 23 04:29:41.066939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3292/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:40 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:42.090707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:42.091371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:42.098789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:42.099295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:42.099754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:42.100471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:42.100948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:42.101469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:42.230339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:42.238170 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20395d9f-63bc-4189-a427-2d695bb8ecc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.151699 Sep 23 04:29:42.238747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3228/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:42 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:43.261978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:43.262629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:43.270243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:43.270738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:43.271183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:43.271894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:43.272360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:43.272798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:43.405656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:43.413426 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6fb0261-0cac-47d4-9c87-835d97651cc8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.155430 Sep 23 04:29:43.414009 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3293/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:43 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:44.437462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:44.438094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:44.445509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:44.446007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:44.446457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:44.447187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:44.447661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:44.448104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:44.578872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:44.587494 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eb3579ba-a841-4149-a57f-d1b99f64a9e0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.154154 Sep 23 04:29:44.588064 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3229/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:44 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:45.610614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:45.611229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:45.618032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:45.618551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:45.618992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:45.619689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:45.620148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:45.620580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:45.758967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:45.766603 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1c18344-d094-4026-900a-79452179845b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.159943 Sep 23 04:29:45.767177 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3294/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:45 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:46.789929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:46.790487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:46.796586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:46.797094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:46.797593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:46.799002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:46.799485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:46.799939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:46.929062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:46.936888 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c63262e-9b66-4b01-b2ca-43f9028104c7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.151283 Sep 23 04:29:46.937492 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3230/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:46 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:47.959968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:47.960616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:47.967703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:47.968133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:47.968571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:47.969264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:47.970420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:47.970853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:48.108918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:48.116697 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3ee071f-d3bb-4b82-b63b-b810aef5962e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.160638 Sep 23 04:29:48.117286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3295/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:47 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:49.140130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:49.140781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:49.147965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:49.148481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:49.148948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:49.149887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:49.150367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:49.150822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:49.283608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:49.291385 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-436acc97-4be9-455e-a41c-711408b7d2d6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.155358 Sep 23 04:29:49.291964 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3231/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:49 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:50.315749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:50.316364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:50.324378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:50.324871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:50.325312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:50.326040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:50.326526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:50.326976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:50.455935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:50.464001 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ae25619-360d-49d0-bd6c-9a364dc81ff4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.152150 Sep 23 04:29:50.464778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3296/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:50 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:51.487744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:51.488376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:51.495455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:51.495993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:51.496481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:51.497204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:51.497720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:51.498172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:51.630127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:51.637832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aeecce4f-b650-4b92-bdc5-f8e55bcd0332 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.154598 Sep 23 04:29:51.638417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3232/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:51 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:52.662960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:52.663526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:52.670399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:52.670886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:52.671323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:52.672017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:52.672475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:52.673492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:52.802675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:52.810527 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c802a964-aedf-4df7-9849-c371e47e5662 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.151522 Sep 23 04:29:52.811098 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3297/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:52 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:53.833708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:53.834267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:53.841524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:53.842037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:53.842502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:53.843217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:53.843698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:53.844155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:53.982523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:53.990437 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-17e905cd-18a4-4b99-afd7-b79825fa75cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.160745 Sep 23 04:29:53.991020 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3233/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:53 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:55.013838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:55.014432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:55.021342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:55.021870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:55.022356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:55.023055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:55.023511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:55.024049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:55.152348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:55.160648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-04284ed4-e195-4356-978b-dfb257667384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.150909 Sep 23 04:29:55.161226 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3298/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:55 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:56.184501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:56.185188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:56.192082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:56.192590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:56.193058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:56.193829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:56.194310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:56.194759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:56.327547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:56.336106 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fb9a81e-fe4d-4e72-a49e-70afe2722677 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1694 microversion: 2.1 time: 0.155310 Sep 23 04:29:56.336684 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3234/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:56 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:57.359219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:57.359981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:57.369496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:57.370171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:57.370970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:57.371773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:57.372261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:57.372673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:57.511350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:57.519792 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d94103ed-4264-4eca-940e-d88703ddf5fd tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1693 microversion: 2.1 time: 0.164497 Sep 23 04:29:57.520375 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3299/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:57 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:57.774185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-unplugged", "status": "completed", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:29:57.785713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:57.786242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:57.786793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:57.799553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Creating event network-vif-unplugged:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h1-858495-2 Sep 23 04:29:57.804992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] Instance 2f096d78-7ead-4402-bc29-c91454491257 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:29:57.816716 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a67c5786-af69-4eed-b8f2-263a16386cc2 req-eb2c7176-0ecd-4998-85fa-88422d9c0d85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046591 Sep 23 04:29:57.817557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3235/6534] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:29:58.543363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:58.544078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:58.551608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:58.552095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:58.552534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:58.553236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:58.553728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:58.554211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:58.690487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:58.698220 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-889f1ad2-83a2-4c11-a6ab-73a1e714e095 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1693 microversion: 2.1 time: 0.158825 Sep 23 04:29:58.698796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3300/6535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:58 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:59.723047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:59.723693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:29:59.731310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:59.731816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:59.732277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:59.732989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:59.733499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:59.733950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:59.852428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:29:59.863375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:59.864126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:59.864566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:59.869297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:29:59.877570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc3be6b2-32f6-4f5f-91b1-39828fe782ce tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1691 microversion: 2.1 time: 0.159401 Sep 23 04:29:59.878194 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3236/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:29:59 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:59.882127 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Creating event network-changed:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h1-858495-2 Sep 23 04:29:59.888162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] Instance 2f096d78-7ead-4402-bc29-c91454491257 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:29:59.899845 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d6c4b786-473e-43fa-bd40-2cfd8a0ab21a req-a8a1b601-9f57-43b5-b18a-c8e8824bed80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051104 Sep 23 04:29:59.900459 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3301/6537] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:30:00.901934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:00.902601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:00.909704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:00.910208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:00.910662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:00.911380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:00.911852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:00.912297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:01.051837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:01.059743 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fe0a0606-b5f9-4bab-844a-73273061b726 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1688 microversion: 2.1 time: 0.161808 Sep 23 04:30:01.060316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3237/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:00 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:01.084317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:01.084941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:01.092103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:01.092580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:01.093014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:01.093735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:01.094192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:01.094619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:01.485083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e72565c5-e4c6-4663-8311-4f478a484f6f tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action" status: 202 len: 0 microversion: 2.1 time: 0.405370 Sep 23 04:30:01.489453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3302/6539] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:30:01 2022] POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:30:01.494747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:01.495475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:01.502584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:01.503103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:01.503703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:01.504492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:01.504947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:01.505429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:01.667106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:01.678487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-afd2b730-916e-4824-8238-0df7c943ff2a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.187702 Sep 23 04:30:01.679213 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3238/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:01 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:30:02.705311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:02.706035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:02.713138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:02.713673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:02.714138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:02.714832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:02.715291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:02.715856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:02.843315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:02.851062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ece7e57c-a900-4256-bc50-a06c2e033c5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.151608 Sep 23 04:30:02.851633 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3303/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:02 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:03.383769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-plugged", "status": "completed", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:03.395784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:03.396290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:03.397136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:03.409955 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Creating event network-vif-plugged:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h1-858495-2 Sep 23 04:30:03.415266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] Instance 2f096d78-7ead-4402-bc29-c91454491257 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:30:03.428178 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bd09d3e1-b597-4220-b7a8-adec6872c646 req-e386f634-f773-4add-8659-1afb03cb1ce7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048375 Sep 23 04:30:03.428974 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3239/6542] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:03.875180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:03.875817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:03.882936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:03.883437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:03.883928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:03.884638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:03.885094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:03.885566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:03.901539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:04.025878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:04.033804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d452dcac-ef3e-47c8-a8bd-7b860b614384 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.162959 Sep 23 04:30:04.034362 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3304/6543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:03 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:04.976206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-unplugged", "status": "completed", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:04.986667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:04.987162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:04.987610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:04.999148 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Creating event network-vif-unplugged:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:30:05.001769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:05.005681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] Instance 2f096d78-7ead-4402-bc29-c91454491257 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:30:05.017091 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-601ce14e-3251-4b4b-bb45-d13c2ac14c07 req-0fa6054b-ec71-447b-a278-167026afd831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114896 Sep 23 04:30:05.017742 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3240/6544] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:05.056106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:05.056724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:05.063710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.064167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.064575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.065286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.065819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.066184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.297731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:05.305763 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f3a50398-d472-428e-84a4-2e7323db6abb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.253530 Sep 23 04:30:05.306340 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3305/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:05 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:06.330383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:06.331017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:06.339448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:06.339947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:06.340503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:06.341212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:06.341715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:06.342159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:06.478388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:06.486216 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6103ef2f-e71b-402e-a821-86a99696e311 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.161273 Sep 23 04:30:06.486804 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3241/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:06 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:07.035332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:07.045238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:07.045749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:07.046182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:07.058011 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Creating event network-changed:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:30:07.063136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] Instance 2f096d78-7ead-4402-bc29-c91454491257 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:30:07.073823 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-344e8570-205d-4e7a-b228-9c4d70353eef req-e2dd2c5b-87b0-4b99-90b0-7c10c3b025b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042747 Sep 23 04:30:07.074462 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3306/6547] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:07.510084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:07.510720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:07.518256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:07.518762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:07.519221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:07.519939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:07.520417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:07.520872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:07.654341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:07.662996 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76cf66e3-c124-4bcb-879d-a7440c906288 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.156915 Sep 23 04:30:07.663577 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3242/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:07 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:08.687737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:08.688482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:08.690556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=41 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:08.696086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:08.696584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:08.697041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:08.697771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:08.698238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:08.698678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:08.866751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:08.874721 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52e981b2-6147-4093-8c5a-ead4cee52345 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1687 microversion: 2.1 time: 0.192255 Sep 23 04:30:08.875294 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3307/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:08 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:09.900345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:09.900972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:09.903934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=39 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:09.909820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:09.910344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:09.910799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:09.911504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:09.911976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:09.912421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:10.042260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:10.050047 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5b35ee4-7746-4405-8863-b9e38deea8ca tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1680 microversion: 2.1 time: 0.153796 Sep 23 04:30:10.050626 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3243/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:09 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:10.504226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-plugged", "status": "completed", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:10.515236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:10.515939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:10.516862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:10.532076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] Creating event network-vif-plugged:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:30:10.537941 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a13e7abc-82fd-4524-a040-3d984c2d095b req-49b0d6ec-3bbc-48cb-bb4f-463119ebf0d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037657 Sep 23 04:30:10.538561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3308/6551] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:42.284500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:42.285398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:42.386409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:42.388735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:42.394760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:42.395261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:42.395716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:42.396423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:42.396897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:42.397340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:42.466488 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3ae5ceb1-c58b-40fd-8bf5-913b55c75d77 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action" status: 200 len: 62973 microversion: 2.1 time: 0.186671 Sep 23 04:30:42.467165 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3244/6552] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:30:42 2022] POST /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257/action => generated 62973 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:05.558984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:05.559710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=21 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:05.668026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:05.668772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:05.675467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:05.675953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:05.676397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:05.677094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:05.677592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:05.678043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:05.803349 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7d35ffc0-e652-49da-8d97-d32de65cbaaa tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1831 microversion: 2.1 time: 0.249654 Sep 23 04:31:05.803930 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3309/6553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:05 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1831 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.654344 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.654955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:06.656327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:06.659139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:06.659924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:06.665494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.666005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.666463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.667290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.667664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.668107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.669295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.670048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.670610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.682978 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] Creating event network-changed:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:31:06.688320 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0c2c3df7-0891-4d65-b364-1dfcf763e389 req-6d007c76-eaf9-49ed-b6cc-5b0d34b92d13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035864 Sep 23 04:31:06.689030 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3310/6554] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:06.699680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:31:06.788017 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47f1bd8e-2323-4653-a2d0-c5b6072d7b64 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 204 len: 0 microversion: 2.1 time: 0.138007 Sep 23 04:31:06.792929 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3245/6555] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:06 2022] DELETE /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:06.799690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.800404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:06.807841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.808350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.808796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.809549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.810013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.810447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.952495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:06.961186 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-91febfcf-bae0-44d8-8f4f-fe64587b6926 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1686 microversion: 2.1 time: 0.167218 Sep 23 04:31:06.961793 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3311/6556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:07.986513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.987243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:07.994973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.995537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.995989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.996756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.997248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.997716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:08.159394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:08.167310 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab4c9d32-d6d5-4eba-bc43-3108311aeaaa tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1686 microversion: 2.1 time: 0.185130 Sep 23 04:31:08.167898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3246/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:08.925934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f096d78-7ead-4402-bc29-c91454491257", "name": "network-vif-deleted", "tag": "2119ae50-5893-4a8d-b949-491425961aed"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:08.938742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:08.939342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:08.940515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:08.953004 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] Creating event network-vif-deleted:2119ae50-5893-4a8d-b949-491425961aed for instance 2f096d78-7ead-4402-bc29-c91454491257 on n-h2-858495-2 Sep 23 04:31:08.958640 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-72a07995-256e-4c09-81aa-9aa774694366 req-0eb844d3-9504-4c7d-a20d-168c278cae36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037289 Sep 23 04:31:08.959495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3312/6558] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:09.190713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:09.191559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:09.198457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:09.198979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:09.199447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:09.200216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:09.200703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:09.201158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:09.238401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:09.238922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:09.239389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:09.239871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lazy-loading 'fault' on Instance uuid 2f096d78-7ead-4402-bc29-c91454491257 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:09.282972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:09.292096 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc79fbcd-b490-4f15-983d-fbb3334a1362 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 200 len: 1355 microversion: 2.1 time: 0.105241 Sep 23 04:31:09.292720 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3247/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:09 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:10.316081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:10.316813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 2f096d78-7ead-4402-bc29-c91454491257] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:10.323848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.324327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.324762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.325485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.325944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.326370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.339552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] HTTP exception thrown: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Request method failure captured: Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 HTTP/1.1 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTVDxP1tPrvtvarx50dHt1SV-31nRvuZp9W9UVzgwK_PTsCLxPAb7zLfOklDDHstaA0yVqu5iO79JMhRm6WVLEZ7AYJQRANaBeauhU5dN2hQc4Bfg4OgDChzYXPP40SCIT58M9RYb6ZbsTJyR6KCEMSInPUntxoPqTMKRTVqjwmGvco Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 65ffb703d321467db51326505107a168 Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2f096d78-7ead-4402-bc29-c91454491257'} Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:31:10.341151 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Returning 404 to user: Instance 2f096d78-7ead-4402-bc29-c91454491257 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-667b1283-ddb0-4b40-9534-1e7e4363012d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257" status: 404 len: 111 microversion: 2.1 time: 0.030809 Sep 23 04:31:10.345044 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3313/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:10 2022] GET /compute/v2.1/servers/2f096d78-7ead-4402-bc29-c91454491257 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:13.901268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9be9fdfb-8106-43b7-b2ad-efe34ed19be2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '.version_select at 0x7f0c8aaccd30>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:13.909334 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9be9fdfb-8106-43b7-b2ad-efe34ed19be2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [1fa0ad32-b2c2-4c5c-943b-934eb6a3b0c4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:31:14.918587 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [None req-9be9fdfb-8106-43b7-b2ad-efe34ed19be2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [1fa0ad32-b2c2-4c5c-943b-934eb6a3b0c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50582. Sep 23 04:31:14.939642 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9be9fdfb-8106-43b7-b2ad-efe34ed19be2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1070327804" status: 202 len: 0 microversion: 2.1 time: 1.043260 Sep 23 04:31:14.940268 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3248/6561] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Sep 23 04:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1070327804 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:14.977341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: .version_select at 0x7f0c89fde3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1130766783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCZGc/sgE4ONgFFUOgwS2QOeIEx/UokV3F11O9B5R6eyfVWLMYewrOxxPNe1kWYOUZqesH1s8m1GgUWE8yZ6pqWJjYCxdUabcmdKFR8rL0pbU3FVayO+TC2Nweuu2pmxw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:14.994563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:14.999593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:15.012954 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:31:16.020172 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50586. Sep 23 04:31:16.035900 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d8280f37-7562-4d4a-8692-fddc1b930b4e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.062642 Sep 23 04:31:16.036558 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3314/6562] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:31:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:21.554114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:21.561473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1091875898", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "6efac829-1e8f-416f-ba05-89a6f3490be5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1130766783", "security_groups": [{"name": "tempest-secgroup-smoke-381996083"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:21.679387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] validate_networks() for [('6efac829-1e8f-416f-ba05-89a6f3490be5', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:31:22.222769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:31:22.223105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:31:22.223647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:31:22.224093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:31:22.224442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:31:22.235283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:22.236121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:22.236418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:22.237409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:22.237896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:22.238350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:22.268870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:22.276942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:22.291250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:31:22.293662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:31:22.361557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b33a1e50-b4e8-46de-a5e3-6b5c23ea3d0a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810721 Sep 23 04:31:22.362466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3249/6563] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:31:22.374336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46cf26bb-b2af-4758-ad57-03706e35ad33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:22.374967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46cf26bb-b2af-4758-ad57-03706e35ad33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:22.379152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=18 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:22.453502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46cf26bb-b2af-4758-ad57-03706e35ad33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:22.465461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46cf26bb-b2af-4758-ad57-03706e35ad33 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1267 microversion: 2.1 time: 0.095584 Sep 23 04:31:22.466982 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3315/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:22 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:23.488508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:23.489155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:23.497957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.498785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.499482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.500697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.501454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.502140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.583452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:23.592292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7886c571-ce61-4e51-8f51-0a3686109f87 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1337 microversion: 2.1 time: 0.107947 Sep 23 04:31:23.592898 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3250/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:23 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:24.616361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:24.616970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:24.624460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:24.625141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:24.625678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:24.626446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:24.626921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:24.627360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:24.770072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:24.778748 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c02718b-0fac-42e3-9236-7649bfe7dabc tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.166398 Sep 23 04:31:24.780132 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3316/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:24 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:25.150625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:25.161490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.162051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.162512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.174765 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] Creating event network-changed:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h1-858495-2 Sep 23 04:31:25.179874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-74dbb0a4-6af5-4cf2-a140-911acb2490f2 req-93f0a195-da25-4b1c-b5dd-4b1a9f01e883 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110001 Sep 23 04:31:25.180655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3251/6567] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:25.803849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:25.804464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:25.811481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.811969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.812414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.813216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.814309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.814759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.948721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:25.956514 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5eb8172-6915-4416-85ae-1e7a2c384196 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.156639 Sep 23 04:31:25.957103 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3317/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:25 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:26.981332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:26.982103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:26.988372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:26.988876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:26.989337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:26.990071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:26.990548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:26.991001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:27.123668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:27.131959 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-646c4315-1047-4524-9c0d-e6065b769ec1 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.155825 Sep 23 04:31:27.132540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3252/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:26 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:28.155183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.155800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:28.163164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.163657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.164106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.164812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.165270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.165766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.298612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:28.307598 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d4d1aab7-20e5-43ae-a75d-b772ed0e2080 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.155683 Sep 23 04:31:28.308173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3318/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:29.330878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.331546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:29.338853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.339365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.339832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.340556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.341031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.341518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.487205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:29.495000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b90f0dd5-0dd7-477b-8f65-488cb71acb31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.168732 Sep 23 04:31:29.495573 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3253/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:29 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:29.892365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "name": "network-vif-plugged", "status": "completed", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:29.902258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.902742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.903180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.914802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] Creating event network-vif-plugged:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h1-858495-2 Sep 23 04:31:29.919947 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a70ad53a-51f6-4f59-b54d-ecb5c4e8f705 req-738406bf-1eda-401b-84aa-86c46e6a86bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100026 Sep 23 04:31:29.920502 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3319/6572] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:30.518791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:30.519411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:30.526328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:30.526828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:30.527284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:30.527990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:30.528464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:30.528908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:30.660463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:30.668149 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5360fcbe-59cf-4fd7-8ca5-78f85fd602ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1392 microversion: 2.1 time: 0.153837 Sep 23 04:31:30.668753 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3254/6573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:30 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:31.692841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:31.693576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:31.699818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.700305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.700747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.701486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.701950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.702379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.830515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:31.838416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f3452b84-872f-4e7b-b613-8763a1eb7eb4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1563 microversion: 2.1 time: 0.151399 Sep 23 04:31:31.838990 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3320/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:31 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:31.861250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:31.861930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:31.868703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.869214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.869715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.870449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.870973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.871436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.005293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.013197 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8953e3fa-ee53-4d9a-b8e0-589b4efb6a45 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1563 microversion: 2.1 time: 0.155812 Sep 23 04:31:32.013809 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3255/6575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:31 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:33.565280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.566041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:33.567473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.569524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:33.572959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:33.574395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.574961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.575470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.576243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.576719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.577133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.582876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:33.590472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.591214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.591838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.604097 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] Creating event network-changed:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h1-858495-2 Sep 23 04:31:33.609177 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0708089c-e575-441a-97c5-693b790a942d req-16f3fad8-5584-458e-8b13-918a4ab828df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045429 Sep 23 04:31:33.610244 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3256/6576] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:33.729449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:33.738414 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-088ebbaa-fcfc-4938-8c6b-bda2b79369b8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1563 microversion: 2.1 time: 0.177336 Sep 23 04:31:33.739476 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3321/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:33 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:57.055960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:57.056720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=36 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:57.061041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:57.063404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:57.070739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.071247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.071711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.072428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.072905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.073403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.126139 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14c127cc-2989-449f-ae23-48f711f61966 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action" status: 200 len: 24571 microversion: 2.1 time: 0.072108 Sep 23 04:31:57.126816 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3257/6578] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:31:57 2022] POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:08.184350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:08.184917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:08.187184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:08.188048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=32 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:08.194472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.194961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.195398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.196093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.196552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.196979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.326204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:08.334663 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2436bf7c-bf8e-4869-8314-c4f10722430a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1682 microversion: 2.1 time: 0.153689 Sep 23 04:32:08.335112 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3322/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:08 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:08.429961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:08.432229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:08.435278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:08.435875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:08.444966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.445501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.445965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.446682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.447156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.447606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.503886 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b049e007-a8fd-441d-88a1-608eef086d04 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action" status: 200 len: 32640 microversion: 2.1 time: 0.078635 Sep 23 04:32:08.504540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3258/6580] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:08 2022] POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action => generated 32640 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:08.667317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:08.667928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:08.674023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.674522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.674972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.675677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.676146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.676586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.811189 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f09ccca5-a3f8-430b-bc98-ac7406e1d326 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1833 microversion: 2.1 time: 0.147517 Sep 23 04:32:08.811783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3323/6581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:08 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:08.842863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:08.845468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:08.852726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.853268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.853763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.854486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.854962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.855414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.881684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lazy-loading 'flavor' on Instance uuid 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:08.893889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Going to try to live migrate instance to another host {{(pid=128723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:32:10.348795 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-23a51e1b-edf8-4818-9a4f-a8a18671c9b3 tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action" status: 202 len: 0 microversion: 2.1 time: 1.510132 Sep 23 04:32:10.352832 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3259/6582] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:08 2022] POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:10.360039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.360703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:10.367647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.368140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.368586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.369302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.370026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.370491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.508874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:10.517004 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be068deb-5cd0-4a5f-b167-ce5113a87d98 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.162066 Sep 23 04:32:10.517628 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3324/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:11.543295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.543926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:11.550300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.550805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.551259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.551968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.552952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.553516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.740746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.748728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b4d7a32-0be3-4b4b-8c5a-0fc50cabd054 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.210704 Sep 23 04:32:11.749327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3260/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:11.805039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "name": "network-vif-unplugged", "status": "completed", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:11.816290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.816760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.817197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.830366 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] Creating event network-vif-unplugged:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h1-858495-2 Sep 23 04:32:11.836210 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b7b4a393-75e5-4bb3-a4df-256e24f1c16f req-39498e5c-9561-469d-a02c-ba1a6bb29633 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035532 Sep 23 04:32:11.836847 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3325/6585] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:12.772859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.773434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:12.780245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.780749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.781204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.781941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.782413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.782859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.917442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:12.925244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd0e2c2f-e696-402f-a7c5-be054e23596e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.157048 Sep 23 04:32:12.925853 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3261/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:13.881245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:13.890871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:13.891375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:13.891816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:13.903605 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] Creating event network-changed:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h1-858495-2 Sep 23 04:32:13.908678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-db4d6190-c2f7-4294-b9cf-d3349f8db7c3 req-d8ca91cc-ec85-474c-8133-2cdfff68b81c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032936 Sep 23 04:32:13.909406 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3326/6587] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:13.948785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.949550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:13.956391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:13.956973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:13.957527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:13.959211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:13.959806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:13.960262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:14.091788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:14.099701 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab237c27-1e03-4ce9-912b-7b1f640b922d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.154741 Sep 23 04:32:14.100286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3262/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:13 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.124980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.125827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:15.131979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:15.132467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:15.132943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:15.133671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:15.134138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:15.134571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:15.280429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:15.288949 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-03fc18b7-bd94-4925-8d56-6fb095435fae tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.168962 Sep 23 04:32:15.289484 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3327/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:16.311529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.312109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:16.319052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.319555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.320019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.320733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.321214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.321695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.455078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:16.463539 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ea0141a-e813-4ced-95d2-a2bbc5e67cc3 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.156017 Sep 23 04:32:16.464130 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3263/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:16 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:17.487668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:17.488305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:17.495349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.495837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.496278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.496978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.497480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.497917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.626411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:17.634884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5516e2e-78cb-45b4-8890-eaf6099d4e2e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.151222 Sep 23 04:32:17.635475 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3328/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:17 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:18.657912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:18.658543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:18.666066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:18.666569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:18.667023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:18.667742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:18.668207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:18.668649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:18.801525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:18.809307 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-694075c8-52fa-4876-8581-e111f5916b24 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.155283 Sep 23 04:32:18.809916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3264/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:18 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:19.834939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:19.835574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:19.842819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.843339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.843784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.844491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.844950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.845415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.992770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:20.000783 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-997dbe41-85ae-4d83-80a5-7fb30c4b04c2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.172239 Sep 23 04:32:20.001376 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3329/6593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:19 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:21.024763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.025541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.032372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.032885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.033385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.034100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.034584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.035043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.254783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:21.263662 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6c1dec04-ae25-4fd3-82f4-cdda19ba32d5 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1692 microversion: 2.1 time: 0.243449 Sep 23 04:32:21.264257 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3265/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:21 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:22.287419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:22.288048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.294974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.295542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.295992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.296814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.297276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.297737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.434359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.442187 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6935eb9b-f730-476e-be61-9d7be2b07501 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1682 microversion: 2.1 time: 0.158870 Sep 23 04:32:22.442763 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3330/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:22.465617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:22.466339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.473329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.473863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.474312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.475020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.475493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.475937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.605931 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e3bec603-9691-4122-afe9-36648224ca1a tempest-TestNetworkAdvancedServerOps-1728478308 tempest-TestNetworkAdvancedServerOps-1728478308-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1833 microversion: 2.1 time: 0.143892 Sep 23 04:32:22.606565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3266/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1833 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:22.632363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:22.632994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.639030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.639535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.640013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.640709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.641161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.641709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.778444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.786266 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-40de7380-2b69-43a6-b48a-1876ca96fdcf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1682 microversion: 2.1 time: 0.158926 Sep 23 04:32:22.787006 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3331/6597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:22.883353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:22.885672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.892131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.892665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.893156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.894015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.894425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.894907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.956199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2fb75b37-79ec-41a8-b3b8-18b191c05bc0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action" status: 200 len: 38627 microversion: 2.1 time: 0.077391 Sep 23 04:32:22.956856 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3267/6598] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:22 2022] POST /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152/action => generated 38627 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:23.930284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:23.932100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:23.934951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:23.943549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.944771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.946243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.947883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.948827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.950438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.955058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.955946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.956770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.976297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] Creating event network-changed:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h2-858495-2 Sep 23 04:32:23.982025 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6f6eaab7-dae1-4228-af33-c27372dcd64b req-443912f3-de54-45bc-9ea1-d186e40cfe0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055011 Sep 23 04:32:23.982764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3268/6599] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:23.995152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:32:24.084724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a6d833c-8d12-442b-a136-0d55e1b729c8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 204 len: 0 microversion: 2.1 time: 0.161085 Sep 23 04:32:24.085329 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3332/6600] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:23 2022] DELETE /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:24.095457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:24.096190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:24.103444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.103960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.104424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.105154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.106330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.106790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.270341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:24.278685 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3236f73b-0f19-4903-9b63-23cb7b1137c0 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1688 microversion: 2.1 time: 0.188369 Sep 23 04:32:24.279276 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3269/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:24 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:25.303154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:25.304100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:25.311060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.311544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.311985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.312690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.313154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.313644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.378736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:25.387939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b86cf72-e843-40fd-9dd6-9e19c098e1c6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 200 len: 1502 microversion: 2.1 time: 0.089224 Sep 23 04:32:25.389525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3333/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:25 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 1502 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:25.997838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c3ba9f-5dc3-4c57-8e00-88a921bd5152", "name": "network-vif-deleted", "tag": "03804b45-0644-4bd1-b468-58b332309f24"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:26.008323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.008818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.009273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.020127 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] Creating event network-vif-deleted:03804b45-0644-4bd1-b468-58b332309f24 for instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 on n-h2-858495-2 Sep 23 04:32:26.025192 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cd81472a-e05d-4888-8e2e-f4af4d5e0a0a req-66e43fc3-26f3-4e5c-9e22-da08423e14a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030950 Sep 23 04:32:26.025939 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3270/6603] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:26.412514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:26.413044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 95c3ba9f-5dc3-4c57-8e00-88a921bd5152] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:26.419962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.420453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.420889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.421613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.422073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.422504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.437982 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] HTTP exception thrown: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Request method failure captured: Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 HTTP/1.1 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTVDxP1tPrvtvarx50dHt1SV-31nRvuZp9W9UVzgwK_PTsCLxPAb7zLfOklDDHstaA0yVqu5iO79JMhRm6WVLEZ7AYJQRANaBeauhU5dN2hQc4Bfg4OgDChzYXPP40SCIT58M9RYb6ZbsTJyR6KCEMSInPUntxoPqTMKRTVqjwmGvco Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 65ffb703d321467db51326505107a168 Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '95c3ba9f-5dc3-4c57-8e00-88a921bd5152'} Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.439641 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Returning 404 to user: Instance 95c3ba9f-5dc3-4c57-8e00-88a921bd5152 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1987c9e4-81d0-43d6-984c-1fbb3e2be018 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152" status: 404 len: 111 microversion: 2.1 time: 0.032685 Sep 23 04:32:26.444535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3334/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:26 2022] GET /compute/v2.1/servers/95c3ba9f-5dc3-4c57-8e00-88a921bd5152 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:29.677917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8495c5a6-5bf0-442d-b24a-205aa4f7a01e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '.version_select at 0x7f0c8a38d8b0>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.699131 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8495c5a6-5bf0-442d-b24a-205aa4f7a01e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1130766783" status: 202 len: 0 microversion: 2.1 time: 0.026295 Sep 23 04:32:29.699743 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3271/6605] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Sep 23 04:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1130766783 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:29.734565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1dede268-5950-499f-a889-9784bb108d66 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: .version_select at 0x7f0c8a2e9ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-456637189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR4eWLUBQDybh/qAVMgtHw7r4qT7RtmO46gYRxK46rp5C118yh+bhhp+BDax0P+ZIDx3ZaMzjRPeXUrUBWrqLmmCjQpuZvxkkmjUMj8iNtjAMMEKHg4uFflxiFcqCKOiw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:29.750718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-1dede268-5950-499f-a889-9784bb108d66 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:29.757119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-1dede268-5950-499f-a889-9784bb108d66 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:29.782130 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1dede268-5950-499f-a889-9784bb108d66 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051804 Sep 23 04:32:29.782854 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3335/6606] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:32:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:35.754139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-11956920", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "aa43bb36-fbf6-47c9-85d7-38ba73ba0363"}], "key_name": "tempest-TestNetworkAdvancedServerOps-456637189", "security_groups": [{"name": "tempest-secgroup-smoke-117614470"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:35.875000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] validate_networks() for [('aa43bb36-fbf6-47c9-85d7-38ba73ba0363', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:36.015025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:36.338132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:36.338585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:36.339086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:36.339522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:36.339965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:36.349091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.349640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.350036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.350793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.351268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.351718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.370209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:36.375578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Getting quotas for user 65ffb703d321467db51326505107a168 and project e31ac3e027834a5fbf68c1631137c22a. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:36.388830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:36.391306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:36.447401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5f074578-d24f-4b2c-9a79-6a833b97ee4a tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699236 Sep 23 04:32:36.448944 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3272/6607] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:36.458457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:36.462940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-71c2bc84-7455-4f3a-832f-4137766a112b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:36.464488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-71c2bc84-7455-4f3a-832f-4137766a112b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:36.534982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-71c2bc84-7455-4f3a-832f-4137766a112b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:36.544384 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-71c2bc84-7455-4f3a-832f-4137766a112b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1264 microversion: 2.1 time: 0.088070 Sep 23 04:32:36.545249 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3336/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:36 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:37.573027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:37.573835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:37.588396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:37.589498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:37.590460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:37.591581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:37.592288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:37.592948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:37.662779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:37.671237 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1a5f1ca2-15e3-4d90-a297-83423ba4ee26 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1322 microversion: 2.1 time: 0.106947 Sep 23 04:32:37.671842 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3273/6609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:37 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1322 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:38.699624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:38.700257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:38.702261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:38.709100 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.709636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.710127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.710858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.711326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.712581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.859223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.867498 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ec57607-f191-407a-88cc-907d398ae7a7 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.175509 Sep 23 04:32:38.868515 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3337/6610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:38 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:39.161563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:39.167756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:39.174443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.175164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.175613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.189821 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] Creating event network-changed:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:32:39.196471 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-28a71ec3-4ea8-4b96-b9f1-2affc26f291a req-4a99d1ae-538c-4920-a2bb-fabc908534f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038818 Sep 23 04:32:39.197675 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3274/6611] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:39.890822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:39.891627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:39.900373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.900856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.901298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.902017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.902476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.902907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.038115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:40.045886 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47a13844-a5b0-4f7d-b3bd-13c803bd89a2 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.158939 Sep 23 04:32:40.050477 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3338/6612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:39 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:41.073929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:41.074659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:41.081001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:41.081561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:41.082147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:41.083021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:41.083505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:41.083960 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:41.218945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:41.227383 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-989566b7-b40d-46c5-8947-0c07a4821417 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.158946 Sep 23 04:32:41.227989 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3275/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:41 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:42.250155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:42.250776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:42.258321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.258812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.259264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.259977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.260440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.260876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.395256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:42.402976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fbf302af-9146-40de-ab1d-883ce65b478c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.156808 Sep 23 04:32:42.403552 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3339/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:42 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:43.426480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:43.427160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:43.434076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:43.434582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:43.435035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:43.435744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:43.436215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:43.436660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:43.575348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:43.583411 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0de76a22-b49b-4a78-91b5-5b5c7b69e08b tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.160966 Sep 23 04:32:43.583987 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3276/6615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:43 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:44.198779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "name": "network-vif-plugged", "status": "completed", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:44.209042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.209565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.210010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.221506 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] Creating event network-vif-plugged:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:32:44.226986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1d112e5b-678b-45c9-a1d1-921a9f3b916e req-55957bea-9143-445a-88e7-574b701f71f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Sep 23 04:32:44.227579 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3340/6616] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:44.606591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.607230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:44.614140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.614647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.615106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.615829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.616311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.616760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.744313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:44.752132 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30d5dce8-68e9-4b01-8ff1-515771b29291 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1389 microversion: 2.1 time: 0.149468 Sep 23 04:32:44.752714 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3277/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:44 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:45.785009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:45.785688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:45.791841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.792332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.792777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.793501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.793966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.794402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.926409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:45.935284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f184a22-138c-4363-a2d6-a7c24d814c40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1560 microversion: 2.1 time: 0.155466 Sep 23 04:32:45.935992 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3341/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:45 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:45.958873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:45.959517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:45.966451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.966955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.967413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.968129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.968606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.969064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:46.102715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:46.110502 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d5e134bc-9162-4f00-93b8-8c41d4a270f6 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1560 microversion: 2.1 time: 0.155835 Sep 23 04:32:46.111088 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3278/6619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:45 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:47.685745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:47.692680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:47.697715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:47.698407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:47.701546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:47.703733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:47.710291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.710790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.711234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.711950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.712414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.712851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.718282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.718787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.719242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.731192 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] Creating event network-changed:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:32:47.737007 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3c1aed7d-4ee3-4d37-bd2a-6c64ac4f399d req-f6a844a0-55d1-4da0-9424-f5316b76b1ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049107 Sep 23 04:32:47.737937 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3279/6620] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:47.862738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:47.871873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a97d3da9-7e5c-403e-a63c-6c85a5ce99ab tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1560 microversion: 2.1 time: 0.190535 Sep 23 04:32:47.872867 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3342/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:47 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:11.163205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=11 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:11.164154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=36 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:11.168842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:11.171163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:11.179689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.180195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.180651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.181384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.181894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.182343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.240745 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f29367b-9ac1-4ba8-baf6-261cdea4bf40 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action" status: 200 len: 24563 microversion: 2.1 time: 0.079856 Sep 23 04:33:11.241489 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3280/6622] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:11 2022] POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action => generated 24563 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:33:22.209505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:22.212241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.214256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=11 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:22.214953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=32 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:22.215828 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:33:22.215971 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action (ip 10.222.0.25) !!! Sep 23 04:33:22.225198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.225656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.226103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.226813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.227276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.227706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.308304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:22.308725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:22.309197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:22.309633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:22.310041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:22.369651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.375594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.376080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.376684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.377244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.377735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.378158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.407658 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-25bef166-a0d5-4945-b445-9f0d8f9be9ec tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action" status: 202 len: 1135 microversion: 2.1 time: 0.202760 Sep 23 04:33:22.408342 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3343/6623] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:22 2022] POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action => generated 1135 bytes in 204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 04:33:22.435493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:22.436237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.438870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:22.439552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:22.445989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.446502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.446972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.447827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.448450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.448922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.590781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:22.599382 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68c8b47b-1a5f-4b2d-9f13-fa4a2a8d69cb tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.173883 Sep 23 04:33:22.599975 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3281/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:22 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.623464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.624086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:23.631174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.631664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.632109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.632813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.633278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.633741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.770592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:23.778502 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-533a5e9b-cc13-4cdf-bf0d-1238e00a9a22 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.158956 Sep 23 04:33:23.779297 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3344/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:24.802499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:24.803056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:24.810056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.810561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.811023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.811734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.812216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.812665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.942399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:24.950417 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6c94aea3-19a0-4eb4-b181-686cc6a1fa31 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.152009 Sep 23 04:33:24.951009 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3282/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:24 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:25.974986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:25.975444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:25.982524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:25.983007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:25.983445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:25.984132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:25.984586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:25.985016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.122683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.130449 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7b277a3a-7ad9-425e-ad83-308eaf2501d4 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.160051 Sep 23 04:33:26.131026 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3345/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:25 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:27.153313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.153969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.160844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.161375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.161852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.162562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.163033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.163485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.291030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:27.298893 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e0ca7e3d-942b-47d2-89a4-fe76653bee9e tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.149524 Sep 23 04:33:27.299460 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3283/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:28.323205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.323716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:28.330695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.331186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.331901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.332601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.333752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.334188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.475203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:28.482919 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f831ca9c-d270-4e61-9b58-8f46d0f69f5c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.163766 Sep 23 04:33:28.483499 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3346/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:28 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:29.507184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:29.507821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:29.514856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.515361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.515817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.516537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.517016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.517520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.645267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:29.654048 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f24a2883-48be-4fb4-93b2-d47a7c9debac tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.151472 Sep 23 04:33:29.654630 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3284/6630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:29 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:30.677818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.678435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:30.684789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.685281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.685753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.686453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.686917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.687353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.815696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:30.823976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e69b967-1966-4781-83e4-257265e723d9 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.150775 Sep 23 04:33:30.824550 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3347/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:30 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:31.848717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.849279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.856211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.856722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.857190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.857959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.858430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.858885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.992982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:32.000795 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88697d40-5eb5-4238-b552-dfc4634b2d79 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.156733 Sep 23 04:33:32.001392 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3285/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:33.023908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:33.024422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:33.031523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.032002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.032438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.033127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.033612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.034040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.162001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:33.169659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6bd71f0-21ec-4a37-84a8-b442eb2a289c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1688 microversion: 2.1 time: 0.149740 Sep 23 04:33:33.170235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3348/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:33 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:34.193650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:34.194297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:34.202773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.203559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.204018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.204773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.205239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.205744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.343130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:34.351337 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b7f36e2-0ef7-441a-be46-1614a0139adf tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1694 microversion: 2.1 time: 0.162512 Sep 23 04:33:34.351916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3286/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:34 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:35.375080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:35.375699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:35.383324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.383821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.384267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:35.384976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.385463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.385898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:35.519820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:35.528006 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bfc4aab2-2a3d-4dd6-8252-342a2cf74b8c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1694 microversion: 2.1 time: 0.156898 Sep 23 04:33:35.528585 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3349/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:35 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:36.551533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:36.552888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:36.560100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.560620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.561089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.561856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.562343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.562831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.694793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:36.702702 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e9f52b1-b87d-44a1-b457-2bee60bf4a3d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1679 microversion: 2.1 time: 0.155320 Sep 23 04:33:36.703288 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3287/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:36 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:38.497488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "name": "network-vif-plugged", "status": "completed", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:38.511515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:38.512035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:38.512476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:38.524439 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] Creating event network-vif-plugged:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:33:38.530299 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9ebde4b7-f841-4ceb-a919-5204b4da030b req-f0a6987f-c1d2-45c5-be92-79c0d4013695 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036492 Sep 23 04:33:38.531236 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3350/6637] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:02.914231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:02.916418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:02.918665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:02.919342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=42 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:02.925167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.925709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.926169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.927457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.927929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.928374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.979097 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ccaae9e5-b3a4-4d9c-8228-0e92c8986d91 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action" status: 200 len: 24574 microversion: 2.1 time: 0.068906 Sep 23 04:34:02.979961 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3288/6638] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:02 2022] POST /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:34:10.473430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:10.478035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:10.479202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:10.481611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=20 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:10.482453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:10.488677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:10.489168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:10.489675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:10.491086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:10.491547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:10.491656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:10.491980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:10.492134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:10.492790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:10.506679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] Creating event network-changed:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:34:10.512441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bd4b5471-260d-4167-b059-80f209cdd63e req-f2b47593-a5c2-4345-8c7f-4fc0a5740ddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037004 Sep 23 04:34:10.513343 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3289/6639] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:10.523280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:34:10.609418 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72b94dbd-8b4c-4941-a9e4-6eb01e2d001c tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 204 len: 0 microversion: 2.1 time: 0.139657 Sep 23 04:34:10.610251 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3351/6640] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:10 2022] DELETE /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:10.619816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:10.621015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:10.629553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:10.630254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:10.631477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:10.632364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:10.632900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:10.633587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:10.776590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:10.784434 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7db4c867-3700-42a7-b004-e476b835949d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1685 microversion: 2.1 time: 0.169678 Sep 23 04:34:10.785227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3290/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:10 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:11.809876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:11.810588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:11.817448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.817939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.818875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.819575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.820072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.820502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.954360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ffb703d321467db51326505107a168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ac3e027834a5fbf68c1631137c22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:11.962684 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e4107ed-57a8-4cf7-8aee-612a43c3140d tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 200 len: 1685 microversion: 2.1 time: 0.157050 Sep 23 04:34:11.963291 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3352/6642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:11 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:12.498443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fabe9b-79ec-4c17-9247-260d1c882240", "name": "network-vif-deleted", "tag": "d7164ae0-7a7d-489b-916a-dacc456dda9c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:12.510369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.510789 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.511235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:12.524352 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] Creating event network-vif-deleted:d7164ae0-7a7d-489b-916a-dacc456dda9c for instance 19fabe9b-79ec-4c17-9247-260d1c882240 on n-h1-858495-2 Sep 23 04:34:12.530076 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-80ca2752-a292-499a-86e5-cd5c893ca3c0 req-523c0e1d-ae2a-4c0d-bce0-35c2771fdf3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035407 Sep 23 04:34:12.531014 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3291/6643] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:12.988090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:12.988699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] [instance: 19fabe9b-79ec-4c17-9247-260d1c882240] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:12.995481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.995961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.996396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:12.997098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.997581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.998008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:13.013433 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] HTTP exception thrown: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Request method failure captured: Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 HTTP/1.1 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTVDxP1tPrvtvarx50dHt1SV-31nRvuZp9W9UVzgwK_PTsCLxPAb7zLfOklDDHstaA0yVqu5iO79JMhRm6WVLEZ7AYJQRANaBeauhU5dN2hQc4Bfg4OgDChzYXPP40SCIT58M9RYb6ZbsTJyR6KCEMSInPUntxoPqTMKRTVqjwmGvco Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e31ac3e027834a5fbf68c1631137c22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: e31ac3e027834a5fbf68c1631137c22a Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1902985093 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 65ffb703d321467db51326505107a168 Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1902985093-project Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '19fabe9b-79ec-4c17-9247-260d1c882240'} Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:13.015064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Returning 404 to user: Instance 19fabe9b-79ec-4c17-9247-260d1c882240 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4fb46028-6ed4-4c89-8469-74891d47c0d8 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240" status: 404 len: 111 microversion: 2.1 time: 0.032671 Sep 23 04:34:13.019016 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3353/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:12 2022] GET /compute/v2.1/servers/19fabe9b-79ec-4c17-9247-260d1c882240 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:15.960106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-62dc3921-21f4-4e72-9471-80e634b16377 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] Calling method '.version_select at 0x7f0c8aa92280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:15.981266 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-62dc3921-21f4-4e72-9471-80e634b16377 tempest-TestNetworkAdvancedServerOps-1902985093 tempest-TestNetworkAdvancedServerOps-1902985093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-456637189" status: 202 len: 0 microversion: 2.1 time: 0.026098 Sep 23 04:34:15.981919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3292/6645] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Sep 23 04:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-456637189 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:34:27.661062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:27.661930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:27.771060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2113292644", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:27.822560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] validate_networks() for None {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:34:28.023119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:28.023547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:28.024022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:28.024428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:28.024837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:28.033698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.034188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.034625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.035350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.035806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.036765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.053982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Getting quotas for project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:28.059551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Getting quotas for user 4d70037bf77a47ffa623c91e5d39015d and project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:28.072323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:34:28.074595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:34:28.119905 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13ac76bf-31c2-40d2-81f0-6c5e132edd86 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464339 Sep 23 04:34:28.120663 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3354/6646] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:34:28.131281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:28.132156 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:28.136722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bb894a3-9d11-4b7e-abb3-eb4ee57433e9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.137545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bb894a3-9d11-4b7e-abb3-eb4ee57433e9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:28.196389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bb894a3-9d11-4b7e-abb3-eb4ee57433e9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.203549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bb894a3-9d11-4b7e-abb3-eb4ee57433e9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1222 microversion: 2.1 time: 0.074063 Sep 23 04:34:28.204141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3293/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:29.231864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:29.232398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:29.239670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.240157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.240595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.241282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.241769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.242201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.304659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:29.312494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1525b4bc-6b5f-4613-93bf-490ea4e936a9 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1274 microversion: 2.1 time: 0.086530 Sep 23 04:34:29.313061 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3355/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:29 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:30.337993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:30.339137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:30.346193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.346697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.347155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.347879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.348353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.348875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.575599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:30.584164 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fd2d01b-f6b0-4983-a116-edd5ff6e10cc tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.250129 Sep 23 04:34:30.584747 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3294/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:30 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:30.941202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1", "tag": "a6db1b9d-595a-41b4-84e1-6c845ca48fa6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:30.951996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.952554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.952729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.965179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] Creating event network-changed:a6db1b9d-595a-41b4-84e1-6c845ca48fa6 for instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 on n-h2-858495-2 Sep 23 04:34:30.970216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fd20ae64-57bc-4c2f-8548-5e9769280409 req-b1106901-9a3a-42d4-ada4-6e0e00190703 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Sep 23 04:34:30.970817 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3356/6650] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:31.607171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:31.607923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:31.615525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:31.616030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:31.616492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:31.617210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:31.617714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:31.618163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:31.772881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:31.780699 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-178e8c59-66d9-4505-9012-c11e6b703f32 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.177509 Sep 23 04:34:31.781286 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3295/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:31 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:32.805461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:32.806162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:32.812431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.812915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.813373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.814066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.814519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.814974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.940594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:32.948290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a319d5e7-853f-46d9-861e-bdffc49773d8 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.148481 Sep 23 04:34:32.948867 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3357/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:32 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:33.971883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.972531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:33.980271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.980764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.981230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.981987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.982474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.982926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.197869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.206748 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fba5871f-2708-4e96-b483-69ed3450cfdf tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.238951 Sep 23 04:34:34.208296 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3296/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:33 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:35.230508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.231136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:35.238083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.238575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.239027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.239726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.240193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.240636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.372404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:35.380707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2b6985f4-930b-4202-8d62-eab9aa15b383 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.154036 Sep 23 04:34:35.381316 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3358/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:36.404435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.405030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.412430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.412932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.413412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.414130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.414606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.415057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.542049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.549800 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-144ef870-6681-4037-8413-57d054f80849 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.149343 Sep 23 04:34:36.550387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3297/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:37.573049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.573685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:37.580742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.581225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.581772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.582557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.583015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.583444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.823781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.825339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1", "name": "network-vif-plugged", "status": "completed", "tag": "a6db1b9d-595a-41b4-84e1-6c845ca48fa6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:37.832872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a84f5e68-20d2-49e3-84cb-6615ff19eefd tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.263673 Sep 23 04:34:37.833625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3359/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:37.852557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.853058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.853545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.865505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] Creating event network-vif-plugged:a6db1b9d-595a-41b4-84e1-6c845ca48fa6 for instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 on n-h2-858495-2 Sep 23 04:34:37.870935 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-7612df08-0b46-4b44-afec-590e1b259c9a req-bf6ad7b5-edae-40c7-938f-659884aeb43c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049580 Sep 23 04:34:37.871544 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3298/6657] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:38.855319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:38.855968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:38.857950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:38.858616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:38.866152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.866640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.867086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.867791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.868254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.868687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.002531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:39.010804 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3cfa919d-e2a0-4099-8cf6-15df2d04fe11 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1322 microversion: 2.1 time: 0.159369 Sep 23 04:34:39.011379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3360/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:38 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:40.030700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:40.036280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.037011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.043542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.044198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.044668 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.045399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.045884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.046339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.231739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.239670 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b496854-1745-476c-bcfb-092f2b5ca55f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1471 microversion: 2.1 time: 0.210038 Sep 23 04:34:40.240248 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3299/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:40.312764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-61ba5015-5d43-4023-aa84-f29bc55f6451 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '.version_select at 0x7f0c89de79d0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.378974 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-61ba5015-5d43-4023-aa84-f29bc55f6451 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/0332fc0e5a3f4874ac752087060d2a83" status: 200 len: 371 microversion: 2.1 time: 0.117866 Sep 23 04:34:40.380100 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3361/6660] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/os-quota-sets/0332fc0e5a3f4874ac752087060d2a83 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:40.391993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bca36189-eb77-4e78-aaa5-219ff4e30515 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-563906552", "id": 417645177, "os-flavor-access:is_public": "True"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:40.409327 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bca36189-eb77-4e78-aaa5-219ff4e30515 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021049 Sep 23 04:34:40.409918 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3300/6661] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:40 2022] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:40.422015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "417645177"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:40.424280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.430818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.431309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.431752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.432453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.432918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.433382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.571687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '458e778868c94d3eaf3db0c9197cf4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0332fc0e5a3f4874ac752087060d2a83', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.577923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-563906552 {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:34:40.584792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.585278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.585747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.586488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.586951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.587387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.607106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Getting quotas for project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:40.612187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Getting quotas for user 4d70037bf77a47ffa623c91e5d39015d and project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:40.624603 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] ram quota exceeded for 0332fc0e5a3f4874ac752087060d2a83, tried to resize instance. Sep 23 04:34:40.625153 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Request method failure captured: Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action HTTP/1.1 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 38 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTdTsPulaRe-PCjUYS4CnN9Am8bUDWpLwKpEmCw1RlvCUOzt6mn_Szo90BFlbVpJV8CuggZyqIKXJ3LL7P09bxRDhkxkDN3f3h21Z1lUYeRx9LjJGzfRxEXsADP3bd9QNSqj--FyDCI_r8RGlD1ViBUIivmdC1dEaJok6RZ4HSYKljE Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 0332fc0e5a3f4874ac752087060d2a83 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Role: admin,reader,member Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: admin,reader,member Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 0332fc0e5a3f4874ac752087060d2a83 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersAdminNegativeTestJSON-1913225010-project-admin Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 458e778868c94d3eaf3db0c9197cf4d8 Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1913225010-project-admin Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: {"resize": {"flavorRef": "417645177"}} Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1', 'body': {'resize': {'flavorRef': '417645177'}}} Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:40.628734 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8dee911c-f054-4fc2-a978-040a4a6f66db tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action" status: 403 len: 118 microversion: 2.1 time: 0.212645 Sep 23 04:34:40.633392 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3362/6662] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:40 2022] POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action => generated 118 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:40.642111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13226287-cb07-4769-994b-f77d5d9ae025 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.659830 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13226287-cb07-4769-994b-f77d5d9ae025 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/417645177" status: 202 len: 0 microversion: 2.1 time: 0.022985 Sep 23 04:34:40.660427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3301/6663] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 04:34:40 2022] DELETE /compute/v2.1/flavors/417645177 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:40.668530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc229f3d-aa85-4c8f-a8c9-9c55e7e9a9c0 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.694021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc229f3d-aa85-4c8f-a8c9-9c55e7e9a9c0 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028804 Sep 23 04:34:40.694644 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3363/6664] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:40.717319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9639cf40-ad6f-4240-ba97-9ee525d5c5f2 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '.version_select at 0x7f0c8aa35310>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.792000 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9639cf40-ad6f-4240-ba97-9ee525d5c5f2 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/0332fc0e5a3f4874ac752087060d2a83" status: 200 len: 371 microversion: 2.1 time: 0.078585 Sep 23 04:34:40.792581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3302/6665] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/os-quota-sets/0332fc0e5a3f4874ac752087060d2a83 => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:40.805011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-93e05dd1-b6c3-4e5f-97e3-936b8148540f tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-813405902", "id": 208794070, "os-flavor-access:is_public": "True"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:40.822420 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-93e05dd1-b6c3-4e5f-97e3-936b8148540f tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021640 Sep 23 04:34:40.823005 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3364/6666] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:40 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:40.835115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "208794070"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:40.837586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.843724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.844241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.844708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.845473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.845961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.846425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.934918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '458e778868c94d3eaf3db0c9197cf4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0332fc0e5a3f4874ac752087060d2a83', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.941142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-813405902 {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:34:40.948121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.948624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.949081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.949858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.950330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.950779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.978923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Getting quotas for project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:40.984065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Getting quotas for user 4d70037bf77a47ffa623c91e5d39015d and project 667ea2505d034e40b6131ac0c98cfbaa. Resources: {'cores', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:40.996585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.compute.api [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] cores quota exceeded for 0332fc0e5a3f4874ac752087060d2a83, tried to resize instance. Sep 23 04:34:40.997141 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Request method failure captured: Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action HTTP/1.1 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 38 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTdTsPulaRe-PCjUYS4CnN9Am8bUDWpLwKpEmCw1RlvCUOzt6mn_Szo90BFlbVpJV8CuggZyqIKXJ3LL7P09bxRDhkxkDN3f3h21Z1lUYeRx9LjJGzfRxEXsADP3bd9QNSqj--FyDCI_r8RGlD1ViBUIivmdC1dEaJok6RZ4HSYKljE Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 0332fc0e5a3f4874ac752087060d2a83 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Role: admin,reader,member Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: admin,reader,member Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0332fc0e5a3f4874ac752087060d2a83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 0332fc0e5a3f4874ac752087060d2a83 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1913225010 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-1913225010-project-admin Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 458e778868c94d3eaf3db0c9197cf4d8 Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1913225010-project-admin Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: {"resize": {"flavorRef": "208794070"}} Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1', 'body': {'resize': {'flavorRef': '208794070'}}} Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:40.999375 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-aaebd596-cd4f-4095-934b-4a3388fc2c24 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action" status: 403 len: 113 microversion: 2.1 time: 0.169724 Sep 23 04:34:41.002728 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3303/6667] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:40 2022] POST /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1/action => generated 113 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:41.009688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9c24af2-ca66-4b0a-9bce-98524de33605 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.026077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9c24af2-ca66-4b0a-9bce-98524de33605 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/208794070" status: 202 len: 0 microversion: 2.1 time: 0.020102 Sep 23 04:34:41.026561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3365/6668] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Sep 23 04:34:41 2022] DELETE /compute/v2.1/flavors/208794070 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:41.034265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-78a62a77-85d5-4b7a-adf2-033f4ae697c0 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.059241 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-78a62a77-85d5-4b7a-adf2-033f4ae697c0 tempest-ServersAdminNegativeTestJSON-1913225010 tempest-ServersAdminNegativeTestJSON-1913225010-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028657 Sep 23 04:34:41.059810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3304/6669] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:41.080391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.080896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.086876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.087369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.087814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.088514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.088976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.089466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.116493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:34:41.190326 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0e1b462-094c-45f9-9991-9de20bf18283 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 204 len: 0 microversion: 2.1 time: 0.113678 Sep 23 04:34:41.191117 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3366/6670] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:41 2022] DELETE /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:41.199757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.200386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.206720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.207724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.208184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.208889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.209378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.209831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.341642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.350229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5ebac5fb-06ee-4115-9e8a-7415ca37f32c tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1477 microversion: 2.1 time: 0.154672 Sep 23 04:34:41.350817 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3305/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:42.373934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:42.374588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:42.382031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.382519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.382963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.383664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.384126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.384561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.512984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:42.521611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6ff7798-ea0a-47e5-bd05-cdb9614ea2e3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1477 microversion: 2.1 time: 0.152024 Sep 23 04:34:42.522194 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3367/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:42 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:43.155846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1", "name": "network-vif-deleted", "tag": "a6db1b9d-595a-41b4-84e1-6c845ca48fa6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:43.168196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.168700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.169148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.188244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] Creating event network-vif-deleted:a6db1b9d-595a-41b4-84e1-6c845ca48fa6 for instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 on n-h2-858495-2 Sep 23 04:34:43.193506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8a7fb2fa-eee4-4a7f-a4ca-dc556d4754f4 req-741829b1-7ab1-44d1-8973-d2689d6b65ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043174 Sep 23 04:34:43.194165 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3306/6673] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:43.544286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:43.544904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:43.551920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.552409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.552856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.553594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.554058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.554492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.585997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.586498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.586999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.587401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lazy-loading 'fault' on Instance uuid e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:43.628272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70037bf77a47ffa623c91e5d39015d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667ea2505d034e40b6131ac0c98cfbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.636530 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c9cb3ad0-a5b6-47ab-a245-c4e05946e8c3 tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 200 len: 1312 microversion: 2.1 time: 0.096178 Sep 23 04:34:43.637114 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3368/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:43 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:44.662237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.662958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] [instance: e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:44.669221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.669754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.670214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.670947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.671422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.671869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.686109 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] HTTP exception thrown: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Request method failure captured: Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 HTTP/1.1 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTdSaYx0vuBUjPr7bRLfhKe2wH5G7bfKb--6x2ZS9ZQGPBVlJ7_aK9xlHZbX23Aqa3y3ngAr_mVwPZ8Vu6e2hSgJHK4kYK6EOqAbxXEJcZXRgGbtyp_pBWPXp1-kWrFLtSSoyYm9SHzJN0qsKutLIF0BSECzkwr6ACY-KyNzwpDS7xk Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 667ea2505d034e40b6131ac0c98cfbaa Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-552479069 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667ea2505d034e40b6131ac0c98cfbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/667ea2505d034e40b6131ac0c98cfbaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/667ea2505d034e40b6131ac0c98cfbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_667ea2505d034e40b6131ac0c98cfbaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-552479069 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 667ea2505d034e40b6131ac0c98cfbaa Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-552479069 Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersAdminNegativeTestJSON-552479069-project Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 4d70037bf77a47ffa623c91e5d39015d Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-552479069-project Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1'} Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.687761 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] Returning 404 to user: Instance e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89a8e69e-2a30-41af-8abd-55c45fc6884f tempest-ServersAdminNegativeTestJSON-552479069 tempest-ServersAdminNegativeTestJSON-552479069-project] 10.222.0.25 "GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1" status: 404 len: 111 microversion: 2.1 time: 0.032812 Sep 23 04:34:44.691876 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3307/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/servers/e1ac0278-7d5d-4f21-aa50-a7d3b548f9b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:50.430399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:50.564511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1929044842", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "577fb2df-b820-4b89-ba3c-a7e23a333649"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:50.598008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:50.620096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] validate_networks() for [('577fb2df-b820-4b89-ba3c-a7e23a333649', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:34:51.028252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:51.028684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:51.029161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:51.029616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:51.030177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:51.039666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.040306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.040754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.041546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.042006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.042614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.060528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Getting quotas for project 224659e413a64f9db4049a26656b8b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:51.066648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Getting quotas for user 8fddd15b100248abadca72e31f69768b and project 224659e413a64f9db4049a26656b8b3f. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:51.079767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:34:51.082272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:34:51.131370 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6b343ae-d5ef-4f9f-ae93-c82c3324d5e6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706234 Sep 23 04:34:51.132041 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3369/6676] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:34:51.152962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d808cf14-d0f8-45ec-b4f9-fdc5326fecb9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:51.155671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d808cf14-d0f8-45ec-b4f9-fdc5326fecb9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:51.158342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:51.164206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:51.176820 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:34:51.177112 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:34:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 (ip 10.222.0.25) !!! Sep 23 04:34:51.245410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d808cf14-d0f8-45ec-b4f9-fdc5326fecb9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.253224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d808cf14-d0f8-45ec-b4f9-fdc5326fecb9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1215 microversion: 2.1 time: 0.110512 Sep 23 04:34:51.253926 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3308/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:51 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:52.278036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:52.278722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:52.288026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.288828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.289677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.290906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.292611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.293651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.380583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:52.391579 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3e37df69-ab1b-4e4a-b532-78ce3169d342 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1275 microversion: 2.1 time: 0.118827 Sep 23 04:34:52.393400 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3370/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:52 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:53.420507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:53.422390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:53.435285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.436765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.437769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.438835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.439541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.440968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.599891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:53.613288 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be6b2b32-5789-46ce-a7a7-ea71b3efe903 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.197735 Sep 23 04:34:53.614442 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3309/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:53 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:54.104828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73941879-ecb0-4f5c-987b-690f062f58d0", "tag": "cdd4ced5-c09c-4f61-899f-45a8166f59f9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:54.135234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:54.136018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:54.136724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:54.159453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] Creating event network-changed:cdd4ced5-c09c-4f61-899f-45a8166f59f9 for instance 73941879-ecb0-4f5c-987b-690f062f58d0 on n-h1-858495-2 Sep 23 04:34:54.172033 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2ddfb8ed-f609-4e48-a3a0-e9e7721ad40d req-61d18200-bd02-438a-818c-675f75600d89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080012 Sep 23 04:34:54.173161 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3371/6680] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:54.640081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:54.640734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:54.647213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:54.647766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:54.648309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:54.650776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:54.651303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:54.651761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:54.792043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:54.800142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8e48ff5f-db31-428e-aa7a-a5ddd5f888b9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.165558 Sep 23 04:34:54.800776 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3310/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:54 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:55.824484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:55.825189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:55.831944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:55.832434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:55.832875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:55.833744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:55.834229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:55.834667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:55.967219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:55.975472 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-31fa1682-7a3f-476a-99ca-e033a595f18a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.156293 Sep 23 04:34:55.976045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3372/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:55 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:56.999062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:56.999707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:57.007439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.007948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.008410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.009133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.009640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.010115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.147209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:57.155361 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c9b99308-331e-4125-b67b-788d904498f9 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.160031 Sep 23 04:34:57.156186 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3311/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:56 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:58.180020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:58.180628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:58.183474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:58.188695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.189187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.189659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.190357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.190822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.191257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.195904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:58.320773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.328659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e1d55f22-bd33-4d5a-99e0-9c4a302b1f40 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.153273 Sep 23 04:34:58.329237 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3373/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:58 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:58.870047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73941879-ecb0-4f5c-987b-690f062f58d0", "name": "network-vif-plugged", "status": "completed", "tag": "cdd4ced5-c09c-4f61-899f-45a8166f59f9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:58.876688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:58.887692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.888196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.888641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.893656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=74 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:58.902800 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] Creating event network-vif-plugged:cdd4ced5-c09c-4f61-899f-45a8166f59f9 for instance 73941879-ecb0-4f5c-987b-690f062f58d0 on n-h1-858495-2 Sep 23 04:34:58.908838 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3db88f2f-6829-4287-bb5c-b2580f036053 req-db070272-19a0-4d5f-8c04-f754ffc51af8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043669 Sep 23 04:34:58.909602 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3312/6685] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:59.351359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:59.351897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:59.358680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.359164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.359602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:59.360290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.360745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.361172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:59.492515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:59.500218 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccfee3dc-d93a-4e6d-bc7d-06b273c481fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1315 microversion: 2.1 time: 0.152934 Sep 23 04:34:59.500786 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3374/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:59 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:00.524880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:00.525698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:00.533082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.533615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.534073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.534858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.535330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.535774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.667667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.676026 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-784e550e-e382-4623-8575-3429127e3ce6 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1503 microversion: 2.1 time: 0.155703 Sep 23 04:35:00.676612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3313/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:00 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:00.698741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:00.701077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:00.707909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.708393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.708834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.709566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.710044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.710459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.738969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.744273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:35:00.750741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:00.751165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:00.751639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:00.752048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:00.752457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:00.818026 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9a9d12b3-4043-40db-a2a8-2e6ce5589b59 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "POST /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0/action" status: 202 len: 0 microversion: 2.1 time: 0.123191 Sep 23 04:35:00.818703 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3375/6688] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:00 2022] POST /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:00.826972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:00.827608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:00.833770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.834271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.834731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.835440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.835913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.836357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:01.010868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:01.018705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-91ab6b5c-4f53-4eae-88b9-d3744afc3389 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1512 microversion: 2.1 time: 0.195581 Sep 23 04:35:01.020520 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3314/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:00 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:02.039687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:02.041025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:02.047063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:02.047696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:02.056634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:02.057137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:02.057633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:02.058373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:02.058849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:02.059289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:02.190728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.199955 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f8b0f02-4184-4e57-87e4-df86e542a4d0 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1512 microversion: 2.1 time: 0.160936 Sep 23 04:35:02.216661 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3376/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:02 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:03.225761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.226411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:03.228472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:03.234998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.235506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.235965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.236688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.237165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.238247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.370937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:03.378912 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0cd5df77-80aa-4579-a2da-3d5c186bdec1 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.157691 Sep 23 04:35:03.379496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3315/6691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:03 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:04.402115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.402691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:04.410890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.411377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.411822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.412545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.412991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.413453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.550741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.558476 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab1202c0-08fa-42b1-88f5-fce671fbb939 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.160376 Sep 23 04:35:04.559049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3377/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:04 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:05.582152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.582845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:05.589795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.590311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.590770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.591521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.591999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.592447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.019829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.027992 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f3b3b901-59a6-4ba3-91a6-24a6e9095537 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.450719 Sep 23 04:35:06.028574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3316/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:05 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:07.051309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.051933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.058794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.059310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.059754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.060450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.060910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.061368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.191831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.199564 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19454bc2-3e2a-4c91-8e88-75e44e1f992b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152226 Sep 23 04:35:07.200138 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3378/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:08.223919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.224546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.231463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.231961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.232444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.233152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.233646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.234090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.363514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:08.371220 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47f48b7c-c9c5-4c47-ace0-a8ce31569030 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.151904 Sep 23 04:35:08.371801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3317/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:08 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:09.394315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:09.394860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:09.401781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.402265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.402703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.403394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.403851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.404281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.530701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:09.539025 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0fff5a28-75fd-441f-9afd-084ee79e1b11 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.149023 Sep 23 04:35:09.539604 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3379/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:09 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:10.563421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:10.564060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:10.571604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.572110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.572572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.573291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.573795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.574246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.700669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:10.709045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52a6c2e4-e3f4-4b3d-aa60-5d60e189e83f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.149595 Sep 23 04:35:10.709674 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3318/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:10 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:11.732556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:11.733161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:11.740107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.740597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.741040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.741770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.742232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.742666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.872294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:11.880726 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0dd6423-2eec-4921-b18e-a020e50570fa tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152197 Sep 23 04:35:11.881312 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3380/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:11 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:12.904790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:12.905759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:12.913617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.914123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.914588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.915312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.915792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.916242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.042450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:13.050510 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9aca2582-778f-46dd-b30c-7d67d1215dea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.150546 Sep 23 04:35:13.051091 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3319/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:12 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:14.074108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:14.074723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:14.082034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.082519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.082958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.083654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.084111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.084543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.214568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:14.222262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d294e57a-d296-46c0-b62b-fa89ee845803 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152075 Sep 23 04:35:14.222870 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3381/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:14 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:15.245742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.246381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.253936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.254481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.254943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.255657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.256135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.256582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.387638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:15.396075 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-46a65a0e-739f-4e46-8ffd-293351f4a921 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.154350 Sep 23 04:35:15.396672 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3320/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:16.419185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:16.419714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.426523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.427018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.427468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.428177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.428642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.429082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.559440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:16.567561 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1717eb44-3dec-40ea-a79c-5b0ecf1ac667 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152419 Sep 23 04:35:16.568152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3382/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:17.591113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.591751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.598538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.599050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.599509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.600221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.600698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.601145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.727724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:17.735570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-42ef15b7-2326-47f7-a307-bd29a019ef1c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.148606 Sep 23 04:35:17.736150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3321/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:18.758798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:18.759335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:18.766001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.766478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.766915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.767604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.768581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.769007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.901435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:18.909669 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7075731-7023-437a-8d94-94de1abd347b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.154821 Sep 23 04:35:18.910246 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3383/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:18 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:19.933201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:19.933873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:19.942559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.943064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.943593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.944307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.944780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.945231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:20.088767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:20.096723 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ad317f65-7a1f-4e81-bf80-7062748f0553 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.167496 Sep 23 04:35:20.097300 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3322/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:19 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:21.120454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:21.121087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:21.127980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.128477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.128926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.129681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.130149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.130586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.265152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:21.276912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa22d3cf-afb3-496d-8306-3fe2fed66c79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.160503 Sep 23 04:35:21.277590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3384/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:21 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.300977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:22.301575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:22.308443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.308952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.309442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.310159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.310639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.311091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.440715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:22.448665 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1d221b2-c0d4-46d3-a078-86b2e6ef873f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152516 Sep 23 04:35:22.449271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3323/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:22 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:23.472708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:23.473324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:23.480194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.480680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.481143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.481862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.482317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.482745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.612521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:23.620262 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c51df9ce-2656-4141-8913-45e836cfcf79 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.152060 Sep 23 04:35:23.620843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3385/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:23 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:24.643217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.643852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.650762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.651267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.651729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.652445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.652925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.653394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.781729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:24.789609 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf58dd67-070b-4339-be4d-f1dd0462f48f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.150314 Sep 23 04:35:24.790193 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3324/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:24 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:25.812195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:25.812755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:25.820143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.820633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.821070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.821793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.822248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.822675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.955901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:25.963623 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c2e58a5-61ee-46fd-9b53-ebdb0d4191a8 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.155536 Sep 23 04:35:25.964227 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3386/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:25 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:26.986151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:26.986782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:26.994021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.994542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.995024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.995776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.996260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.996716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.124278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:27.132402 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b0dc4db6-089b-4929-8df6-16a585f9c47a tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.150181 Sep 23 04:35:27.132991 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3325/6711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:26 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:28.155900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:28.156529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:28.163403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.163900 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.164351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.165057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.165564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.166008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.297014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:28.299331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:28.306529 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df89c609-1c5a-4536-8785-bb26be73cd6c tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.154649 Sep 23 04:35:28.307244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3387/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:28 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:29.330008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:29.330651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:29.337685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.338196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.338658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.339378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.339862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.340317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.473289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:29.481162 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09193152-626c-44b3-ba79-f1e41ec0869b tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1517 microversion: 2.1 time: 0.155370 Sep 23 04:35:29.481852 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3326/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:29 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:30.239407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73941879-ecb0-4f5c-987b-690f062f58d0", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd4ced5-c09c-4f61-899f-45a8166f59f9"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:30.244367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=34 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:30.250209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.250692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.251128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.263437 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Creating event network-vif-unplugged:cdd4ced5-c09c-4f61-899f-45a8166f59f9 for instance 73941879-ecb0-4f5c-987b-690f062f58d0 on n-h2-858495-2 Sep 23 04:35:30.269585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] Instance 73941879-ecb0-4f5c-987b-690f062f58d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:35:30.280862 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-363cb3da-b2d2-4d51-9405-72a822ee382a req-523e3a41-6975-43a4-85c2-6c3a46a83f60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112328 Sep 23 04:35:30.281627 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3388/6714] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:30.505394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.506050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:30.513804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.514397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.514867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.515603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.516085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.516538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.521628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=86 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:30.725320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:30.733259 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20e80a09-4114-4253-923c-dd069e98907f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1516 microversion: 2.1 time: 0.233086 Sep 23 04:35:30.733879 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3327/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:30 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:31.758999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.759620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:31.765766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.766249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.766682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.767389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.767847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.768275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.895010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:31.902821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0211e8b3-4057-4c81-97bc-248df81cbb81 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1514 microversion: 2.1 time: 0.149259 Sep 23 04:35:31.903412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3389/6716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:32.303717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73941879-ecb0-4f5c-987b-690f062f58d0", "tag": "cdd4ced5-c09c-4f61-899f-45a8166f59f9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:32.309628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=32 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:32.315266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.315770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.316228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.328060 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Creating event network-changed:cdd4ced5-c09c-4f61-899f-45a8166f59f9 for instance 73941879-ecb0-4f5c-987b-690f062f58d0 on n-h2-858495-2 Sep 23 04:35:32.334098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] Instance 73941879-ecb0-4f5c-987b-690f062f58d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:35:32.344820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9cd0b489-46a1-4c7c-8e8c-6fae92cdfb75 req-70992349-cf20-49da-8c8f-44e5efd274ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044894 Sep 23 04:35:32.346155 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3328/6717] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:32.927234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.927859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:32.935010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.935503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.935949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.936656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.937120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.937578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.073001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:33.081013 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-180947e5-cca0-41d7-b8d2-df3095a6ce67 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1514 microversion: 2.1 time: 0.158220 Sep 23 04:35:33.081668 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3390/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:34.105713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:34.106556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:34.112941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.113479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.113943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.114664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.115143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.115590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.252595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:34.260572 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52c8d8d9-604e-4af0-8c83-b4ebab4f1be3 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1511 microversion: 2.1 time: 0.160192 Sep 23 04:35:34.261171 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3329/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:34 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:34.283393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:34.283933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:34.290648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.291130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.291567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.292385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.292794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.293221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.319639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:35:34.370380 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Found an unconfirmed migration during delete, id: 16, status: finished Sep 23 04:35:35.727540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2c45f28b-e21d-4544-ba27-3037c6648bea tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 204 len: 0 microversion: 2.1 time: 1.447665 Sep 23 04:35:35.728171 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3391/6720] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:34 2022] DELETE /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 0 bytes in 1449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:35:35.737424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:35.738066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:35.745201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.745741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.746200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.746922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.747402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.747853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.874823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:35.882636 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10f002ee-0d8e-4cf4-9798-e3c74e9a33cb tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1503 microversion: 2.1 time: 0.149899 Sep 23 04:35:35.883219 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3330/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:35 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:36.906792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:36.907564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:36.915190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.915679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.916124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.916824 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.917288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.917758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.048967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fddd15b100248abadca72e31f69768b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224659e413a64f9db4049a26656b8b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:37.057591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-20e06494-6ed8-46de-8f23-7139c86b1c92 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 200 len: 1503 microversion: 2.1 time: 0.155134 Sep 23 04:35:37.058170 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3392/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:36 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:37.554215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73941879-ecb0-4f5c-987b-690f062f58d0", "name": "network-vif-deleted", "tag": "cdd4ced5-c09c-4f61-899f-45a8166f59f9"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:37.567445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.567948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.568402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.582921 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] Creating event network-vif-deleted:cdd4ced5-c09c-4f61-899f-45a8166f59f9 for instance 73941879-ecb0-4f5c-987b-690f062f58d0 on n-h2-858495-2 Sep 23 04:35:37.589170 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c6d34c5a-3bdd-43c8-96ae-6779c92a5e58 req-25c6f4f0-c231-4e55-b32c-ba7bdeea9b2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038814 Sep 23 04:35:37.591168 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3331/6723] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:38.081503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:38.085921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:38.093054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.093584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.094026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.094728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.095187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.096320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.110578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] HTTP exception thrown: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Request method failure captured: Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 HTTP/1.1 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTdqnMLSkbaALWgg2ncNMDyNm9iOGUzkkQvxokJfR_-AaXXPWJbkzp5QskZTl2SCp60vm1xDGCDDWjch--15E1kBoKF1LGESE63eH39i5MxU0ezPwgtHrV-7UNziH1GwNtCD2ozkI17xBZvWhddbEFCfz6Q9O8Bl1lyo6yzsDxowC4A Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_224659e413a64f9db4049a26656b8b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fddd15b100248abadca72e31f69768b Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '73941879-ecb0-4f5c-987b-690f062f58d0'} Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.112315 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Returning 404 to user: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-08648210-eff4-4d28-b620-8b4785577e1f tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 404 len: 111 microversion: 2.1 time: 0.037553 Sep 23 04:35:38.116348 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3393/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:38 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:38.129311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:38.129952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:38.136134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.136643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.137099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.137840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.138314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.138762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.152452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] HTTP exception thrown: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Request method failure captured: Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 HTTP/1.1 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTdqnMLSkbaALWgg2ncNMDyNm9iOGUzkkQvxokJfR_-AaXXPWJbkzp5QskZTl2SCp60vm1xDGCDDWjch--15E1kBoKF1LGESE63eH39i5MxU0ezPwgtHrV-7UNziH1GwNtCD2ozkI17xBZvWhddbEFCfz6Q9O8Bl1lyo6yzsDxowC4A Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_224659e413a64f9db4049a26656b8b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 8fddd15b100248abadca72e31f69768b Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '73941879-ecb0-4f5c-987b-690f062f58d0'} Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:38.154441 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Returning 404 to user: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0700db9-3622-4adf-96ce-1d7c1a324a03 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 404 len: 111 microversion: 2.1 time: 0.030858 Sep 23 04:35:38.162068 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3332/6725] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:38 2022] DELETE /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:38.164870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:38.165515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] [instance: 73941879-ecb0-4f5c-987b-690f062f58d0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:38.171501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.171982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.172422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.173108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.173611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.174067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.187872 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] HTTP exception thrown: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Request method failure captured: Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 HTTP/1.1 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTdqnMLSkbaALWgg2ncNMDyNm9iOGUzkkQvxokJfR_-AaXXPWJbkzp5QskZTl2SCp60vm1xDGCDDWjch--15E1kBoKF1LGESE63eH39i5MxU0ezPwgtHrV-7UNziH1GwNtCD2ozkI17xBZvWhddbEFCfz6Q9O8Bl1lyo6yzsDxowC4A Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/224659e413a64f9db4049a26656b8b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_224659e413a64f9db4049a26656b8b3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 224659e413a64f9db4049a26656b8b3f Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-DeleteServersTestJSON-12395851 Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 8fddd15b100248abadca72e31f69768b Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-DeleteServersTestJSON-12395851-project Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '73941879-ecb0-4f5c-987b-690f062f58d0'} Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:38.189403 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] Returning 404 to user: Instance 73941879-ecb0-4f5c-987b-690f062f58d0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba6f48fd-4448-4478-9333-f81f08cf2c29 tempest-DeleteServersTestJSON-12395851 tempest-DeleteServersTestJSON-12395851-project] 10.222.0.25 "GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0" status: 404 len: 111 microversion: 2.1 time: 0.029782 Sep 23 04:35:38.196484 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3394/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:38 2022] GET /compute/v2.1/servers/73941879-ecb0-4f5c-987b-690f062f58d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:46.460820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1401466914", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "4aff8d5d-6b0c-4d30-a37b-3a70d32d3e5d"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:46.524928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] validate_networks() for [('4aff8d5d-6b0c-4d30-a37b-3a70d32d3e5d', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:46.909680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:46.910128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:46.910632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:46.911063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:46.911528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:46.920787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.921426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.921888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.922635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.923111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.923558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.940329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for project 608b0f57455442d3b144343f526628b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:46.946160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for user fc492233f6dc49dfa1dedc70c74e49ca and project 608b0f57455442d3b144343f526628b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:46.960919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:46.964337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:47.010954 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3c13f0e1-5a9d-41bc-b3de-0b4b0f745bbf tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691260 Sep 23 04:35:47.011617 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3333/6727] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:47.023781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2d82f6f-faaa-4377-8f06-bcf5528d405a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:47.024566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2d82f6f-faaa-4377-8f06-bcf5528d405a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:47.081920 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2d82f6f-faaa-4377-8f06-bcf5528d405a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:47.089612 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2d82f6f-faaa-4377-8f06-bcf5528d405a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1218 microversion: 2.1 time: 0.070665 Sep 23 04:35:47.094538 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3395/6728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:47 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:48.114505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:48.115813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:48.123375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.124181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.124795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.125806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.126439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.127108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.226135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:48.240297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b1451aa5-0159-4a42-a553-779447258590 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1278 microversion: 2.1 time: 0.131764 Sep 23 04:35:48.241157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3334/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:48 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:49.267603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:49.268420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:49.277625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:49.279610 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.280412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.281121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.282029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.282641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.283224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.579302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:49.587478 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-73f5bd9c-b649-49f4-9711-aa6d63cbbf76 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.325364 Sep 23 04:35:49.588439 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3396/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:49 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:49.998970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:50.011803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.012713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.013405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.029985 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] Creating event network-changed:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h2-858495-2 Sep 23 04:35:50.035738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-250457f4-4649-4e28-a21a-a605c1518683 req-6a9f567c-02df-42d2-85a4-2766f6280059 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042408 Sep 23 04:35:50.037288 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3335/6731] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:50.611945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:50.612608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:50.619436 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.619915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.620352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.621042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.621528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.621962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.753486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:50.761738 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c71f8026-4d60-49b8-b46b-2c42f7faea8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.153609 Sep 23 04:35:50.762335 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3397/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:50 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:51.787093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:51.787822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:51.794374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.794874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.795327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.796073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.796545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.796990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.924001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:51.933428 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9521c421-7309-41b1-a9b8-7f8d8d3e005d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.152016 Sep 23 04:35:51.934016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3336/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:51 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:52.956532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:52.957155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:52.965652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.966146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.966590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:52.967289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.967753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.968185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.101772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:53.109854 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5bdc4012-fa71-4de3-8af6-8da354ae5cd3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.157623 Sep 23 04:35:53.110426 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3398/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:52 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:54.132694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:54.133449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:54.140330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:54.140910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:54.141470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.142259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:54.142830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:54.143374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.334846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:54.342655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0fa440d2-0440-4623-b3b8-1dd88d07e119 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.214503 Sep 23 04:35:54.343244 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3337/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:54 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:55.366908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:55.367526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:55.374565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.375055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.375499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.376194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.376680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.377414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.544579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:55.552796 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fca04beb-3291-4255-bde8-e5415c81ee60 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.190389 Sep 23 04:35:55.553394 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3399/6736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:55 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:56.226539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "name": "network-vif-plugged", "status": "completed", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:56.238034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.238551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.239013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.251676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] Creating event network-vif-plugged:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h2-858495-2 Sep 23 04:35:56.256807 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3d04dac3-f34d-4463-91c1-61f3bdb4c667 req-a7397a27-3d37-452e-8edf-46f6ea818214 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 Sep 23 04:35:56.257452 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3338/6737] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:56.575348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:56.575966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:56.583657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.584144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.584589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.585287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.585774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.586206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.795155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:56.803499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e3f9df2e-413d-41fc-9e38-b95592403a28 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.232094 Sep 23 04:35:56.804077 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3400/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:56 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:57.824117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:57.824920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:57.831868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:57.832608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:57.840608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.841143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.841625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.842349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.842820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.843264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.982089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:57.989820 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a2f6d5f6-12e8-40d6-a706-8197d802a54f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1318 microversion: 2.1 time: 0.166632 Sep 23 04:35:57.990406 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3339/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:57 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.018916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.019807 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.022817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:59.027825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.028672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.029120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.030547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.031368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.031813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.170270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.178228 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd8a46d7-b441-4e05-a333-a128d641985b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1509 microversion: 2.1 time: 0.167926 Sep 23 04:35:59.178812 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3401/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.200412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.201046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.208902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.209497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.209958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.210665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.211142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.211587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.424140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.431998 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-af156430-2432-4c55-8e2f-0d503b8404c6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1509 microversion: 2.1 time: 0.235585 Sep 23 04:35:59.432581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3340/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:59.454682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:59.457908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.464097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.464583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.465029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.465773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.466231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.466664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.532797 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-344bb268-1868-468e-890e-8a9780082bb5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "PUT /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1081 microversion: 2.1 time: 0.082287 Sep 23 04:35:59.534152 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3402/6742] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Sep 23 04:35:59 2022] PUT /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1081 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.551783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.552399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.558489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.558987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.559438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.560140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.560608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.561047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.692765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.700656 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2adfddd2-7430-4007-8e33-4a0b4e11a494 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1507 microversion: 2.1 time: 0.152750 Sep 23 04:35:59.701252 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3341/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.723153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.723783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.729872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.730364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.730809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.731519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.731975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.732410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.864278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.872083 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d90e79d0-902a-4c4f-907c-e2c5373ebc3c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1507 microversion: 2.1 time: 0.152893 Sep 23 04:35:59.872660 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3403/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.894225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:59.896519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.902613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.903111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.903559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.904263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.904733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.905179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.934223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.939632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Old instance type m1.heat2, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:35:59.946725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:59.947162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:59.947648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:59.948068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:59.948491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:00.018222 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4da6b228-fe3c-4662-8273-294e5c7c6cf2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf/action" status: 202 len: 0 microversion: 2.1 time: 0.127802 Sep 23 04:36:00.022715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3342/6745] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:59 2022] POST /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:00.028582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:00.029209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:00.037015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.037846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.038067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:00.038699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.039162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.039597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:00.197244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:00.205675 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da745228-1177-4946-be04-d3c7b035091f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1518 microversion: 2.1 time: 0.181182 Sep 23 04:36:00.206830 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3404/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:00 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:01.230744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:01.231523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:01.240472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.240977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.241464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.242184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.242660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.243104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.247175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:01.425104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:01.433130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9cd6a447-c4e6-421a-8669-cc0eeb937320 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1518 microversion: 2.1 time: 0.207740 Sep 23 04:36:01.433830 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3343/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:01 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:02.457091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:02.457757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:02.460519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:02.466852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.467362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.467805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.468611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.468996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.469456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.599353 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:02.607138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca101b1c-e62f-47c6-8a64-74bba6fb875e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.154983 Sep 23 04:36:02.607720 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3405/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:02 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:03.630295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:03.630925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:03.633652 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:03.638883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.639390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.639842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.640553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.641022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.641502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.775044 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:03.782847 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1306a370-3586-4e96-afee-6a2f315c2df5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.156656 Sep 23 04:36:03.783434 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3344/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:03 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:04.806764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:04.807324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:04.814251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.814737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.815177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.815877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.816335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.816767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.944282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:04.952072 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ad804ff-ec33-4ebe-84f5-39bf63bc34bd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.149338 Sep 23 04:36:04.952658 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3406/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:04 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:05.976946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:05.977632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:05.984975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.985508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.985969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:05.986681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.987685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.988128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:06.205845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:06.213833 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de1c5cea-5dd4-431e-acbe-5c6b5ab44c2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.241017 Sep 23 04:36:06.214427 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3345/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:05 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:07.236939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:07.237613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:07.244442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.244926 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.245385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.246229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.246692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.247126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.378371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:07.386255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f26ed42-5122-4467-98a8-363b89eb91af tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.153222 Sep 23 04:36:07.386838 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3407/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:07 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:08.409901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:08.410416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:08.417437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.417945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.418394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.419103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.419651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.420093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.549996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:08.558067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-273fed07-a3a5-4f97-b64e-b602e4d80815 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.152962 Sep 23 04:36:08.558671 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3346/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:08 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:09.582345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:09.582903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:09.589916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.590400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.590844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.591541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.592002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.592437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.726767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:09.734429 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0783e946-f2fd-48b8-ad50-562cc49b3d90 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.156907 Sep 23 04:36:09.735007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3408/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:09 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:10.757877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:10.758444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:10.765466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.765972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.766430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.767145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.767622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.768762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.899381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.907145 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49a20eba-2e32-491e-963c-aff1f7d7683e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.153506 Sep 23 04:36:10.907751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3347/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:10 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:11.931724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.932346 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:11.939172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.940298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.940739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:11.941461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.941924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.942358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.073184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:12.081178 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c405353e-bfee-4137-9776-8a133494bd20 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.153426 Sep 23 04:36:12.081783 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3409/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:11 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:13.104240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.104869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.111891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.113203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.113676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.114394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.114864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.115303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.242113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:13.249849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ba340525-3135-4ec6-be40-cef69816afbe tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.149642 Sep 23 04:36:13.250434 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3348/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:13 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:14.273608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:14.274222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:14.281073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.281605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.282035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.282724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.283177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.283602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.409861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.417556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e20fc36-1fca-472f-af23-d7df8b4a0623 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.149705 Sep 23 04:36:14.418132 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3410/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:14 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:15.441394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:15.442316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:15.449802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.450514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.450976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.451689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.452165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.452615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.584294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:15.592297 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5301f4de-6899-4f49-b19f-93f5d6fb0f00 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.155845 Sep 23 04:36:15.592888 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3349/6759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:15 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:16.615108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:16.615767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:16.622829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.623319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.623762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.624465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.624930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.625385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.753391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.756878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:16.762002 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7de87309-2ef0-4eda-948b-9ee8ea50ad03 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.150864 Sep 23 04:36:16.762581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3411/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:16 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:17.786291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:17.786843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:17.793129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.793660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.794118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.794827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.795301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.795751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.925615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:17.933340 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6be7505-d7b1-4e83-bab0-33145c8959f8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.151899 Sep 23 04:36:17.933936 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3350/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:17 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:18.956441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:18.957061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:18.964768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.965248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.965711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.966501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.966967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.967397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.098627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.106372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f39f59e2-1ddc-4c14-bb18-741b8df99230 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.154184 Sep 23 04:36:19.106954 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3412/6762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:18 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:20.130136 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:20.130771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:20.137994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.138495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.138952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.139663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.140138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.140585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.268576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:20.276557 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b429e96-5052-47b2-9d13-434209da930f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.150350 Sep 23 04:36:20.277141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3351/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:20 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:21.300984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:21.301532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:21.308504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.308980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.309448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.310139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.310594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.311019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.441111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:21.448878 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c91f3dbc-d7e2-4702-8a7c-e93bf317efe3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.152590 Sep 23 04:36:21.449552 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3413/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:21 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:22.472943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:22.473601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:22.480473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.480999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.481482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.482193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.482669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.483118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.610084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:22.618078 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6f17f1e6-a215-4e89-afaa-076fdc86d3a5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.149743 Sep 23 04:36:22.618668 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3352/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:22 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:23.641042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:23.641686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:23.648472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.648956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.649417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.650115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.650577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.651009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.788684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:23.796382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee687a3d-7259-43de-8615-d4664d805579 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.159263 Sep 23 04:36:23.796966 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3414/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:23 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:24.819885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:24.820438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:24.827308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.828061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.828513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:24.829216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.829724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.830184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:24.959949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:24.967686 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ff18844-dfc9-44e1-bc47-4e7245ef198a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.151849 Sep 23 04:36:24.968265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3353/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:24 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:25.991509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:25.992140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:25.998945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:25.999422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:25.999855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.000543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.000995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.001440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.130042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:26.137966 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-babe52d3-27e6-4003-be98-e5644e2fa3c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.150847 Sep 23 04:36:26.138547 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3415/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:25 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:27.162105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:27.162659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:27.169489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:27.169989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:27.170442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:27.171323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:27.171802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:27.172249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:27.302864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:27.310596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-821cc2f6-a23a-4ec2-9107-d3f52d3361aa tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.153108 Sep 23 04:36:27.311172 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3354/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:27 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:28.333500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:28.334070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:28.340921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.341445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.341880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.342578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.343037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.343471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.472300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:28.480163 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46eaa3e2-d953-4324-bc42-56f81f2ebb52 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1523 microversion: 2.1 time: 0.150730 Sep 23 04:36:28.480738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3416/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:28 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:29.505491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:29.506894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:29.514815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.515513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.516167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.517277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.518950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.519606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.632158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "name": "network-vif-unplugged", "status": "completed", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:29.643442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.643962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.644528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.657642 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Creating event network-vif-unplugged:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h1-858495-2 Sep 23 04:36:29.664970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:29.665463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] Instance 22c88951-61f3-484c-a891-2d43ca5752bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:29.673431 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a901743-4487-4b3a-8141-f176eb434d91 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1522 microversion: 2.1 time: 0.173152 Sep 23 04:36:29.674070 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3355/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:29 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:29.691881 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-620bdd80-35be-41eb-a982-985365ca5053 req-2f7d319a-d191-4418-aeda-ee57542797da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122819 Sep 23 04:36:29.692516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3417/6772] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:30.696308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.697177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:30.704420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.705459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.705928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.706650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.707132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.707584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.838619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:30.847016 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4e787257-e2e8-4438-ba09-ff76bebfbb8c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1520 microversion: 2.1 time: 0.154815 Sep 23 04:36:30.847604 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3356/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:30 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:31.711089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:31.720681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.721633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.722068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.733382 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Creating event network-changed:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h1-858495-2 Sep 23 04:36:31.739493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] Instance 22c88951-61f3-484c-a891-2d43ca5752bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:31.750394 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8fcb156f-3a28-46e3-bc78-0b860a1a69c3 req-a742341e-dc8d-4a64-b554-cad24826bf9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044511 Sep 23 04:36:31.750992 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3418/6774] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:31.869900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.870609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:31.878704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.879225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.879809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.880613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.881264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.881743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.884564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=84 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:32.103494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:32.112971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7baef33-deda-4fd0-925d-bdc29c1b33cd tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1520 microversion: 2.1 time: 0.246761 Sep 23 04:36:32.125389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3357/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:31 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:33.137131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:33.137864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:33.139774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=28 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:33.145457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.145952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.146396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.147134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.147595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.148030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.282738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.291322 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bf3e9133-9d36-4174-be09-529cd2a3093f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1517 microversion: 2.1 time: 0.159295 Sep 23 04:36:33.291902 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3419/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:33 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:33.314264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:33.315510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:33.324167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.324787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.325267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.326055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.326522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.326966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.385936 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-829e9330-86e4-4576-a6ea-f14ba8c5ee4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf/action" status: 204 len: 0 microversion: 2.1 time: 0.075587 Sep 23 04:36:33.386611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3358/6777] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:33 2022] POST /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:33.395248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:33.395791 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:33.401899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.402387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.402864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.403706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.404326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.404811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.606612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.614881 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8521206-9097-4ca8-916e-876fc4976538 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1517 microversion: 2.1 time: 0.223673 Sep 23 04:36:33.615481 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3420/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:33 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:34.640341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:34.641153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:34.643775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=30 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:34.649538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.650053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.650520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.651241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.651715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.652158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.800322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:34.808887 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dfc03436-556f-490f-9c23-6ac1e1743987 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1517 microversion: 2.1 time: 0.173547 Sep 23 04:36:34.809530 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3359/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:34 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:35.508759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "name": "network-vif-plugged", "status": "completed", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:35.518164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.518639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.519068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.529982 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] Creating event network-vif-plugged:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h1-858495-2 Sep 23 04:36:35.535588 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fd704189-a3ee-4ba0-a0fa-50f665b91913 req-129c86fa-53ea-4824-ace6-881f56ecdd3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087578 Sep 23 04:36:35.536185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3421/6780] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:35.833373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:35.833905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:35.840973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.841502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.841954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.842660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.843130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.843574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.968973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:35.977380 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-146db64c-4d94-45cd-b16a-e7098f740d3e tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1509 microversion: 2.1 time: 0.148738 Sep 23 04:36:35.977954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3360/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:35.999775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:36.000594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:36.006821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.007334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.007775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.008470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.008928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.009379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.138753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:36.146552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b5e66164-29eb-4065-8576-66f597dd4c5b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1509 microversion: 2.1 time: 0.151086 Sep 23 04:36:36.147141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3422/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:36.172177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-69572755-ab37-4591-b84b-b7e5ce2a055f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'create', calling method: .version_select at 0x7f0c8b155430>, body: {"keypair": {"name": "tempest-keypair-383059371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOytF4z1d150xng3zo8R8Ge5/TMV5ZQuvP2lHhOSfLCJ/gfs5rM2Di5/Ac548lgbBBosl4JgNLenDXZtZMBs8TFU5qmf0CGWay87v4CDm7VErRgKuRx5XQJ9qJ5eT75lrw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:36.188294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-69572755-ab37-4591-b84b-b7e5ce2a055f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for project 608b0f57455442d3b144343f526628b3. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:36.193469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-69572755-ab37-4591-b84b-b7e5ce2a055f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for user fc492233f6dc49dfa1dedc70c74e49ca and project 608b0f57455442d3b144343f526628b3. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:36.218777 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-69572755-ab37-4591-b84b-b7e5ce2a055f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050473 Sep 23 04:36:36.219422 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3361/6783] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:36:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:37.411236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:37.411849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:37.418997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.419488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.419948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.420673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.421141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.421640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.549402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:37.557188 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-44602837-ee16-4ebd-8b14-3319095e878d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 200 len: 1509 microversion: 2.1 time: 0.149852 Sep 23 04:36:37.557739 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3423/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:37 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:37.581091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:37.581634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:37.588326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.588836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.589300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.590049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.590528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.590984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.615939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:36:37.692790 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5b6c04aa-3b38-49a9-aeef-36d745a17c3f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 204 len: 0 microversion: 2.1 time: 0.116762 Sep 23 04:36:37.693646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3362/6785] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:36:37 2022] DELETE /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:37.752123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-589517646", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "4aff8d5d-6b0c-4d30-a37b-3a70d32d3e5d"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:37.806489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] validate_networks() for [('4aff8d5d-6b0c-4d30-a37b-3a70d32d3e5d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:36:38.172840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:36:38.173275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:36:38.173815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:36:38.174234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:36:38.174653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:38.183631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.184145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.184588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.185616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.186502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.186956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.203889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for project 608b0f57455442d3b144343f526628b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:38.209651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Getting quotas for user fc492233f6dc49dfa1dedc70c74e49ca and project 608b0f57455442d3b144343f526628b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:38.222311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:36:38.224617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:38.270691 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-05cd609d-be71-47b9-be32-e2378bfb5301 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522473 Sep 23 04:36:38.271533 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3424/6786] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:36:38.284272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28e10e8e-4010-4fd9-80f9-76886d7d0741 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:38.284993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28e10e8e-4010-4fd9-80f9-76886d7d0741 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:38.342573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28e10e8e-4010-4fd9-80f9-76886d7d0741 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:38.350665 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28e10e8e-4010-4fd9-80f9-76886d7d0741 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1217 microversion: 2.1 time: 0.071265 Sep 23 04:36:38.351276 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3363/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:38 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:39.378514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:39.379227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:39.398971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.402672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.405988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.406812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.407296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.407801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.436633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c88951-61f3-484c-a891-2d43ca5752bf", "name": "network-vif-deleted", "tag": "b986af56-2660-413f-8281-add158e40b6b"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:39.459318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.460061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.460696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.479605 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] Creating event network-vif-deleted:b986af56-2660-413f-8281-add158e40b6b for instance 22c88951-61f3-484c-a891-2d43ca5752bf on n-h1-858495-2 Sep 23 04:36:39.485067 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-03c53f4f-d060-4cbf-9474-2ff37d716808 req-95d4a921-0b57-4616-9776-32dafa615fd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052291 Sep 23 04:36:39.486812 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3364/6788] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:39.575613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.589622 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6da1a691-35c6-45cc-a8f1-10809c9545e6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1287 microversion: 2.1 time: 0.219948 Sep 23 04:36:39.594228 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3425/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:39 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1287 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:40.614908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:40.615638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:40.621938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.622451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.622919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.623639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.624121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.624574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.840068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:40.849705 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-571abeb4-87ac-4b81-9b29-fd69d0ef1a18 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.239926 Sep 23 04:36:40.852389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3365/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:40 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:40.954125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:40.964300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.964772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.965200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.976304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] Creating event network-changed:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h2-858495-2 Sep 23 04:36:40.981267 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-99908335-c669-46a8-9a98-d075229eb680 req-fd5321db-38bb-492c-89bd-733016f9e1aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081384 Sep 23 04:36:40.981903 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3426/6791] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:41.875931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:41.876488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:41.884152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.884796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.885259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.886010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.886488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.886938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.013494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:42.021324 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eef092ec-4ba6-4ca1-89be-02a8cc36ed6f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.149479 Sep 23 04:36:42.021934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3366/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:41 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:43.045440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:43.046155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:43.052401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.052893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.053336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.054057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.054517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.054951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.187033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:43.195228 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3462311b-87d4-49e6-9a07-a64b2b566b53 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.154976 Sep 23 04:36:43.195816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3427/6793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:43 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:44.218591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:44.219224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:44.226793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:44.227299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:44.227757 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:44.228473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:44.228949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:44.229425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:44.362768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:44.370655 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4641893-5efa-42a1-b63f-a3c5295f57b6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.155975 Sep 23 04:36:44.371247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3367/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:44 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:45.394197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:45.394849 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:45.402360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.402851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.403297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:45.403997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.404463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.404901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:45.532219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:45.540594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-456138de-47b5-4e8f-b6ae-bcf3f143c522 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.150374 Sep 23 04:36:45.541163 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3428/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:45 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:46.563865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:46.565107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:46.574073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:46.574776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:46.575224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:46.581213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:46.581770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:46.582248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:46.736873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:46.744922 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-06933dc5-26e9-4eb1-98ef-e17e1b8686da tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.185420 Sep 23 04:36:46.745546 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3368/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:46 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:47.766690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:47.767833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:47.774511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:47.774995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:47.775432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:47.776132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:47.776588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:47.777022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:47.909759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:47.917821 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2a38b34b-700d-411d-89cc-a0d3e14b8eb3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.154960 Sep 23 04:36:47.918404 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3429/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:47 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:48.501100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "name": "network-vif-plugged", "status": "completed", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:48.507059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:48.513138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:48.513673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:48.514139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:48.526240 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] Creating event network-vif-plugged:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h2-858495-2 Sep 23 04:36:48.531618 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-548b4785-de9b-4f6d-9909-a8b05f5e296f req-aba64ebc-93bd-473b-8969-e62de0c1c893 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034191 Sep 23 04:36:48.532631 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3369/6798] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:48.940838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:48.941486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:48.943435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:48.944112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:48.951035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:48.951522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:48.952216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:48.952922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:48.953402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:48.953834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:48.969201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:49.085617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:49.093497 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f89ffbf6-6ce0-4054-afdb-d901653ec0ba tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1317 microversion: 2.1 time: 0.157212 Sep 23 04:36:49.094077 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3430/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:48 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:50.118201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:50.119017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.125574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.126079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.127189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.127959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.128437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.128882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.257786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:50.265611 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ccf6b1aa-3586-4e0c-b04d-c5b38686b892 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1507 microversion: 2.1 time: 0.152665 Sep 23 04:36:50.266200 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3370/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:50 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:50.287783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:50.288438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.295347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.295833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.296276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.296976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.297492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.297953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.427914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:50.435613 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8dd37d3e-f818-4b1a-9154-00b0fe9a33ab tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1507 microversion: 2.1 time: 0.151833 Sep 23 04:36:50.436187 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3431/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:50 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:50.457871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:50.460207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.467129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.467471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.467935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.468666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.469144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.469634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.498972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:50.504461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:36:50.511217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:36:50.511663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:36:50.512164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:36:50.512598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:36:50.513031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:50.576089 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c48cf5d-9b57-467c-b8e8-27ad69762c33 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e/action" status: 202 len: 0 microversion: 2.1 time: 0.122211 Sep 23 04:36:50.576721 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3371/6802] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:50 2022] POST /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:50.585432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:50.586019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.591940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.592434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.592881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.593616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.594078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.594511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.754795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:50.762685 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-be2fcb7c-ec22-430a-93c5-8aaa9d9732c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1514 microversion: 2.1 time: 0.181268 Sep 23 04:36:50.763250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3432/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:50 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:51.788000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:51.788638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:51.795867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.796314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.796777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:51.798271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.798897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.799359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:52.008738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:52.012408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:52.018758 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3565cd1b-ead5-4499-a9a4-49bb98e035ce tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1514 microversion: 2.1 time: 0.236429 Sep 23 04:36:52.019389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3372/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:51 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:53.041839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:53.042451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:53.049777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.050259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.050701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.051389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.051841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.052268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.177497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.185150 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-58caf80e-9f54-43ee-9318-8475eebe51cc tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.147288 Sep 23 04:36:53.185755 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3433/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:53 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:54.209824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:54.210488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:54.218327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.218831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.219285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.219988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.220459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.220901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.354959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:54.363367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51360be5-11ff-4c15-b748-d673990d6a31 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.158432 Sep 23 04:36:54.363946 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3373/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:54 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:55.386233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:55.386847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:55.393611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:55.394095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:55.394532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:55.395219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:55.395674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:55.396105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:55.523066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:55.530837 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b291123b-d556-4e84-8a99-17b18c535305 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.148590 Sep 23 04:36:55.531411 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3434/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:55 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:56.555319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:56.556097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:56.563135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:56.563635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:56.564615 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:56.565324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:56.565818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:56.566262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:56.700656 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:56.709558 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9a5039bc-4276-4885-b3b2-9914e3bdca29 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.159522 Sep 23 04:36:56.710155 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3374/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:56 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:57.732044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:57.732566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:57.739430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.739914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.740349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.741038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.741526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.741954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.870116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:57.878325 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-45ef6f4a-9be8-409d-852e-a5e070874c1f tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.150319 Sep 23 04:36:57.878901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3435/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:57 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:58.901928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:58.902538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:58.911139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:58.911647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:58.912107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:58.912833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:58.913313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:58.913896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.055821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:59.064194 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a968880-0d6f-455e-a8d4-a98b74d98e11 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.166316 Sep 23 04:36:59.064827 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3375/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:58 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:00.088307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:00.088757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:00.096412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.096894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.097336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.098049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.098501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.098927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.225009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:00.232736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eaf54295-7910-4919-b145-b25e61eb0e6b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.148576 Sep 23 04:37:00.233320 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3436/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:00 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:01.255526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:01.256166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:01.263278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.263787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.264251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.264974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.265483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.265940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.404548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:01.413097 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-570979bc-7394-4c3e-8d58-4ebf356e2a09 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.161501 Sep 23 04:37:01.413712 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3376/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:01 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:02.436147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:02.436768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:02.443738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.444222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.444662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.445371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.445850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.446280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.585421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:02.593488 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-55aa9cf2-103e-4637-994a-9076f8342b63 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.161345 Sep 23 04:37:02.594057 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3437/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:02 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:03.616938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:03.617600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:03.624572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.625076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.625574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.626287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.626761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.627218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.766716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:03.775039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5000d6f2-6f00-4091-a967-9004e33b41c0 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.162101 Sep 23 04:37:03.775623 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3377/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:03 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:04.798630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:04.799902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:04.802536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:04.808034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.808526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.808978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.809788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.810255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.810698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.940206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:04.948131 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca9a05dc-0645-4071-b3be-1b50d2c5aba1 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.153504 Sep 23 04:37:04.948706 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3438/6815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:04 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:05.972143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:05.972772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:05.975693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:05.980847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:05.981345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:05.981824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:05.982531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:05.983001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:05.983444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.118336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.126207 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d823c30f-65ef-4249-b9f7-b497d3816f54 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.158024 Sep 23 04:37:06.126795 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3378/6816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:05 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:07.149803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:07.150318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:07.157175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.157711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.158158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.158865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.159328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.159766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.359357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:07.367704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-363f0bf0-332d-4faf-bd8e-33c9ceabba2c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.222019 Sep 23 04:37:07.368480 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3439/6817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:07 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:08.391631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:08.392181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:08.399247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.399744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.400196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.400894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.401390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.401833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.533545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:08.541848 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c136743-29fd-40e5-a077-f3d2519705d5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.154268 Sep 23 04:37:08.542430 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3379/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:08 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:09.565309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:09.565953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:09.572785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.573266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.573734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.574425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.574877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.575306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.701808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.710171 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d94ca82b-74db-467a-a1d8-9a4074a64085 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.148720 Sep 23 04:37:09.710751 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3440/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:09 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:10.732935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:10.733509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:10.741163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.741687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.742142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.742850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.743326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.743773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.876067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.883769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4965608e-567d-4b46-9323-6ac701c13422 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.154900 Sep 23 04:37:10.884359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3380/6820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:10 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:11.906781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.907342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:11.917196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.917704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.918175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.918861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.919327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.919813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.052967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.060917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8d4b1217-8671-4b04-bf53-7cd895337a7d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.158154 Sep 23 04:37:12.061530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3441/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:13.084449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:13.085087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:13.094217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.094728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.095195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.095918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.096398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.097423 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.234301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:13.242162 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0da5f0ac-6389-4f98-84d2-a8abf3ea00c9 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.161767 Sep 23 04:37:13.242746 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3381/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:13 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:14.265155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:14.265788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:14.272696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.273177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.273643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.274333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.274788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.275214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.405549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:14.413784 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-87937061-9dfe-46cc-942a-ce39184abfe5 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.152506 Sep 23 04:37:14.414363 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3442/6823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:14 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:15.439635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:15.440264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:15.447077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.447579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.448040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.448755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.449232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.449725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.576060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:15.584243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a36a1d18-1fd8-4279-bc6c-2bc57875fe4d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.149646 Sep 23 04:37:15.584836 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3382/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:15 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:16.607307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:16.607917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:16.614954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.615435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.615871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.616563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.617019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.617475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.747106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:16.755311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f3e6b586-a210-4b0a-b2d8-e1f9e572f43c tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.151963 Sep 23 04:37:16.755888 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3443/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:16 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:17.779421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:17.779995 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:17.786422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.786930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.787383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.788091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.788565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.789041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.919607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:17.929110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30fd14a6-fb59-406a-807e-3547f467cf10 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.153983 Sep 23 04:37:17.929736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3383/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:17 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:18.952633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:18.953247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:18.960431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.960912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.961366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.962060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.962513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.962943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.977694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=84 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:19.090030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:19.097671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de3dfc92-2bb1-4d5b-bd4b-b72e02aa452a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1519 microversion: 2.1 time: 0.149243 Sep 23 04:37:19.098245 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3444/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:18 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:19.883199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:19.893731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.894231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.894686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.907213 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Creating event network-vif-unplugged:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h1-858495-2 Sep 23 04:37:19.913672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] Instance cb97e3ad-da54-48b7-8af7-7f718199d23e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:37:19.926672 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-69b02af3-32fd-4c43-a70d-b3d6dfccc436 req-6509f574-c376-4a5d-be99-aa90fa03528f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047151 Sep 23 04:37:19.927310 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3384/6828] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:20.120101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:20.120778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:20.127821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.128325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.128771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.129552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.130022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.130486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.266159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:20.274700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-edc6c5b0-3513-4a79-ac6d-b230026b7913 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1518 microversion: 2.1 time: 0.158538 Sep 23 04:37:20.275298 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3445/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:20 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:21.300630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:21.301303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:21.307560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.308062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.308515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.309223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.309716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.310161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.453330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:21.462317 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28b76961-80e9-4c38-b1f7-5dd7e3da3cb2 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1516 microversion: 2.1 time: 0.167567 Sep 23 04:37:21.463178 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3385/6830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:21 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:21.952426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:21.964828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.965278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.965747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.977618 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Creating event network-changed:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h1-858495-2 Sep 23 04:37:21.985464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] Instance cb97e3ad-da54-48b7-8af7-7f718199d23e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:37:21.996789 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-81ff865b-1598-46ac-908c-c03200a30d23 req-d02883c0-8cb0-4a17-866f-242a17787e34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049176 Sep 23 04:37:21.997471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3446/6831] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:22.488581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:22.490063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:22.497560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.498078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.498543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.499287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.499767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.500237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.868696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:22.876920 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-733864c5-456c-4430-8cec-419892028543 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1513 microversion: 2.1 time: 0.393001 Sep 23 04:37:22.877645 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3386/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:22 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1513 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:22.901073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:22.901769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:22.908016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.908504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.908947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.909663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.910120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.910551 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.974240 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ce86789-3a34-4f13-afce-94747daf4172 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "POST /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e/action" status: 204 len: 0 microversion: 2.1 time: 0.077291 Sep 23 04:37:22.974895 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3447/6833] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:37:22 2022] POST /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:22.983684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:22.984321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:22.991248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.991691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.992132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.992860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.993337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.993811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:23.200069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:23.208246 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4b82d49e-3fd0-4950-9ff5-3371a23a94e8 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1513 microversion: 2.1 time: 0.228827 Sep 23 04:37:23.208837 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3387/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:22 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:24.232251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.233026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.240601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.241091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.241578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.242281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.242735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.243578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.383374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.391126 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8f051072-5422-4193-b500-5ba502cec96b tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1505 microversion: 2.1 time: 0.163195 Sep 23 04:37:24.391721 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3448/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:24 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:24.415454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.416108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.425610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.426138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.426598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.427324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.427803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.428284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.432693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=89 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:24.563353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.571190 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d1d296de-cc5c-45d2-83ad-cd1f8c0da8f6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1505 microversion: 2.1 time: 0.159756 Sep 23 04:37:24.571780 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3388/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:24 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:24.593811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.594421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.600996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.601521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.601966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.602662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.603116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.603542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.730902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.738717 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6eb12959-e053-47c6-8854-4837a9743696 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1505 microversion: 2.1 time: 0.148818 Sep 23 04:37:24.739323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3449/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:24 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:24.760575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.761146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.767141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.767677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.768140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.769371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.769870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.770320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.795388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:24.877390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f52fa61-588f-437a-8eec-24eac66fe1a3 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 204 len: 0 microversion: 2.1 time: 0.120445 Sep 23 04:37:24.878499 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3389/6838] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:24 2022] DELETE /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:24.898366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.898862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.904708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.905196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.905696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.906390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.906840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.907276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.932945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:24.976867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.compute.api [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Instance is already in deleting state, ignoring this request Sep 23 04:37:24.977724 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-765ece11-5806-42c7-ba3e-904f9b0d35be tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 204 len: 0 microversion: 2.1 time: 0.084114 Sep 23 04:37:24.978287 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3450/6839] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:24 2022] DELETE /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:37:24.986955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.987716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.993679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.994177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.994632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.995334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.995804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.996247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.128911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:25.136788 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-80b732c9-5287-49d1-9ee8-20a5ef00274d tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1511 microversion: 2.1 time: 0.154208 Sep 23 04:37:25.137388 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3390/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:24 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:25.604441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "name": "network-vif-plugged", "status": "completed", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:25.616592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.617086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.617670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.629450 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] Creating event network-vif-plugged:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h1-858495-2 Sep 23 04:37:25.634765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-aefaa851-4f79-4ccb-b50d-8bfc157f0301 req-e7b2d56c-124e-4e9f-80b6-ea4cd3f228b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034695 Sep 23 04:37:25.635580 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3451/6841] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:26.160940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:26.161963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:26.168967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.169544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.170009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.170713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.171183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.171628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.299404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc492233f6dc49dfa1dedc70c74e49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b0f57455442d3b144343f526628b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.307342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21b77472-d993-4689-8544-719a06bea92a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 200 len: 1511 microversion: 2.1 time: 0.151002 Sep 23 04:37:26.307942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3391/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:26 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:26.656740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb97e3ad-da54-48b7-8af7-7f718199d23e", "name": "network-vif-deleted", "tag": "0b768b4f-3910-4629-a43c-708dee60c748"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:26.667373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.667763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.668206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.686424 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] Creating event network-vif-deleted:0b768b4f-3910-4629-a43c-708dee60c748 for instance cb97e3ad-da54-48b7-8af7-7f718199d23e on n-h1-858495-2 Sep 23 04:37:26.691943 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-43b32000-9ebc-440e-8c1a-079e8ccf0bf1 req-af4107c1-f7d1-447e-b0b9-f7f51e9fe371 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040874 Sep 23 04:37:26.692752 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3452/6843] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:27.331189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.331824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: cb97e3ad-da54-48b7-8af7-7f718199d23e] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.338693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.339199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.339659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.340370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.340847 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.341295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.355156 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] HTTP exception thrown: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Request method failure captured: Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e HTTP/1.1 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTeiC6Ukqih6mT5DGsoIL48TYKSBXt2MsMBkyOAG-jao7-8AHCdJAF4sCd-lHHiHC2BCAg5VFfRInEtUWuAKsNLa0mQEOQ93r7h0jrfGK6hEJTZIsIbhjpjXJihkT9ycsbwBerrkCoLUUqICIIlPVzD7OawX62-gPRqJF9bXtzd2zgg Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/608b0f57455442d3b144343f526628b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_608b0f57455442d3b144343f526628b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: fc492233f6dc49dfa1dedc70c74e49ca Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cb97e3ad-da54-48b7-8af7-7f718199d23e'} Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:27.356803 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Returning 404 to user: Instance cb97e3ad-da54-48b7-8af7-7f718199d23e could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-508fd614-3817-495a-8051-e243b61766a6 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e" status: 404 len: 111 microversion: 2.1 time: 0.031032 Sep 23 04:37:27.361037 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3392/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:27 2022] GET /compute/v2.1/servers/cb97e3ad-da54-48b7-8af7-7f718199d23e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:27.367922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4b38993-5e7e-4cc2-a9ef-74bf0ba5f957 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '.version_select at 0x7f0c8b8f1c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.372415 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4b38993-5e7e-4cc2-a9ef-74bf0ba5f957 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:37:28.380338 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4b38993-5e7e-4cc2-a9ef-74bf0ba5f957 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [eb9650c7-5f7b-4879-b86d-f3203e9b21f0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51776. Sep 23 04:37:28.398658 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4b38993-5e7e-4cc2-a9ef-74bf0ba5f957 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383059371" status: 202 len: 0 microversion: 2.1 time: 1.034827 Sep 23 04:37:28.399257 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3453/6845] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 23 04:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383059371 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:37:28.997363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:28.997895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.004694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.005192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.005680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.006392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.006864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.007310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.021915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] HTTP exception thrown: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Request method failure captured: Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf HTTP/1.1 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTeiC6Ukqih6mT5DGsoIL48TYKSBXt2MsMBkyOAG-jao7-8AHCdJAF4sCd-lHHiHC2BCAg5VFfRInEtUWuAKsNLa0mQEOQ93r7h0jrfGK6hEJTZIsIbhjpjXJihkT9ycsbwBerrkCoLUUqICIIlPVzD7OawX62-gPRqJF9bXtzd2zgg Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/608b0f57455442d3b144343f526628b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_608b0f57455442d3b144343f526628b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: fc492233f6dc49dfa1dedc70c74e49ca Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '22c88951-61f3-484c-a891-2d43ca5752bf'} Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:29.023968 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Returning 404 to user: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0f4e4bfd-922a-422d-9697-e1f98a559d8a tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 404 len: 111 microversion: 2.1 time: 0.032355 Sep 23 04:37:29.027965 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3393/6846] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:28 2022] DELETE /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:37:29.036560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:29.037297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] [instance: 22c88951-61f3-484c-a891-2d43ca5752bf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.043485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.043975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.044419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.045118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.045631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.046070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.059174 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] HTTP exception thrown: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Request method failure captured: Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf HTTP/1.1 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTeiC6Ukqih6mT5DGsoIL48TYKSBXt2MsMBkyOAG-jao7-8AHCdJAF4sCd-lHHiHC2BCAg5VFfRInEtUWuAKsNLa0mQEOQ93r7h0jrfGK6hEJTZIsIbhjpjXJihkT9ycsbwBerrkCoLUUqICIIlPVzD7OawX62-gPRqJF9bXtzd2zgg Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/608b0f57455442d3b144343f526628b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/608b0f57455442d3b144343f526628b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_608b0f57455442d3b144343f526628b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 608b0f57455442d3b144343f526628b3 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-372781722 Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: fc492233f6dc49dfa1dedc70c74e49ca Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerDiskConfigTestJSON-372781722-project Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '22c88951-61f3-484c-a891-2d43ca5752bf'} Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:29.060798 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] Returning 404 to user: Instance 22c88951-61f3-484c-a891-2d43ca5752bf could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8d69d14-88cc-4c88-99dd-a9db9138cc98 tempest-ServerDiskConfigTestJSON-372781722 tempest-ServerDiskConfigTestJSON-372781722-project] 10.222.0.25 "GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf" status: 404 len: 111 microversion: 2.1 time: 0.031721 Sep 23 04:37:29.065157 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3454/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:29 2022] GET /compute/v2.1/servers/22c88951-61f3-484c-a891-2d43ca5752bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:37:37.708836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c50147af-e016-4ef7-a7b4-3fbb46474700 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: .version_select at 0x7f0c933a6430>, body: {"keypair": {"name": "tempest-keypair-1383234453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHlwmBMiJ+F5wgml28vgC08+WqrIOwfxu24iOvOxTyJB9GAhLaUzgZTD5VbdJDftzt4c/KRm7mMQLuJbCF/wnsGDFxU/P/x1yw1ZdqNJoI20ZlI4hUvewn9Y/XOnyM/Fw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:37.714595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:37.730775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c50147af-e016-4ef7-a7b4-3fbb46474700 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:37.737991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-c50147af-e016-4ef7-a7b4-3fbb46474700 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:37.765231 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c50147af-e016-4ef7-a7b4-3fbb46474700 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189730 Sep 23 04:37:37.765883 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3394/6848] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:37:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:39.107718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2117042906", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25f0ca0f-c178-43bc-b606-0859a805d244"}], "security_groups": [{"name": "tempest-securitygroup--1193035431"}], "key_name": "tempest-keypair-1383234453", "user_data": "}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:39.118237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:39.118906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:39.226177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] validate_networks() for [('25f0ca0f-c178-43bc-b606-0859a805d244', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:39.687734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:39.688203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:39.688691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:39.689113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:39.689783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:39.701716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.702146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.702594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:39.703343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.703811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.704250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:39.725175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:39.730728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:39.743131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:39.745538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:39.794829 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a9eab374-f135-4a74-9f09-89e7bfe0487e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.691613 Sep 23 04:37:39.801395 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3455/6849] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:39.818234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-55f56ee2-d01a-4db4-9cf0-0d8a2cfba364 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:39.818875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-55f56ee2-d01a-4db4-9cf0-0d8a2cfba364 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:39.821642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:39.887812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55f56ee2-d01a-4db4-9cf0-0d8a2cfba364 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:39.895537 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-55f56ee2-d01a-4db4-9cf0-0d8a2cfba364 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1239 microversion: 2.1 time: 0.092630 Sep 23 04:37:39.896133 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3395/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:39 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:40.920193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.922322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:40.929136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.929781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.930289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.931254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.932153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.932777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.047909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:41.058912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81788335-7346-4fec-9ce6-965bd18d2686 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1299 microversion: 2.1 time: 0.144472 Sep 23 04:37:41.071765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3456/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:42.083383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.084035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:42.094418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.094940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.095441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.096226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.096710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.097172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.244221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.253851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2bae4e94-1bef-4829-9e92-562bcb3155e6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.174873 Sep 23 04:37:42.254420 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3396/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:42.394010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:42.405092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.406370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.407085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.425081 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] Creating event network-changed:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h1-858495-2 Sep 23 04:37:42.431971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-771f856d-f2ac-4d2f-9b6c-8866bff6830c req-619aa80d-4712-457a-b607-7372730b39c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043107 Sep 23 04:37:42.432964 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3457/6853] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:37:43.277817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:43.278380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:43.285651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:43.286180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:43.286662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:43.288000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:43.288496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:43.288952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:43.417525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:43.425390 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dbfaf329-a16a-47e2-9e2c-2636f20d4142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.151667 Sep 23 04:37:43.425975 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3397/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:43 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:44.449217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:44.449960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:44.456929 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.457453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.457904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.458615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.459079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.459520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.588085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:44.596457 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d43fdfe3-94b8-4dd4-a49d-42eb0c20df1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.152317 Sep 23 04:37:44.597032 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3458/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:44 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:45.621039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:45.621784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:45.629404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.630079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.630354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.631072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.631546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.631992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.770328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:45.778447 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4da77a61-3e85-4a50-a691-f19d8932f483 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.162208 Sep 23 04:37:45.779265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3398/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:45 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:46.801891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:46.802449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:46.809273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:46.809806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:46.810257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:46.810993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:46.811458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:46.811899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:46.941141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:46.948947 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-553448d4-701a-4b06-9636-ff8db231b576 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.151067 Sep 23 04:37:46.949553 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3459/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:46 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:47.682799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "name": "network-vif-plugged", "status": "completed", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:47.692928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.693585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.693978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.706906 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] Creating event network-vif-plugged:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h1-858495-2 Sep 23 04:37:47.711979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4f1910d2-0c4b-4252-8267-5745d3cb4468 req-7b35ce14-4057-4d05-bd39-00e5e1b45b59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Sep 23 04:37:47.712589 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3399/6858] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:47.972161 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:47.972720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:47.979753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.980246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.980685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.981413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.981876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.982307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.133533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:48.141511 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0357b988-609e-4ea8-8271-2f4e4fb4451f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.173972 Sep 23 04:37:48.142820 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3460/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:47 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:49.166694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:49.167418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:49.174390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:49.174890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:49.175345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:49.176054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:49.176524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:49.176966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:49.309786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:49.317499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2cdf1b5a-bf84-4283-a711-06b8d58d6baf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1365 microversion: 2.1 time: 0.156028 Sep 23 04:37:49.318079 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3400/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:49 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:50.340424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:50.341035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:50.343887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:50.344705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:50.351423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:50.351905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:50.352342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.353038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:50.353527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:50.353957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.493029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:50.500707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1f01f12e-d28b-44b7-8f6c-ec0b7bf0ab2d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1551 microversion: 2.1 time: 0.164161 Sep 23 04:37:50.501286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3461/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:50 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:50.523134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:50.523655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:50.525660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:50.532010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:50.532511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:50.533502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.534340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:50.534864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:50.535349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.615971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6784fea0-a089-454e-b9d8-3785807432c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097067 Sep 23 04:37:50.616777 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3401/6862] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:37:50 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:51.534455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:51.544713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.545201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.545674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.556707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] Creating event network-changed:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h1-858495-2 Sep 23 04:37:51.561814 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f5f3845e-3dfb-40c7-a565-8b3cb940556b req-b7ff8502-e8a0-407a-8611-76466df221ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Sep 23 04:37:51.562610 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3462/6863] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:27.512490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:27.513496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=30 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:27.518590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.519246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.529580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.530082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.530535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.531252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.531725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.532169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.668706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.677063 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-13b0ccfc-10cd-4929-b8e7-3cde51e23b52 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.166856 Sep 23 04:38:27.677682 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3402/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:27.698056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:27.698813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:27.703556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.704269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.715275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.715773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.716223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.716927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.717474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.717863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.846262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.857213 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f704f83-7a98-49a4-a3c6-de1eda2dbd96 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.161258 Sep 23 04:38:27.857831 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3463/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:27.879532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.880166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.888590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.889149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.889634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.890349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.890825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.891272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.027800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.036319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d46b8182-2761-4dc6-8ba4-0d2084d87226 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.160826 Sep 23 04:38:28.036918 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3403/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:28.058388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:28.060692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.069968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.070470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.070913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.071627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.072095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.072532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.106270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.114394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:38:28.121325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:28.121782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:28.122253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:28.122659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:28.123068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:28.188288 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-25500386-8390-4281-abdf-3ed2b7f028c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/action" status: 202 len: 0 microversion: 2.1 time: 0.133893 Sep 23 04:38:28.188922 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3464/6867] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:38:28 2022] POST /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:38:28.197964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.198727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.207940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.208451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.208912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.209664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.210150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.210601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.376246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.384300 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0efe4539-2cd8-4bde-b5bf-41ae5137f722 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1679 microversion: 2.1 time: 0.190193 Sep 23 04:38:28.384904 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3404/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:28 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:29.409838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:29.410458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:29.418021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.418513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.418953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.419647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.420104 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.420530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.550482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.558659 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-288e8f2a-9243-4198-9a07-29a9130f080e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1679 microversion: 2.1 time: 0.153708 Sep 23 04:38:29.559236 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3465/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:29 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:30.582958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:30.583627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:30.590815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.591322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.591785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.592497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.592974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.593545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.721088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.728885 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1c704e06-48c4-433d-9bfe-a20bd7da05b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.150501 Sep 23 04:38:30.729477 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3405/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:30 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:31.752832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:31.753335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:31.759945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.760433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.760873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.761596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.762059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.762497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.893319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:31.901978 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4fdcd2a1-fded-43d2-9488-c8dff70ddd49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.153239 Sep 23 04:38:31.902561 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3466/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:31 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:32.926127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:32.927303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:32.934233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.934742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:32.935206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:32.935925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.936409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:32.936876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.063540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:33.071408 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-73cfa8f3-4dec-4cfa-b43e-bb715be7cd40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.149982 Sep 23 04:38:33.071994 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3406/6872] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:32 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:34.095736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:34.096380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:34.103700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.104184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.104624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.105314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.105800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.106233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.239568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.247846 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f13c782-a619-4fc2-929b-27db9b4abb0c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.156278 Sep 23 04:38:34.248431 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3467/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:34 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:35.271384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:35.272022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:35.278931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.279434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.279894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.280607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.281085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.281570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.409592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:35.418570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e06468dd-bd01-42de-b0c6-38dbc28fac16 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.151335 Sep 23 04:38:35.419188 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3407/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:35 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:36.446074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:36.446700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:36.453760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.454257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.454707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.455412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.455880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.456319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.586209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:36.594246 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cbcdbbc0-775c-411f-98a4-f1ca691d1a62 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.152748 Sep 23 04:38:36.595049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3468/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:36 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:37.617341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:37.617975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:37.625012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.625548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.626008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.626719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.627195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.627642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.758193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.765992 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94f4dc8d-66c3-4d45-88d5-e60b7a3a54fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.152663 Sep 23 04:38:37.766570 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3408/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:37 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:38.790601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:38.791429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:38.798481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.798963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.799419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.800087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.800541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.800972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.930655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.938445 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d326d805-06bc-420c-a485-5ce0dd3e5476 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.152511 Sep 23 04:38:38.939021 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3469/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:38 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:39.961917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:39.962543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:39.969860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.970363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.970868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.971631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.972100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.972547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:40.104992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.112846 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7be193c-f07f-4ca7-868e-f3433dd0c2c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.154920 Sep 23 04:38:40.113451 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3409/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:39 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:41.135733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.136348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.143613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.144105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.144556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.145252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.145746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.146185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.272953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:41.280598 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7e5beaf4-5144-40be-8922-0767ff8a68db tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.149368 Sep 23 04:38:41.281183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3470/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:42.304590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:42.305223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:42.312594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.313092 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.313574 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:42.314281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.314752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.315199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:42.444414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.453136 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-febfb454-0b49-4db5-9089-1dae8af86ec1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.152566 Sep 23 04:38:42.453764 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3410/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:42 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:43.476042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:43.476730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:43.483642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.484134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.484577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.485277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.485766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.486197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.616840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.624498 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0142cd45-190b-46e2-bd30-8c30773c1470 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.152384 Sep 23 04:38:43.625068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3471/6881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:43 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:44.648076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:44.648745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:44.656182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.656686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.657148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.657891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.658373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.658822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.786362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.794828 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-57c0661d-0c3f-4494-9325-cd6b9e93a491 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.150717 Sep 23 04:38:44.795409 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3411/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:44 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:45.818014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:45.818662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:45.825775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.826265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.826709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.827410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.827889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.828320 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.964575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.972643 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ec663257-5a60-4e2b-bdab-b98b6574c3c9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.158561 Sep 23 04:38:45.973218 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3472/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:45 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:46.996751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:46.997411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.004362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.004877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.005340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.006089 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.006573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.007030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.138858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:47.146890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-821fdad7-3b15-4b66-8d97-a0312ad57aea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1684 microversion: 2.1 time: 0.154617 Sep 23 04:38:47.147486 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3412/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:46 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:47.669588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "name": "network-vif-unplugged", "status": "completed", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:47.679352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.679866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.680284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.692296 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Creating event network-vif-unplugged:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h2-858495-2 Sep 23 04:38:47.697885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:38:47.708918 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-859ccc2f-b791-4b5a-9c85-37dc8eb9329b req-fd69156b-38a3-4c35-942a-e9263cfd6067 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044305 Sep 23 04:38:47.709864 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3473/6885] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:48.170646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:48.171643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:48.179099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.179543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.179997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.180714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.181463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.181913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.707158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.714986 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-417ebc1b-1a0e-46a5-9697-a5444986a1fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1683 microversion: 2.1 time: 0.548337 Sep 23 04:38:48.715580 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3413/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:48 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1683 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:49.726203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:49.735599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.736079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.736514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.739231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.739970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.746702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.747208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.747667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.748188 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Creating event network-changed:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h2-858495-2 Sep 23 04:38:49.748386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.748863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.749312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.753533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:38:49.764751 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2cbc4a78-c9ff-42d3-b77f-4cc526fef872 req-fa8e4ee1-2586-4a90-8e47-f57ff0481a2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043564 Sep 23 04:38:49.765522 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3474/6887] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:49.882544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.891015 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8fbfccff-3543-47f7-a42d-be7c9b2d846c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1681 microversion: 2.1 time: 0.155760 Sep 23 04:38:49.891601 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3414/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:50.916281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.916988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.924040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.925193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.925789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.926937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.927685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.928162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.059336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.067139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e0923377-943b-4e3c-acd4-a3f781a24ac1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1681 microversion: 2.1 time: 0.156228 Sep 23 04:38:51.067718 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3475/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:52.092004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.092635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.099882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.100384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.100836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.101578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.102054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.102497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.257276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.265740 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f27755ae-112d-4264-9f9d-850e8d6a0de1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1678 microversion: 2.1 time: 0.178268 Sep 23 04:38:52.266327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3415/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:52 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:52.288417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:52.288946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.296297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.296783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.297225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.297955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.298419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.298878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.359378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3013814-f09c-4dbb-a8fa-373d9c4a97d2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/action" status: 204 len: 0 microversion: 2.1 time: 0.074670 Sep 23 04:38:52.360077 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3476/6891] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:38:52 2022] POST /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:52.368185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.368818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.374784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.375290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.375748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.376458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.376935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.377395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.515110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.524263 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0df47b51-d38c-470b-8a90-42d24c4bd5b9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1678 microversion: 2.1 time: 0.159674 Sep 23 04:38:52.525397 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3416/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:52 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:53.549619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.550336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.557419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.557915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.558359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.559739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.560200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.560637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.690653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.692987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:53.701143 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83164af8-254d-4853-8206-6d9ab283c547 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1678 microversion: 2.1 time: 0.156138 Sep 23 04:38:53.701876 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3477/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:54.725248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.725831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.732705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.733211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.733709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.734426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.734904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.735361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.869566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.877469 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6055df20-ad65-4f52-9b31-30d9df93d2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.156478 Sep 23 04:38:54.878058 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3417/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:54.899928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.900543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.909073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.909579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.910024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.910716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.911169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.911595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.044680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.052562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a4e54f64-b359-468d-9a0b-a5eee0ef3e5e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.156513 Sep 23 04:38:55.053148 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3478/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.075961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.076717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.082863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.083455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.083990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.084721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.085199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.085749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.099438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "name": "network-vif-plugged", "status": "completed", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:55.105051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=100 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:55.115274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.116012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.116449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.130322 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] Creating event network-vif-plugged:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h2-858495-2 Sep 23 04:38:55.135678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-7b6fa2c4-17ec-4187-9f68-d24ae764e31f req-28e27d74-2540-4ae5-9141-78dae6f797ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041390 Sep 23 04:38:55.136477 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3479/6896] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:38:55.223392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.231386 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bb121a8-1c7f-4160-a1c7-e1cf7e2ecddf tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1670 microversion: 2.1 time: 0.160079 Sep 23 04:38:55.231916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3418/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:55.254290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.254896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.261035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.261572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.262635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.263395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.263861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.264301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.289013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:55.365790 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f8cb9e3-5e3c-40ed-baf2-0d9ddeb02637 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 204 len: 0 microversion: 2.1 time: 0.115328 Sep 23 04:38:55.366393 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3480/6898] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:55 2022] DELETE /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:55.375488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.376114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.382168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.382676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.383124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.383825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.384296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.384739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.515965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.523741 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5894c93-140c-4c86-adef-c1e0a0533184 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1676 microversion: 2.1 time: 0.152858 Sep 23 04:38:55.524333 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3419/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:56.548097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.548806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:56.555659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.556149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.556598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.557306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.557792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.558228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.689400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.697062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ea6e958-2cc1-4f47-a95a-3700edb972ca tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1676 microversion: 2.1 time: 0.153895 Sep 23 04:38:56.697673 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3481/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:57.705272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845b9ee3-4906-4cd0-a346-0093e0f0783a", "name": "network-vif-deleted", "tag": "fa31e24c-a37d-45d7-ae75-7ea76ad163aa"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:57.712715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=37 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:57.722647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:57.723277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:57.723520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.724035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.724486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.728098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:57.732700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.733276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.733826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.734640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.735184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.735693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.756072 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] Creating event network-vif-deleted:fa31e24c-a37d-45d7-ae75-7ea76ad163aa for instance 845b9ee3-4906-4cd0-a346-0093e0f0783a on n-h2-858495-2 Sep 23 04:38:57.761769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1d65b6cc-5537-4f0e-84f5-e188643b64dc req-adeb73ab-0253-4839-9f5a-13368940e960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060363 Sep 23 04:38:57.762771 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3420/6901] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:57.826369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:57.834468 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42d86461-d8ad-4d11-9814-180d5894f066 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 200 len: 1608 microversion: 2.1 time: 0.117611 Sep 23 04:38:57.835093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3482/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:57 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 1608 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:58.858889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.859601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.867070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.867570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.868024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.868732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.869233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.869701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.883966 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a HTTP/1.1 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '845b9ee3-4906-4cd0-a346-0093e0f0783a'} Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.885624 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d343bcd4-3370-428e-bf5c-2a1876e3d53e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 404 len: 111 microversion: 2.1 time: 0.032619 Sep 23 04:38:58.891422 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3421/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:58.901528 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.902143 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.909493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.909978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.910415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.911116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.911572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.912005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.927575 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a HTTP/1.1 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '845b9ee3-4906-4cd0-a346-0093e0f0783a'} Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.929246 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-54b968ba-c83b-4f5c-8fbf-26cd92a49696 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 404 len: 111 microversion: 2.1 time: 0.033068 Sep 23 04:38:58.933987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3483/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:58.983732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-991796467", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "25f0ca0f-c178-43bc-b606-0859a805d244"}], "security_groups": [{"name": "tempest-securitygroup--1193035431"}], "key_name": "tempest-keypair-1383234453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:59.088373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] validate_networks() for [('25f0ca0f-c178-43bc-b606-0859a805d244', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:38:59.525982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:59.526422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:59.526940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:59.527367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:59.527792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:59.536734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.537232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.537712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.538455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.538929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.539363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.558709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:59.564642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:59.576889 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:59.579242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:59.624654 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [d6006998-4946-4d20-8401-87b6c682858c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:39:00.632907 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [d6006998-4946-4d20-8401-87b6c682858c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 52120. Sep 23 04:39:00.636840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-20c5f28c-951f-4439-b0c6-9895144b9196 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.657150 Sep 23 04:39:00.637523 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3422/6905] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:38:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:39:00.648814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a029476c-dc50-4fd7-8046-06b32d62c336 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.649446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a029476c-dc50-4fd7-8046-06b32d62c336 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:00.706509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a029476c-dc50-4fd7-8046-06b32d62c336 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:00.713467 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a029476c-dc50-4fd7-8046-06b32d62c336 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1238 microversion: 2.1 time: 0.068716 Sep 23 04:39:00.714765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3484/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:00 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:01.739437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.740075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.746272 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.746760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.747219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.747940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.748970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.749441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.811608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:01.819760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-12b6effc-f3b5-4910-be14-f214056c915b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1296 microversion: 2.1 time: 0.085290 Sep 23 04:39:01.820445 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3423/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:02.843967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:02.844590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:02.852763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.853257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.853740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.854449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.854919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.855358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.999021 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:03.008207 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b04fd805-cb57-4139-bea0-25b25c1cfaa5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.168490 Sep 23 04:39:03.008925 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3485/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:02 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:03.064322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:03.095090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.095647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.096260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.116348 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] Creating event network-changed:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h1-858495-2 Sep 23 04:39:03.123787 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e8a657f3-5d65-4d01-b82e-6461ccf2c449 req-c4b58def-e8f2-482e-b410-aa8e544ec4f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063338 Sep 23 04:39:03.125036 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3424/6909] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:04.034058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.034613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.041474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.041975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.042426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.043133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.043602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.044042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.176827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:04.184589 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-18524d31-9b76-4fb5-a800-72061be0243d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.155299 Sep 23 04:39:04.185167 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3486/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:05.210286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:05.211014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:05.217451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.218624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.219099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.219813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.220302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.220755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.350828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.358669 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a4d2f4da-b23c-481e-af77-2ca87bfbee56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.153773 Sep 23 04:39:05.359247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3425/6911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:05 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:06.381707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.382340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.389248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.389769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.390219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.390924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.391384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.391820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.518863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:06.526641 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7dfb9d36-586c-4227-b658-70cd77e5d78e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.148847 Sep 23 04:39:06.527212 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3487/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:07.550605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.551238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.558234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.558740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.559202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.559951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.560430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.560881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.692949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:07.700701 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60359b66-341c-4e41-9a03-afd45acdde7f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.154195 Sep 23 04:39:07.701291 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3426/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:08.294341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "name": "network-vif-plugged", "status": "completed", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:08.306186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.306693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.307134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.322961 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] Creating event network-vif-plugged:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h1-858495-2 Sep 23 04:39:08.326844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b40d8f06-725f-48ed-a534-b2c8d874ede5 req-78f10f91-d9b1-44c6-998f-79722a48dbc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037475 Sep 23 04:39:08.327718 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3488/6914] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:08.725016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.725694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.732560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.733068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.733553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.734904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.735385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.735839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.860998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:08.868734 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d14d4a62-c78c-48e9-b1f0-90eb357ad588 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1364 microversion: 2.1 time: 0.147975 Sep 23 04:39:08.869313 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3427/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:09.893785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.894487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.900578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.901064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.901539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.902228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.902682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.903112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.035890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:10.043666 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1fa7c7ad-cde1-4eda-82d7-78a8461e6d18 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1550 microversion: 2.1 time: 0.155577 Sep 23 04:39:10.044277 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3489/6916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:10.067282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:10.067798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:10.069859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:10.070573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:10.077190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.077726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.078806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.079522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.079999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.080448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.158509 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ea9a80b-9520-4c7f-8200-68ff8ec1e7f0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095584 Sep 23 04:39:10.159098 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3428/6917] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:39:10 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:11.368776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:11.374056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:11.380556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.381116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.381655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.393224 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] Creating event network-changed:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h1-858495-2 Sep 23 04:39:11.398304 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-df02565b-d511-43ee-ae7a-4a67ff7af6fe req-355d4329-1361-4863-8a62-120785db39ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Sep 23 04:39:11.398921 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3490/6918] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:47.161782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:47.162663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=44 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:47.167594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:47.175413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.175924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.176381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.198894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:39:47.241023 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-884da4a2-f764-4d20-94a1-effb5fe3c5c8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action" status: 202 len: 0 microversion: 2.1 time: 0.080958 Sep 23 04:39:47.241678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3429/6919] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:39:47 2022] POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:39:47.250453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=19 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:47.251372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:47.256392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:47.257462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:47.267505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.267993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.268431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.269137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.269617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.270056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.402644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.410418 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a594da69-d815-49d6-8fa8-c923d1e522c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.164095 Sep 23 04:39:47.411019 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3491/6920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:47 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:48.435849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:48.436579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:48.443027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.444834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.444834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.444834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.445207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.445684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.576581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:48.584451 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-780cf8b4-18ce-4ac1-a054-444d9f85cc54 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.154041 Sep 23 04:39:48.585030 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3430/6921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:48 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:49.608037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:49.608655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:49.616078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.616575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.617024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.617816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.618289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.618729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.752211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:49.760147 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-859cf973-e5c2-4d82-b9ba-cd73ce7a9425 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.156744 Sep 23 04:39:49.760733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3492/6922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:49 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:50.795812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:50.796363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:50.803204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.803705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.804159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.804867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.805339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.805811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.934909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.942715 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-185f1a71-7bc6-40cb-9f93-2c5f3e72d79f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.150924 Sep 23 04:39:50.943308 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3431/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:50 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:51.968592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:51.969238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:51.976120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.976601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.977039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.977760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.978224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.978654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:52.108258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:52.116148 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81113ea0-035c-4e67-b3a4-dc01fa3f4a89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.151976 Sep 23 04:39:52.116728 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3493/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:51 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:53.139070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:53.139759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:53.146992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.147512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.147980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.148768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.149254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.149736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.278329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.286161 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-70938112-933a-4821-813a-9ebd44bcfc6c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.151109 Sep 23 04:39:53.286745 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3432/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:53 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:54.309879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:54.310496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:54.317711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.318201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.318640 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.319349 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.319805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.320233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.453440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:54.461244 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3492c1b0-b154-44ab-ba95-b0904a9b58c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.155277 Sep 23 04:39:54.462072 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3494/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:54 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:55.484734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:55.485379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:55.492645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.493148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.493632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.494337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.494810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.495253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.622054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.630616 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-47d83c34-869e-4d70-a059-ffaa684b24d5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.150428 Sep 23 04:39:55.631198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3433/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:55 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:56.653684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.654300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.661073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.661600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.662048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.662751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.663214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.663649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.791814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:56.799815 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-50e6e513-7fa0-4e25-ad65-7a1f248fe256 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.150059 Sep 23 04:39:56.800403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3495/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:56 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:57.823631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:57.824160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:57.831131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.831638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.832244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.832886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.833369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.833822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.964336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.973014 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6bb8659b-72eb-43f8-93d9-643a2ac92272 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.153350 Sep 23 04:39:57.973633 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3434/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:57 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:58.996583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:58.997199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:59.004274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.004765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.005215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.005945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.006411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.006848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.138999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.147317 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8001e7af-cc52-480c-9061-f2ecc5e24ca9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.154775 Sep 23 04:39:59.147901 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3496/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:58 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:00.171191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.171762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.179201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.179709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.180165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.180879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.181378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.181823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.312273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:00.320587 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbf19c24-923c-4cdf-92a6-46b6e2c58115 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.153599 Sep 23 04:40:00.321170 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3435/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:00 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:01.344896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:01.345541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:01.351939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.352426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.352871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.353674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.354137 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.354570 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.487481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.495324 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ccac707c-df07-45ea-ac15-529ed8b7fa2a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.155197 Sep 23 04:40:01.495911 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3497/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:01 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:02.519579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:02.520225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.527316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.527824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.528286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.529012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.529552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.529994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.662516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:02.670276 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f67cd2c-4dd0-4ddf-9e0c-deb3eaf2c5b0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1656 microversion: 2.1 time: 0.155556 Sep 23 04:40:02.670868 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3436/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:02 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:02.693106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:02.695445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.705305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.705826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.706275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.706985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.707451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.707927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.735910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:02.741512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Old instance type m1.heat2, new instance type m1.heat {{(pid=128724) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:40:02.748030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:40:02.748457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:40:02.748938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:40:02.749379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:40:02.749797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:40:02.813956 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5e2aff0-d916-4963-87c5-97c028091d71 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action" status: 202 len: 0 microversion: 2.1 time: 0.124292 Sep 23 04:40:02.814753 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3498/6934] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:40:02 2022] POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:40:02.822603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:02.823475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.830065 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.830572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.831038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.831761 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.832246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.832693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.990199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:02.998844 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c2ef52b9-2481-458e-a35d-1194b7f8698e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.180112 Sep 23 04:40:02.999433 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3437/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:02 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:04.023635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:04.024255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:04.031186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.031675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.032625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.033313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.033795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.034224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.164318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:04.174093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ee9872f-0958-40c2-800a-1d32db1049a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.155138 Sep 23 04:40:04.174693 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3499/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:04 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:05.197866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:05.198499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:05.206378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.206884 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.207335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.208055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.208527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.208970 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.339851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.348392 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56efd554-5217-4870-80f2-3a04a85cca8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1679 microversion: 2.1 time: 0.154582 Sep 23 04:40:05.348990 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3438/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:05 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:06.371673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.372283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.379222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.379703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.380141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.380994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.381612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.382048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.513975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:06.521747 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f1085f11-f958-4a42-8891-f2521eab1083 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1684 microversion: 2.1 time: 0.153931 Sep 23 04:40:06.522352 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3500/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:07.546083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:07.546784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:07.555152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.555634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.556084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.556837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.557337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.557810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.810972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.818863 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4545d48c-ba5d-4465-8091-b3784896f1a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1683 microversion: 2.1 time: 0.276823 Sep 23 04:40:07.819452 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3439/6939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:07 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1683 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:07.926246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "name": "network-vif-unplugged", "status": "completed", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:07.938949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.939429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.939864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.951835 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Creating event network-vif-unplugged:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h2-858495-2 Sep 23 04:40:07.957241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:40:07.968058 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-aba6d466-0fa3-41a6-85de-a31e2aec8a13 req-1f5adeab-e0d6-4bff-be10-43086f9f7ac0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046357 Sep 23 04:40:07.968851 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3501/6940] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:08.842002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:08.842620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:08.854797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.855669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.856138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.856878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.857415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.857872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:09.013051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:09.020952 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60b28c0c-db88-4f39-81f0-f4c2993ad69a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1683 microversion: 2.1 time: 0.182871 Sep 23 04:40:09.021575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3440/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:08 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:10.008600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:10.018025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.018503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.018948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.030322 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Creating event network-changed:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h2-858495-2 Sep 23 04:40:10.036055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:40:10.045829 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:10.046454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:10.046822 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-bb41ebcc-34c5-4927-8bc5-d58b5f5105c0 req-ef846a0d-2b72-4d71-adee-1811f7a2d55c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 Sep 23 04:40:10.047323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3502/6942] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:10.054243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.054739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.055189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.055918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.056403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.056850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.188382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:10.196595 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b95d134-4aec-47f5-888d-f9f2e2ecb138 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1681 microversion: 2.1 time: 0.154519 Sep 23 04:40:10.197457 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3441/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:10 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:11.225151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:11.225894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:11.232102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:11.232592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:11.233043 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:11.233777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:11.234247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:11.234679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:11.371198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:11.379328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b6055406-b672-4c6a-8c27-dda11d5906a1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1681 microversion: 2.1 time: 0.160126 Sep 23 04:40:11.379923 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3503/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:11 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:12.403135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:12.403768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:12.410797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.411306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.411764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.412481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.413001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.413488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.547951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:12.555756 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa9b4ab6-0399-4f96-ba01-75fd1baf9afa tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1677 microversion: 2.1 time: 0.156614 Sep 23 04:40:12.556341 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3442/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:12 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:12.578388 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:12.578933 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:12.586306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.586795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.587237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.587930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.588391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.588823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.649456 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46301882-d967-4555-b34d-58410d01ed69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action" status: 204 len: 0 microversion: 2.1 time: 0.074718 Sep 23 04:40:12.650144 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3504/6946] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:40:12 2022] POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:12.658330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:12.659021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:12.665451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.665993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.666451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.667360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.667858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.668308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.807249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:12.815721 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-512f537e-241b-48c7-989c-8284486b6a1b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1677 microversion: 2.1 time: 0.160681 Sep 23 04:40:12.816560 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3443/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:12 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:13.840183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:13.840895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:13.847763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:13.848257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:13.848703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:13.849432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:13.849897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:13.850330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:13.988473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:13.991149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:13.998313 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b966a78f-2e2d-48da-886d-a0b40820734f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1656 microversion: 2.1 time: 0.163207 Sep 23 04:40:13.998908 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3505/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:13 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:14.020967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:14.021686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:14.028595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.029111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.029604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.030330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.030811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.031278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.051284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:14.163812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:14.171802 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7acc0847-c9d2-4a87-80dd-85dcbd8a91f5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1656 microversion: 2.1 time: 0.154861 Sep 23 04:40:14.172397 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3444/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:14 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:14.193744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:14.201032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.201606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.202056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.225777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Going to try to start instance {{(pid=128724) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:40:14.266611 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-627c5341-ae2c-4155-82d3-a1af1b73dd35 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action" status: 202 len: 0 microversion: 2.1 time: 0.076648 Sep 23 04:40:14.267600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3506/6950] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:40:14 2022] POST /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:40:14.275973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:14.276611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:14.282923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.283438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.284519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.285319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.285868 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.286325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.460742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:14.469234 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-88bae034-bfd5-4945-96e0-4150281fe862 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1665 microversion: 2.1 time: 0.197050 Sep 23 04:40:14.469884 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3445/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:14 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1665 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:15.495059 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:15.495777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:15.502144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.503419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.504054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.504943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.505593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.506186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.582090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "name": "network-vif-plugged", "status": "completed", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:15.594542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.595093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.595587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.607401 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] Creating event network-vif-plugged:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h2-858495-2 Sep 23 04:40:15.613491 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b0a567a6-efee-4a05-bd8a-8a6c8346b3b9 req-06aaa916-d304-4bc3-ac3c-fffaccfe9a0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Sep 23 04:40:15.614563 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3446/6952] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:40:15.644416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.652556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dbae752e-27ea-4b23-81f2-ce39f194aa92 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1669 microversion: 2.1 time: 0.162992 Sep 23 04:40:15.653141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3507/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:15 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:15.676255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:15.676792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:15.683415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.683948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.684409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.685113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.685626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.686070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.711436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:40:15.787533 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-731b2940-d592-4857-a50b-b48fc20e88b8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 204 len: 0 microversion: 2.1 time: 0.115556 Sep 23 04:40:15.788281 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3447/6954] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:15 2022] DELETE /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:15.796697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:15.797303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:15.803816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.804313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.804754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.805480 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.805944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.806381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.935917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.944303 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ddc3db17-e5ad-4e86-8d19-094312d0e742 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1675 microversion: 2.1 time: 0.151635 Sep 23 04:40:15.944884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3508/6955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:15 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:16.968533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:16.969290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:16.976139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.976593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.977051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:16.977821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.978299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.978745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:17.109479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:17.120091 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-908c614b-750c-4a13-935c-92f6bed2ac46 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1675 microversion: 2.1 time: 0.155899 Sep 23 04:40:17.120682 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3448/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:16 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:18.144981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:18.146213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:18.149006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=41 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:18.154546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:18.155052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:18.155495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:18.156215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:18.156689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:18.157126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:18.447230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:18.456327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-92a17e7c-af67-490b-b405-08fd48b41909 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 200 len: 1607 microversion: 2.1 time: 0.315804 Sep 23 04:40:18.457617 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3509/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:18 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 1607 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:18.473506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228bdfbc-a83b-4a33-8ec7-ba20d3f7df72", "name": "network-vif-deleted", "tag": "78ac1c99-7967-43ab-bca7-768046729ea6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:18.479502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:18.486372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:18.486979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:18.487479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:18.502464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] Creating event network-vif-deleted:78ac1c99-7967-43ab-bca7-768046729ea6 for instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 on n-h2-858495-2 Sep 23 04:40:18.508338 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-70768f08-2379-463d-b41e-3a28d57ffe28 req-60bdf068-aae3-4d75-a960-3cf10bde8c6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053549 Sep 23 04:40:18.509500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3449/6958] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:19.479984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:19.480615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:19.487410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.487925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.488357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.489044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.489544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.489975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.503284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 HTTP/1.1 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '228bdfbc-a83b-4a33-8ec7-ba20d3f7df72'} Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:19.504949 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2aab6dd7-8f00-4574-b8e2-d932edd1e0a3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 404 len: 111 microversion: 2.1 time: 0.030301 Sep 23 04:40:19.509454 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3510/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:19 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:19.524646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:19.525409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:19.532665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.533172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.533671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.534387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.535535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.535992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.552944 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 HTTP/1.1 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '228bdfbc-a83b-4a33-8ec7-ba20d3f7df72'} Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:19.554618 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5a08c272-1f0f-4312-8ec3-a94640ea73fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 404 len: 111 microversion: 2.1 time: 0.035720 Sep 23 04:40:19.559255 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3450/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:19 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:19.604774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-544709461", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "25f0ca0f-c178-43bc-b606-0859a805d244"}], "security_groups": [{"name": "tempest-securitygroup--1193035431"}], "key_name": "tempest-keypair-1383234453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:19.708870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] validate_networks() for [('25f0ca0f-c178-43bc-b606-0859a805d244', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:40:20.073397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:40:20.073825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:40:20.074300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:40:20.074707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:40:20.075118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:40:20.085327 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.085866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.086299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.087019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.087471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.087897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.104995 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:40:20.110212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:40:20.122895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:40:20.125575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:40:20.172914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52be5322-5529-4295-9df1-6fea6a645b60 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.572027 Sep 23 04:40:20.173677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3511/6961] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:40:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:40:20.185296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0e8ddaaa-e2c8-4173-a8f7-ad7af56f04e5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:20.186465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0e8ddaaa-e2c8-4173-a8f7-ad7af56f04e5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:20.241730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0e8ddaaa-e2c8-4173-a8f7-ad7af56f04e5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:20.248931 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0e8ddaaa-e2c8-4173-a8f7-ad7af56f04e5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1238 microversion: 2.1 time: 0.067687 Sep 23 04:40:20.249531 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3451/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:20 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:21.272379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:21.273046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:21.281364 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.281864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.282477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.283348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.283953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.284531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.350287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:21.367133 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2874e77b-5809-4ef5-a7b0-7f1c473b3b7b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1308 microversion: 2.1 time: 0.098397 Sep 23 04:40:21.367736 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3512/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:21 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:22.390854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:22.391586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:22.400711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.401221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.401703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.402422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.402897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.403342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.539706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:22.547776 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b13dde90-1933-4605-9610-da165f0245ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1364 microversion: 2.1 time: 0.160805 Sep 23 04:40:22.548510 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3452/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:22 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:22.635744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:22.646281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.646863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.647396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.659707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] Creating event network-changed:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:40:22.664851 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-9f9c1fe4-dc26-446a-954c-c3288d91ecd4 req-4a4cdbfa-f8ec-49e3-95e7-f049ba7f5d0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033276 Sep 23 04:40:22.666064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3513/6965] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:40:23.572168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:23.572802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:23.579697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:23.580200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:23.580680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:23.581419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:23.581899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:23.582348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:23.716453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:23.724356 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7071b82f-1d08-477d-a621-6bc873d43bba tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1364 microversion: 2.1 time: 0.156625 Sep 23 04:40:23.724884 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3453/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:23 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:24.748941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:24.749713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:24.757252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:24.757998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:24.758448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:24.759193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:24.759660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:24.760098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:24.905151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.913513 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-89a0bd14-1121-4db8-9611-9595983fd882 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1364 microversion: 2.1 time: 0.169895 Sep 23 04:40:24.914093 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3514/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:24 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:25.940551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:25.941210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:25.948717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.949222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.949732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:25.950444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.950918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.951363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:26.082101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:26.090514 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e914c9c2-2253-44ea-b413-a54aaa7fdcce tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1364 microversion: 2.1 time: 0.153930 Sep 23 04:40:26.091097 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3454/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:25 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:26.658390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "name": "network-vif-plugged", "status": "completed", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:26.669674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:26.670248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:26.670718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:26.682987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] Creating event network-vif-plugged:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:40:26.688165 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-534d402a-d003-4feb-b61b-e521951a0c16 req-ad95cc5a-abe5-40bc-874a-89faab77f1a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Sep 23 04:40:26.688770 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3515/6969] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:27.113743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:27.114299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:27.122428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:27.122965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:27.123420 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:27.124130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:27.124598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:27.125045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:27.254953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:27.263549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b35e8c4-71a3-4488-9b5e-6e92e08387c2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1364 microversion: 2.1 time: 0.154127 Sep 23 04:40:27.264170 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3455/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:27 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:28.289677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:28.290312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:28.296557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.297052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.297538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.298269 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.298735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.299171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.427202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:28.435551 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cc6766a1-c5e9-42f8-a457-dac8dc0f814b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1551 microversion: 2.1 time: 0.151753 Sep 23 04:40:28.436135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3516/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:28.458430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:28.458953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:28.466432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.466939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.467841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.468110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.468587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.469037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.551039 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-758e6222-f5ed-4ef8-a618-fd7381c3b31e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096530 Sep 23 04:40:28.551659 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3456/6972] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:40:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:29.464416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:29.474676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.475670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.476109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.487411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] Creating event network-changed:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:40:29.493291 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-f0ec3600-bd83-454b-867e-63dd0a6293aa req-86b0a7b5-ce34-46be-8a2b-a8dfd02e9fb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Sep 23 04:40:29.494089 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3517/6973] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:02.611327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.612194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=17 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.612991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.617463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:02.619719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:02.628291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.628787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.629240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.630029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.630504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.630952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.663643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:02.669094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:41:02.675600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:02.676035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:02.676523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:02.676944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:02.677392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:02.741829 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5db192e4-e6ec-4a6f-8e04-470dbc8ac2f8 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/action" status: 202 len: 0 microversion: 2.1 time: 0.132472 Sep 23 04:41:02.742429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3457/6974] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:41:02 2022] POST /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:41:02.747828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.749023 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.752230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.752909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:02.757532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:02.758247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:02.768553 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.769154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.769662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.770373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.770838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.771272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.970399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:02.978871 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6523a4f6-d6d9-4894-bde3-adcb7eb6c142 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1679 microversion: 2.1 time: 0.231925 Sep 23 04:41:02.979466 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3518/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:02 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:04.002445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:04.003108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:04.011446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.011962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.012422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.013144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.013646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.014096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.196540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.205065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-caa709c3-4955-43f7-8d5e-277f90ed79b4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1679 microversion: 2.1 time: 0.206977 Sep 23 04:41:04.205754 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3458/6976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:03 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:05.228676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:05.229294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:05.236743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.237229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.237699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.238405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.238868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.239305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.368728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:05.376898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10081ec8-fbb4-4c5d-84a9-e26db7a26ec2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.152234 Sep 23 04:41:05.377525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3519/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:05 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:06.400770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:06.401329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:06.408245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.408749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.409210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:06.409945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.410421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.410867 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:06.538564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:06.546515 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68b2d603-f977-4ad6-9147-58aa57e1beac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.149714 Sep 23 04:41:06.546972 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3459/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:06 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:07.570830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:07.571489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:07.582963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:07.583455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:07.583903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:07.584629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:07.585093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:07.585557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:07.716766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:07.724490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e090e18-78b0-418d-a161-1da1f22fa447 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.158106 Sep 23 04:41:07.725064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3520/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:07 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:08.748805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:08.749397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:08.757191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:08.757732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:08.758192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:08.758904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:08.759375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:08.759821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:08.886167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:08.894603 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-25991602-a430-43fc-8165-7bfc38b1bc69 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.149810 Sep 23 04:41:08.895180 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3460/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:08 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:09.917907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:09.918450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:09.925321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:09.925825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:09.926272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:09.926974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:09.927438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:09.927871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.059223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.067086 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f5786393-bd75-4054-976a-66393fb1c1f2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.153205 Sep 23 04:41:10.067667 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3521/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:09 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:11.090857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:11.091494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:11.098877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.099386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.099840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:11.100550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.101022 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.101500 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:11.231698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:11.240278 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a041ec19-2b95-40f3-8efb-f58789471485 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.153402 Sep 23 04:41:11.240855 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3461/6982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:11 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:12.262815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:12.263432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:12.270252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:12.270735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:12.271171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.271860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:12.272316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:12.272743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.399168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:12.406867 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-009bfbb8-94ab-4151-a73f-f64899c27aae tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.147923 Sep 23 04:41:12.407453 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3522/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:12 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:13.430062 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:13.430730 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:13.437762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.438408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.438865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.439575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.440052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.440528 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.572260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:13.580165 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2601a7bb-572b-4983-b017-79ed64646fe7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.154050 Sep 23 04:41:13.580745 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3462/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:13 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:14.603821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:14.604434 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:14.611328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.611810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.612249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.612938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.613423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.613852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.742300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:14.750032 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-edcf57d6-c6fd-4356-9693-c5f72cf85dab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.150142 Sep 23 04:41:14.750613 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3523/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:14 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:15.773880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:15.774445 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:15.781431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:15.781943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:15.782404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:15.783118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:15.783597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:15.784050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:15.916850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:15.924757 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-274f48ba-e96d-4e9d-91fd-591fc81c4746 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1684 microversion: 2.1 time: 0.155526 Sep 23 04:41:15.925873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3463/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:15 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:16.888585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "name": "network-vif-unplugged", "status": "completed", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:16.900465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.901058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.901533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.914416 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Creating event network-vif-unplugged:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h2-858495-2 Sep 23 04:41:16.919913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] Instance 27bb303c-3968-4160-a3a7-7a17224071f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:41:16.931490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-61315cb8-4d68-411b-9db5-9f5d84d16362 req-8f61a281-a176-4adb-b2e0-4439f9b76226 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046749 Sep 23 04:41:16.932135 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3524/6987] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:16.948446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:16.949085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:16.955373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.955888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.956354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.957669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.958200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.958660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.194591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.202506 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1ed1d9f1-c5ed-4459-bfc3-e933670b6788 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1683 microversion: 2.1 time: 0.258094 Sep 23 04:41:17.203212 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3464/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:16 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:18.229548 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:18.230290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:18.236587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:18.237070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:18.237542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:18.238253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:18.238711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:18.239145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:18.376107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.384059 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c9bd8fc-70c1-4ded-a540-68087fdc33bc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1681 microversion: 2.1 time: 0.159835 Sep 23 04:41:18.384648 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3525/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:18 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:18.951554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:18.961844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:18.962340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:18.962794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:18.974741 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Creating event network-changed:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h2-858495-2 Sep 23 04:41:18.980033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] Instance 27bb303c-3968-4160-a3a7-7a17224071f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:41:18.991462 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3b6b3d38-14e3-484c-9ad1-92062b4e19c9 req-dc4cb11c-fd62-41b3-9ab3-931166b607c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043622 Sep 23 04:41:18.992079 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3465/6990] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:19.407976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:19.408590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:19.416155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.416660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.417101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.417832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.418286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.418714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.563226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:19.572127 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b56b2261-299a-42ed-bc2b-ca6f767d9ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1681 microversion: 2.1 time: 0.167965 Sep 23 04:41:19.572726 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3526/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:19 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:20.597058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:20.597809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:20.604616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.605118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.605600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.606314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.606795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.607336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.765547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:20.776630 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e6d22c45-d9a6-45af-97f6-7130059b330b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1681 microversion: 2.1 time: 0.184557 Sep 23 04:41:20.780177 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3466/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:20 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:21.801027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:21.802318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:21.809101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.809625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.810073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.810781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.811240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.811675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.943492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.951401 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6810f55c-2e13-4acf-bfa0-f28bff5d91fd tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1678 microversion: 2.1 time: 0.154269 Sep 23 04:41:21.952023 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3527/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:21 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:21.974061 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:21.974619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:21.981537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.982054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.982507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.983230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.983707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.984159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.022338 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.022845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.023305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.024060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.024543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.025000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.046295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:22.052050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:22.152155 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44f11271-f4c7-4a55-96eb-8ff9862942c7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/action" status: 202 len: 0 microversion: 2.1 time: 0.181926 Sep 23 04:41:22.152765 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3467/6994] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:41:21 2022] POST /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:41:22.160997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:22.161770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:22.167705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.168196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.168636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.169333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.169949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.170485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.368285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.376279 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f86fcf7-e214-494a-a698-a4d11362e73c tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1677 microversion: 2.1 time: 0.219301 Sep 23 04:41:22.376962 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3528/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:22 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:23.402116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:23.402975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:23.410392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.410950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.411413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.412161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.412637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.413087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.547775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:23.555646 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fec6079-814b-4ad0-87de-09f0bc107eb3 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1677 microversion: 2.1 time: 0.159394 Sep 23 04:41:23.556228 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3468/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:23 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:23.887993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "name": "network-vif-plugged", "status": "completed", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:23.899249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.899743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.900200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.912060 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Creating event network-vif-plugged:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h2-858495-2 Sep 23 04:41:23.917559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] Instance 27bb303c-3968-4160-a3a7-7a17224071f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:41:23.928397 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1eb76cca-d040-4e3f-89f7-bb8ce319e970 req-a06edd3a-fb71-441b-bb68-3a1f905d6da8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044115 Sep 23 04:41:23.929235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3529/6997] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:24.578891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:24.579524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:24.587038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.587538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.587993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.588702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.589179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.589647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.607573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:24.726771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:24.734674 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b087857b-8639-4841-bc25-4a1f01db58da tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1677 microversion: 2.1 time: 0.159631 Sep 23 04:41:24.735301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3469/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:24 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:25.547571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "name": "network-vif-unplugged", "status": "completed", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:25.559354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.559841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.560279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.573378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Creating event network-vif-unplugged:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:41:25.579150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] Instance 27bb303c-3968-4160-a3a7-7a17224071f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:41:25.590727 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-ddd466b9-5d3e-4c3c-9a78-d03ab4a17d5c req-5652b423-5977-414e-a8bb-d6d83b60d9c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049016 Sep 23 04:41:25.591315 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3530/6999] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:25.757878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:25.758526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:25.767213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.767762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.768225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.768958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.769487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.770014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.913695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.921904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8d98faf-d14c-48eb-b3e0-5381c9c44810 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1677 microversion: 2.1 time: 0.168345 Sep 23 04:41:25.922502 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3470/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:25 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:26.947969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:26.948686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:26.954883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.955368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.955802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.956492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.956944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.957390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.087389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.095148 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1fc4eb0-7706-4ff6-ae29-66c56b4a5969 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1677 microversion: 2.1 time: 0.152777 Sep 23 04:41:27.095733 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3531/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:26 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:27.630048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:27.640825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.641321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.641796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.654068 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Creating event network-changed:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:41:27.659725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] Instance 27bb303c-3968-4160-a3a7-7a17224071f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:41:27.670801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d1141f8d-a8c4-4bd7-8fdd-bff971bde33a req-720c8f79-e512-4dc9-9376-5036802c4e47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044789 Sep 23 04:41:27.671394 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3471/7002] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:28.119535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.120148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.130805 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.132256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.133405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.134870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.135579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.137308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.346497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:28.356296 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c2f15739-be3e-4518-a091-33846cd4afd4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1670 microversion: 2.1 time: 0.241367 Sep 23 04:41:28.356900 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3532/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:28.380376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.381106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.387255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.387754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.388209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.388915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.389410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.389858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.523835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:28.531683 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f43faeec-49a4-4b91-9060-6f46ede4fc49 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1670 microversion: 2.1 time: 0.156001 Sep 23 04:41:28.532260 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3472/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:28.554664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.555272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.561065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.561588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.562025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.562713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.563164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.563601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.689752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:28.697405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16f586d7-3ee4-4bce-92d5-c81e5bae5614 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1670 microversion: 2.1 time: 0.147277 Sep 23 04:41:28.697984 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3533/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:28.720779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.721410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.728219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.728723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.729189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.729967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.730444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.730890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.756540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:41:28.832153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d31de10-6111-423c-a89e-45f47afd340d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 204 len: 0 microversion: 2.1 time: 0.115856 Sep 23 04:41:28.833025 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3473/7006] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:41:28 2022] DELETE /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:41:28.843696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.844566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.851462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.851976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.852412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.853229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.853837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.854439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.997733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.006580 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42764ba9-736e-47d3-802f-3a60252dd731 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1676 microversion: 2.1 time: 0.168137 Sep 23 04:41:29.007182 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3534/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:30.031279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.032003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.039517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.040021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.040480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.041191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.041695 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.042147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.173336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.181278 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f50b2d4c-7802-491b-ac15-c2f987e1098a tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1676 microversion: 2.1 time: 0.154346 Sep 23 04:41:30.181918 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3474/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:31.031207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb303c-3968-4160-a3a7-7a17224071f7", "name": "network-vif-deleted", "tag": "46e16654-ec9a-4588-9afe-c9893cd3ed34"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:31.043066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.043555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.044330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.056677 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] Creating event network-vif-deleted:46e16654-ec9a-4588-9afe-c9893cd3ed34 for instance 27bb303c-3968-4160-a3a7-7a17224071f7 on n-h1-858495-2 Sep 23 04:41:31.061467 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-3dc24146-cbc7-449c-a385-8b33bca6d89d req-af65d42f-84f1-4d03-8e73-6351361925de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099053 Sep 23 04:41:31.062105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3535/7009] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:31.206680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:31.207379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:31.214976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.215478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.215929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.216645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.217106 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.217576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.252359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.253056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.253562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.254296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lazy-loading 'fault' on Instance uuid 27bb303c-3968-4160-a3a7-7a17224071f7 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:41:31.295712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:31.303872 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5885ee0b-6ecd-4faa-9b3a-2d045a7cf20d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 200 len: 1328 microversion: 2.1 time: 0.101170 Sep 23 04:41:31.304462 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3475/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:31 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:32.334588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:32.335334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:32.341752 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.342237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.342674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.343384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.343840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.344267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.348922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=100 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:32.359805 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 HTTP/1.1 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '27bb303c-3968-4160-a3a7-7a17224071f7'} Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:32.361452 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ef3adf4a-87ba-414b-8c1b-66a791e108ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 404 len: 111 microversion: 2.1 time: 0.034344 Sep 23 04:41:32.365987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3536/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:32 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:41:32.377546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:32.383321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:32.383949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:32.390143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.390641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.391084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.391785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.392250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.392696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.406493 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 HTTP/1.1 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '27bb303c-3968-4160-a3a7-7a17224071f7'} Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:32.408108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-84276feb-cc43-4035-a86f-2792e6278a21 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 404 len: 111 microversion: 2.1 time: 0.032895 Sep 23 04:41:32.412806 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3476/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:32 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:41:32.460240 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2041002743", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "25f0ca0f-c178-43bc-b606-0859a805d244"}], "security_groups": [{"name": "tempest-securitygroup--1193035431"}], "key_name": "tempest-keypair-1383234453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:32.563568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] validate_networks() for [('25f0ca0f-c178-43bc-b606-0859a805d244', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:41:32.931547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:32.932010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:32.932494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:32.932924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:32.933333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:32.935292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=43 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:32.944489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.944978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.945461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.946204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.946668 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.947135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.964974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:32.970430 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:32.982783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:41:32.985140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:41:33.032116 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2dc7244d-c335-449d-a8ea-38c92ff38290 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.576263 Sep 23 04:41:33.032690 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3537/7013] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:41:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:41:33.044219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec045c12-5cd9-4f31-bf04-8e12c197e210 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.044851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec045c12-5cd9-4f31-bf04-8e12c197e210 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.046753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:33.106885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ec045c12-5cd9-4f31-bf04-8e12c197e210 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.115535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec045c12-5cd9-4f31-bf04-8e12c197e210 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1239 microversion: 2.1 time: 0.074848 Sep 23 04:41:33.115998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3477/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:34.141581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:34.142925 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:34.149959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:34.150673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:34.151289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:34.152182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:34.152802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:34.153241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:34.241549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:34.249556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e7b4f1b6-bd93-482a-8929-c87baf96815d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1309 microversion: 2.1 time: 0.113300 Sep 23 04:41:34.250133 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3538/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:34 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:35.277547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:35.278831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.286762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.287871 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.288402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.289419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.289971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.291138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.483059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.494257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b4e918fa-5b78-414a-9472-2ecdd37c4ad9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.224454 Sep 23 04:41:35.496347 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3478/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:35.612456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:35.624126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.624851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.625284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.638113 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] Creating event network-changed:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:41:35.642969 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-a68c141a-09df-46a7-b3f4-e86cc0301459 req-705d5ea6-7c5d-428c-8d46-737013fc2346 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034374 Sep 23 04:41:35.643818 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3539/7017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:36.524731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.525422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.532317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.532810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.533262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.533998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.534466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.534907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.662763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.670618 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5719e098-e35f-4995-81d2-e9fd30401e3b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.150545 Sep 23 04:41:36.671208 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3479/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:37.695321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:37.696024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:37.702148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.702631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.703061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.703744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.704194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.704618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.836375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.843964 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c2d3034-c089-4ea3-a82a-9f6624555eb2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.153826 Sep 23 04:41:37.844535 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3540/7019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:37 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:38.868123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:38.868767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:38.875816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.876323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.876783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.877541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.878018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.878465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.008853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.016613 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f99b938f-fdfd-4b89-be06-bc158cf75956 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.152636 Sep 23 04:41:39.017196 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3480/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:38 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:40.040421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:40.041039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:40.048024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.048571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.049050 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.049785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.050243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.050675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.182348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.190141 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ee681653-6868-4873-b905-9b398ebdd0ea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.153943 Sep 23 04:41:40.190731 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3541/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:40 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:41.214082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:41.214722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:41.221728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.222238 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.222694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.223411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.223887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.224334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.355672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.363460 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-63e060ca-1b33-46f2-8038-a35e29588a82 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.153398 Sep 23 04:41:41.364044 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3481/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:41 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:42.050725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-plugged", "status": "completed", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:42.060897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.061404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.062184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.073733 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] Creating event network-vif-plugged:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:41:42.078576 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-79cef2c0-7fb5-4f73-93ce-b74766995ea5 req-130f8d70-8105-413d-9ee1-a48f9bf917dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084998 Sep 23 04:41:42.079168 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3542/7023] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:42.387633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:42.388262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:42.395224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.395726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.396181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.396883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.397375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.397811 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.529269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.537110 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7b00436f-2f1b-44ea-a4bb-d751c0bdd25e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1365 microversion: 2.1 time: 0.153510 Sep 23 04:41:42.537717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3482/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:42 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.558110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:43.558999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:43.564508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.565224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.573459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.573974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.574411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.575112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.575566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.575994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.711727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.721597 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b77897cb-179c-413e-9efe-9624b7fd6dee tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1552 microversion: 2.1 time: 0.164308 Sep 23 04:41:43.722302 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3543/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.746216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.746718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.748611 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:43.755069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.755681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.756422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.757145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.757654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.758138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.837095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36a3afa7-56ac-4258-987e-9c7de0a841d6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095412 Sep 23 04:41:43.837781 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3483/7026] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:45.098233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:45.108374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.108854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.109285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.121110 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] Creating event network-changed:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:41:45.126318 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e7103b0d-bd5b-4da4-8b36-050ca6ffb0ad req-53d0db05-2735-483a-b21b-81674c620c82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089122 Sep 23 04:41:45.126960 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3544/7027] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:58.584398 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 04:42:58.584962 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 (ip 10.222.0.25) !!! Sep 23 04:42:58.585864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=15 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:58.586700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:58.592134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:58.592759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:58.600643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.601140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.601620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:58.602326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.602797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.603248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:58.735675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.743571 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65db796e-0a65-455c-a1b9-979cbfc1c866 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1671 microversion: 2.1 time: 0.162535 Sep 23 04:42:58.744156 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3484/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:58 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:58.767017 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 04:42:58.767537 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments (ip 10.222.0.25) !!! Sep 23 04:42:58.768609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:58.769345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=32 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:58.773998 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4ffe813-6df8-49e5-b06f-c089bf242df0"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:58.776414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:58.785291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.785749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.786189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:58.786881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.787340 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.787768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.046475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f29a0d2-c619-4359-8840-b53e60051aeb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282273 Sep 23 04:42:59.047099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3545/7029] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:42:58 2022] POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:43:10.821097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:10.823467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:10.826293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.827027 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.833120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.833641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.834103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.834821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.835301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.835750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.863651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:10.869018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:43:10.876635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:10.877076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:10.877603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:10.878030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:10.878459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:10.940465 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-09d3c1d3-4b2f-4cae-861c-48122a986eef tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/action" status: 202 len: 0 microversion: 2.1 time: 0.123283 Sep 23 04:43:10.944073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3485/7030] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:43:10 2022] POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:43:10.947651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.948978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.955070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:10.955779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:10.966065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.966554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.966992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.967725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.968180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.968613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:11.128148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:11.136619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65500e5a-9e17-461c-800a-5d12685fa83f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1726 microversion: 2.1 time: 0.190978 Sep 23 04:43:11.137188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3546/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:10 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:12.161859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:12.162406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:12.169815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.170303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.170763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.171493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.171969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.172418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.371461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:12.380350 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7af88ee5-513e-444d-9d7f-a565f565c213 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1726 microversion: 2.1 time: 0.223456 Sep 23 04:43:12.380940 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3486/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:12 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:13.404223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:13.404970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:13.412379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:13.412864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:13.413306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:13.414025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:13.414484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:13.414916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:13.545641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:13.554367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b32b3bf-c567-4478-915c-33415b365fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.154149 Sep 23 04:43:13.554944 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3547/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:13 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:14.577129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:14.577747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:14.584634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.585140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.585641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.586362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.586850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.587302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.715879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:14.726956 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4eccbea9-3af5-4c21-8d4f-44685f2ff0a2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.153823 Sep 23 04:43:14.727549 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3487/7034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:14 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:15.752241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:15.752775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:15.759542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:15.760028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:15.760470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:15.761166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:15.761650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:15.762083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:15.895375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:15.903614 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f217747e-9113-4b46-bda7-af4bacea76ac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.155975 Sep 23 04:43:15.904199 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3548/7035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:15 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:16.927458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:16.928084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:16.934476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.934972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.935424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:16.936134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.937094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.937648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:17.065005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:17.073314 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-608326e5-4760-4208-8265-50f609756630 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.149798 Sep 23 04:43:17.073919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3488/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:16 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:18.096538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:18.097193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:18.104467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:18.105045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:18.105618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:18.106414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:18.106946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:18.107457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:18.234978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:18.243241 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-393a3ab8-af57-44e5-a816-0bf79b66a116 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.151335 Sep 23 04:43:18.243816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3549/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:18 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:19.267326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:19.267987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:19.275197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:19.275706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:19.276167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:19.276881 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:19.277433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:19.277834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:19.414494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:19.422948 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-65410c8d-833c-440f-bd70-93ecf8afc854 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.159724 Sep 23 04:43:19.423734 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3489/7038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:19 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:20.446741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:20.447379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:20.454497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.454984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.455422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.456540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.456999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.457521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.585094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:20.593932 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e284b13e-07e1-4628-a500-db831e143b58 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.150573 Sep 23 04:43:20.594507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3550/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:20 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:21.617682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:21.618324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:21.625400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:21.625910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:21.626372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:21.627086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:21.627563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:21.628010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:21.760277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:21.769490 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0d738a13-513f-496d-bcf4-2643f503e136 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.155509 Sep 23 04:43:21.770078 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3490/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:21 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:22.793280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:22.793947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:22.801661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.802154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.802601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.803305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.803770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.804206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.933042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:22.941253 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-addfe0f7-ef5b-4ea3-a92e-5ea5316cc670 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.151983 Sep 23 04:43:22.941920 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3551/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:22 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:23.964882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:23.965566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:23.972438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:23.972941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:23.973421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:23.974129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:23.974607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:23.975055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:24.105168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:24.114133 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d63c1af1-7a96-4689-b655-11da0b9601d1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.153258 Sep 23 04:43:24.114715 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3491/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:23 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:25.138261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:25.138830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:25.146701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.147193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.147636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.148339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.148798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.149230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.278749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:25.287033 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cf8ae6db-c37d-4ab2-9edb-c076fbb26743 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.152755 Sep 23 04:43:25.287620 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3552/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:25 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:26.310726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:26.311346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:26.318491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.319169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.319795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:26.320510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.320983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.321462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:26.453146 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:26.464971 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a2f1d9e2-c27f-40a0-8350-423fc3598106 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.157643 Sep 23 04:43:26.466185 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3492/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:26 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:27.493090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:27.494093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:27.501026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:27.501558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:27.502001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:27.502700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:27.503156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:27.503585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:27.634526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:27.644452 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7ae665b-0c39-49ee-8f64-266f7eab9a6d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.155987 Sep 23 04:43:27.645323 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3553/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:27 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:28.669601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:28.670252 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:28.677113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:28.677643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:28.678099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:28.678804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:28.679275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:28.679719 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:28.814971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:28.823196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41679ee4-d8cb-46ba-8e99-564caed80da2 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.157619 Sep 23 04:43:28.823774 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3493/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:28 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:29.849759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:29.850292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:29.857141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:29.857660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:29.858097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:29.858793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:29.859243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:29.859671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:29.994855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:30.003156 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ee80f6e-45a2-4a30-96a7-1ccc9038e8a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.159568 Sep 23 04:43:30.004572 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3554/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:29 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:31.028401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:31.029397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:31.037297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:31.037857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:31.038321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:31.039239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:31.040039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:31.040270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:31.170459 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:31.179739 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-15d9c42f-c79c-4f48-bbf2-95691ad0ba40 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1731 microversion: 2.1 time: 0.155621 Sep 23 04:43:31.180327 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3494/7048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:31 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:32.204717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:32.205343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:32.212092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:32.212608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:32.213048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:32.213794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:32.214256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:32.214683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:32.352407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:32.361102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9132bd3a-2f00-4172-88ab-66f026f98da7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1730 microversion: 2.1 time: 0.161284 Sep 23 04:43:32.361982 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3555/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:32 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:32.574308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-unplugged", "status": "completed", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:32.585755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:32.586263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:32.586727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:32.603367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Creating event network-vif-unplugged:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h1-858495-2 Sep 23 04:43:32.609408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:43:32.621778 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b780cd17-2567-4c77-9e0a-587083f3efc0 req-930ce613-7185-4853-8a85-a4dabf152f14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051169 Sep 23 04:43:32.622521 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3495/7050] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:33.386215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:33.386871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:33.393724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:33.394216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:33.394662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:33.396147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:33.396612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:33.397175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:33.532542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:33.541139 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8bb9e18f-ce75-4f45-b2b7-2f170529cfac tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1730 microversion: 2.1 time: 0.158836 Sep 23 04:43:33.542189 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3556/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:33 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:34.564563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:34.566043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:34.574419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:34.575019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:34.575540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:34.576530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:34.577071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:34.577555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:34.660671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:34.672590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:34.673075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:34.673545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:34.686021 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Creating event network-changed:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h1-858495-2 Sep 23 04:43:34.691597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:43:34.703930 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e009ba52-276b-4ac2-a30a-68ce96067089 req-db039f74-fdc4-4e90-b3ed-5925a5c05bc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047793 Sep 23 04:43:34.704825 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3557/7052] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:43:34.727879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:34.756714 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-93ce5f9b-f6bb-4434-9efb-107929de0fb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.196067 Sep 23 04:43:34.758170 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3496/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:34 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:35.783749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:35.784450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:35.791631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.792120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.792592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.793294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.793779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.794209 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.930424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:35.939121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81ee0010-9171-441f-8be8-ce31a35430a0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.160502 Sep 23 04:43:35.939719 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3558/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:35 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:36.963940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:36.964604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:36.971697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.972199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.972653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:36.973882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.974354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.974798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:37.106558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.115243 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d78f2478-b955-44fb-810b-6c289e256534 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.155230 Sep 23 04:43:37.116039 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3497/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:36 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:38.138935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:38.139547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:38.149048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.149591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.150029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.150749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.151193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.151638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.301213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.310284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-842bb349-c216-4841-a560-b633e5512965 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.175104 Sep 23 04:43:38.310886 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3559/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:38 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:39.334042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:39.334674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:39.341627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.342135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.342596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.343314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.343796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.344251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.477450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:39.485863 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-230d91fe-c8b2-40d8-9363-31363f2814e7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.155843 Sep 23 04:43:39.486454 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3498/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:39 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:40.509873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:40.510498 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:40.517368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.517868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.518312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.519053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.519517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.519951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.665264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.673701 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-67321d77-2225-4372-88ed-50bcc31a7c31 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.167652 Sep 23 04:43:40.674235 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3560/7058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:40 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:41.696879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:41.697560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:41.700495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=33 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:41.705920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.706440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.706898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.707623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.708605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.709102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.713292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:41.846499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:41.855732 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8c939325-1acc-482d-a1fd-aa71cb43f2f7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.162860 Sep 23 04:43:41.856319 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3499/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:41 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:42.878676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:42.879323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:42.882653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=31 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:42.887830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:42.888312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:42.888751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:42.889465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:42.889927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:42.890354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:42.893069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=89 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:43.018415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:43.027475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0cd699ae-ebbd-4204-b338-59c67ac2e5dc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.152703 Sep 23 04:43:43.028068 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3561/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:42 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:44.050814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:44.051452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:44.058542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:44.059047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:44.059501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:44.060204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:44.060673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:44.061116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:44.195899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:44.204581 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea9b8a6a-83d2-452c-ade5-1f6936750522 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.157817 Sep 23 04:43:44.205165 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3500/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:44 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:45.228704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:45.229407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:45.236385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:45.236873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:45.237308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:45.238034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:45.238486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:45.238914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:45.370189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:45.378338 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c198e2fb-2a38-4a6a-a0f6-d1709c852ac0 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1728 microversion: 2.1 time: 0.154122 Sep 23 04:43:45.378912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3562/7062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:45 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:46.402403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:46.403031 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.408994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.409525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.409981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.410688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.411157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.411598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.544386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:46.553092 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-880ced65-6b6c-40fa-96a0-90dbb235ef70 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1725 microversion: 2.1 time: 0.154924 Sep 23 04:43:46.553784 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3501/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:46 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:46.576121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:46.576663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.583515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.584008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.584506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.585738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.586206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.586642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.623186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.623671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.624114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.624848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.625309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.625848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.646366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:46.651828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Getting quotas for user 6b1823e759b44dd7b5b0894e8e1353c8 and project 912548a7ed864971bfc3fa48ff626a24. Resources: {'cores', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:46.750660 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f6ccf9ef-db25-4f6c-b585-1d282622ac56 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/action" status: 202 len: 0 microversion: 2.1 time: 0.178210 Sep 23 04:43:46.751261 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3563/7064] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:43:46 2022] POST /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:43:46.760261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:46.760895 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.767078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.767633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.768094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.768877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.769440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.769948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.907169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:46.916564 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cee51cc2-3ac8-4781-930a-2940f90cf031 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.161040 Sep 23 04:43:46.917164 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3502/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:46 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:47.560218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-plugged", "status": "completed", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:47.570446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:47.571068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:47.571513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:47.584257 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Creating event network-vif-plugged:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h1-858495-2 Sep 23 04:43:47.589859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:43:47.601661 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b18dddc4-1521-48c8-80f6-e153dc1278ab req-99e466bc-ea30-410e-b5ab-b4c2bbd47767 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045799 Sep 23 04:43:47.602292 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3564/7066] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:47.940857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:47.941527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:47.951920 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:47.952436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:47.952901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:47.953653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:47.954139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:47.954612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:48.083177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:48.092284 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da302ce1-3b5f-412c-975a-34284d9c4ffb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.155442 Sep 23 04:43:48.092867 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3503/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:47 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:49.119492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:49.120813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:49.131079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.131794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.132304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.133077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.133799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.134296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.269700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:49.278914 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-beaa01e8-4bef-47ec-a626-fb047aba02a5 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.166717 Sep 23 04:43:49.279571 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3565/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:49 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:50.302957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:50.304304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:50.311230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.311794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.312259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.312974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.313492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.313924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.442350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:50.450756 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e7af44c8-26f7-4681-adc1-cc2d3d95aa90 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.151770 Sep 23 04:43:50.451340 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3504/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:50 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:51.476303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:51.477639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:51.485432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:51.486424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:51.487198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:51.488210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:51.489413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:51.490022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:51.543576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-unplugged", "status": "completed", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:51.557162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:51.557823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:51.558419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:51.571742 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Creating event network-vif-unplugged:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:43:51.579056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:43:51.591610 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-859d8b43-f238-4401-9296-57dd0c735a95 req-3bc8051d-c30e-4fd9-ba98-5a53a2c2562e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053694 Sep 23 04:43:51.592857 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3505/7070] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:51.739333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:51.748123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46bd8fda-64b0-4eca-ad40-30a1bc3ad5fc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.278587 Sep 23 04:43:51.748711 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3566/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:51 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:52.635343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:52.646039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.646413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.646865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.659999 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Creating event network-changed:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:43:52.665949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:43:52.676874 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b1fb97a8-f683-4e04-8a9f-483edfe31b43 req-a8da85bf-a183-4062-ad4c-38e545aea67d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046165 Sep 23 04:43:52.677892 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3506/7072] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:52.772184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:52.774160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:52.783025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.783644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.784195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.785028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.785638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.786285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.999850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:53.009120 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d579c4d-8c0f-4a61-9495-6c5c5935fb20 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.240878 Sep 23 04:43:53.009894 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3567/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:52 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:54.033606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:54.034332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:54.041302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.041833 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.042293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.043016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.043510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.043957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.180191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:54.188720 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38e9e230-492b-4bfe-a303-67c4d44dba42 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.160348 Sep 23 04:43:54.189305 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3507/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:54 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:55.212660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:55.213425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:55.220195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.220686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.221120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.221836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.222295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.222720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.354088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:55.362427 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e9c5ee4d-9120-49ba-a745-e1be6eece5c4 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.154167 Sep 23 04:43:55.363007 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3568/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:55 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:56.385886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:56.386522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:56.393398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.393931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.394388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.395104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.395586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.396036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.539486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:56.547833 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ed79753-7072-432f-a089-3d150fd6ac6b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.166165 Sep 23 04:43:56.548418 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3508/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:56 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:57.573313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.574086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.577002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:57.582657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.583146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.583594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.584296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.584754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.585182 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.720906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:57.729889 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f24e2dd-6c27-44d9-b073-68314d68eb8e tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.161009 Sep 23 04:43:57.730506 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3569/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:58.754068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:58.754614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:58.762087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.762598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.763057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.763773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.764250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.764700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.896257 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:58.905002 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-52c3a2a6-a508-450a-bb6d-82970bffe027 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.154982 Sep 23 04:43:58.905642 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3509/7078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:58 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:59.928011 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:59.928633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:59.935502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.935989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.936428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.937132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.937618 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.938048 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.069892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:00.078628 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-76ec3fb1-b0f8-45b8-8867-59f3cff071be tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.154481 Sep 23 04:44:00.079210 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3570/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:59 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.103052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.103685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:01.110550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.111054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.111518 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.112241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.112718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.113167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.241726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:01.250568 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74bda428-09d2-48c1-be2b-c8a8351bffd9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.151697 Sep 23 04:44:01.251160 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3510/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:02.275921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.276533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.283115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.283596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.284031 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.284718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.285169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.285630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.417961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:02.426263 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6514e73c-0712-4257-86eb-93b929384011 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.155137 Sep 23 04:44:02.426839 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3571/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:03.449807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.450443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.457584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.458091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.458552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.459276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.459753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.460205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.593762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:03.602073 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-163f52dc-4b40-4628-ab86-06a3c7ecef47 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.156190 Sep 23 04:44:03.602656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3511/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:03 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:04.626688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:04.627231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:04.635203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.635693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.636139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.636838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.637301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.637763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.772895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:04.782084 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79664b0c-2954-4177-812a-09a8e0282886 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.159435 Sep 23 04:44:04.782670 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3572/7083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:04 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:05.805410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.805949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:05.813051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.813610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.814075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.814790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.815270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.815721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.944372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:05.953490 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2b0c5436-1f16-47e9-b10c-7c990f7cf4fb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1724 microversion: 2.1 time: 0.152150 Sep 23 04:44:05.954082 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3512/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.032056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.032678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.039644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.040135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.041246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.041979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.042447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.042881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.174580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.183430 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8db16d54-9a12-41ac-b2a0-68a55bfd4eb7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1717 microversion: 2.1 time: 0.155248 Sep 23 04:44:07.184684 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3573/7085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.207443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.208075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.215469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.216742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.217412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.218131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.218750 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.219325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.355073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.363540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-16066aef-e11c-4bd8-9286-f4640a9ecb67 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1717 microversion: 2.1 time: 0.160108 Sep 23 04:44:07.364141 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3513/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.385943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.386579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.392717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.393245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.393711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.394420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.394884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.395318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.531534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.539773 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-79766041-c901-4368-922d-a1a136c5bfc7 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1717 microversion: 2.1 time: 0.157826 Sep 23 04:44:07.540351 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3574/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.562492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.562962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.569009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.569555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.570010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.570714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.571186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.571630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.597448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:07.652961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:07.683055 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-51f38ece-6d69-4965-9cc5-7dbf3b31228f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 204 len: 0 microversion: 2.1 time: 0.124119 Sep 23 04:44:07.683771 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3514/7088] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:07 2022] DELETE /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:07.692422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.693061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.699622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.700108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.700569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.701248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.701734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.702162 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.706088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:07.835592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.844404 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a40cb47-35fa-4cee-87ac-69cbb6b532c1 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1723 microversion: 2.1 time: 0.155901 Sep 23 04:44:07.844991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3575/7089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:08.872037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:08.872767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:08.879992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.880502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.881151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.881613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-plugged", "status": "completed", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:08.882090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.882427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.882899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.892131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.892840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.893287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.908110 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] Creating event network-vif-plugged:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:44:08.913962 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-19d92431-15e2-4554-923b-828a7ef466de req-4e1cdda2-82c1-4503-afe1-e0b308faed6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Sep 23 04:44:08.914951 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3576/7090] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:44:09.027427 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:09.036788 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fead8a68-9c34-4105-b1b5-d7205eb2c093 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1723 microversion: 2.1 time: 0.168868 Sep 23 04:44:09.037417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3515/7091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:08 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:10.065184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.066101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.072332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.072834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.073283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.074038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.074507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.075088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.190717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:10.200082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ed47cc9-79fb-457b-8d02-89a67c543cbc tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1655 microversion: 2.1 time: 0.141712 Sep 23 04:44:10.201099 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3577/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1655 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:10.412317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003133b8-bc6c-4b75-abaf-38030ddb61a7", "name": "network-vif-deleted", "tag": "b74ad224-fde8-4fca-aeb4-b91a1c4bf920"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:10.430055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.431119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.431852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.444485 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] Creating event network-vif-deleted:b74ad224-fde8-4fca-aeb4-b91a1c4bf920 for instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 on n-h2-858495-2 Sep 23 04:44:10.450462 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0d358fa1-cb67-45a9-9fa0-8034622a04d2 req-93b4d290-567c-44eb-ab2f-18a6cef8b074 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041930 Sep 23 04:44:10.451095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3516/7093] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:11.224644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:11.225938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:11.234258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.234750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.235191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.236071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.236536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.236964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.307525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:11.317423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fd4a16fd-95ef-4e97-8363-411589c11611 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1370 microversion: 2.1 time: 0.096854 Sep 23 04:44:11.318337 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3578/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:11 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:12.342105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:12.342763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:12.346034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:12.352285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.352815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.353269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.354645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.355112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.355553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.420443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:12.429008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e4fa334b-a021-4e2e-83b5-1561deaa5cbe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1370 microversion: 2.1 time: 0.091435 Sep 23 04:44:12.429647 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3517/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:12 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:13.452286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:13.452901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:13.456105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:13.461675 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:13.462166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:13.462603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:13.463818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:13.464267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:13.464692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:13.533795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:13.542706 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e23aa9e-3927-4db8-86e8-0ced5b7a9e89 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1370 microversion: 2.1 time: 0.094366 Sep 23 04:44:13.543288 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3579/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:13 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:14.565019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:14.565601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:14.572512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.573018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.573504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.574223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.574702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.575150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.608758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.609267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.609752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.610216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lazy-loading 'fault' on Instance uuid 003133b8-bc6c-4b75-abaf-38030ddb61a7 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:14.651841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1823e759b44dd7b5b0894e8e1353c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912548a7ed864971bfc3fa48ff626a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:14.660347 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fc68031a-21b9-4a8b-8615-97ed2c5b20fe tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 200 len: 1375 microversion: 2.1 time: 0.099365 Sep 23 04:44:14.660917 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3518/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:14 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:15.684617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:15.685261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:15.692186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.692674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.693115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.693846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.694306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.694740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.710455 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 HTTP/1.1 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '003133b8-bc6c-4b75-abaf-38030ddb61a7'} Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:15.712096 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21be5f2b-2806-4c09-9c83-429bca7392f6 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 404 len: 111 microversion: 2.1 time: 0.033610 Sep 23 04:44:15.716102 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3580/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:15 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:15.777972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:15.780166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:15.787066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.787566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.788020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.788729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.789198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.789744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.810651 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments HTTP/1.1 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '003133b8-bc6c-4b75-abaf-38030ddb61a7'} Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:15.812629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-86139025-2f4d-4102-a31e-47de76640e19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040646 Sep 23 04:44:15.817105 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3519/7099] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:44:15 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.134103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.134591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.142301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.146761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.147256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.147986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.148477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.148905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.165736 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 HTTP/1.1 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '003133b8-bc6c-4b75-abaf-38030ddb61a7'} Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.167356 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ac6d0b4-65e3-44d5-9595-bcaf23d86a83 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 404 len: 111 microversion: 2.1 time: 0.038652 Sep 23 04:44:19.171505 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3581/7100] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:19 2022] DELETE /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.177878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.178513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 003133b8-bc6c-4b75-abaf-38030ddb61a7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.185991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.186531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.187008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.187739 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.188211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.188654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.204153 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 HTTP/1.1 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '003133b8-bc6c-4b75-abaf-38030ddb61a7'} Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.205752 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 003133b8-bc6c-4b75-abaf-38030ddb61a7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d98655e8-7394-4d6e-a7bf-43abeab75b19 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7" status: 404 len: 111 microversion: 2.1 time: 0.033590 Sep 23 04:44:19.209540 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3520/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:19 2022] GET /compute/v2.1/servers/003133b8-bc6c-4b75-abaf-38030ddb61a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.216114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.216644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.222809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.223293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.223732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.224432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.224885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.225305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.240594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 HTTP/1.1 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '27bb303c-3968-4160-a3a7-7a17224071f7'} Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.242510 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.247255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c455290-1e58-46b0-a72c-b54ce5351fea tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 404 len: 111 microversion: 2.1 time: 0.031761 Sep 23 04:44:19.248525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3582/7102] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:19 2022] DELETE /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.253130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.253784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 27bb303c-3968-4160-a3a7-7a17224071f7] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.259755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.260262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.260713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.261442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.261915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.262360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.276140 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 HTTP/1.1 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '27bb303c-3968-4160-a3a7-7a17224071f7'} Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.277696 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 27bb303c-3968-4160-a3a7-7a17224071f7 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.282408 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fd27a7ea-dd2a-4a0f-bcae-3c726a7c4e8d tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7" status: 404 len: 111 microversion: 2.1 time: 0.029909 Sep 23 04:44:19.289417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3521/7103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:19 2022] GET /compute/v2.1/servers/27bb303c-3968-4160-a3a7-7a17224071f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.289524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.289524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.294779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.295270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.295710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.296406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.296865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.297297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.311597 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 HTTP/1.1 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '228bdfbc-a83b-4a33-8ec7-ba20d3f7df72'} Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.313148 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-334a0cfb-249a-4f10-bafd-48e9cd77708f tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 404 len: 111 microversion: 2.1 time: 0.030810 Sep 23 04:44:19.317289 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3583/7104] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:19 2022] DELETE /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.323587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.324210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.330240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.330742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.331277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.331902 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.332373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.332814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.346684 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 HTTP/1.1 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '228bdfbc-a83b-4a33-8ec7-ba20d3f7df72'} Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.348255 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-206b06fe-1f52-4d77-b028-6c23f456eeb9 tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72" status: 404 len: 111 microversion: 2.1 time: 0.030065 Sep 23 04:44:19.352219 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3522/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:19 2022] GET /compute/v2.1/servers/228bdfbc-a83b-4a33-8ec7-ba20d3f7df72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.358895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.359336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.365409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.365904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.366343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.367042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.367502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.367932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.382461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a HTTP/1.1 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '845b9ee3-4906-4cd0-a346-0093e0f0783a'} Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.384064 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6bd20ad1-0c2f-47e2-a830-93d8aacd7efb tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 404 len: 111 microversion: 2.1 time: 0.030554 Sep 23 04:44:19.388062 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3584/7106] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:19 2022] DELETE /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.394562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.395186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] [instance: 845b9ee3-4906-4cd0-a346-0093e0f0783a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.402317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.402808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.403259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.403972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:19.404443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:19.404886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.419329 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] HTTP exception thrown: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Request method failure captured: Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a HTTP/1.1 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTgRpdNexiED8VIP7JbDuEZlgfQ8HKJR7Yr9Mos-pEtT9wampg0_CArfHH7DcRP51yO9QX7gxhLtpwAS0b5SLgqaWeU9vk5D7sOnKK3jTUY3ubm-MEnTjKh_AooyEv0x_KgHHR28mvUrZA-y-TaQyM0eCMq-QFgpapwES7ntlBkp234 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_912548a7ed864971bfc3fa48ff626a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 912548a7ed864971bfc3fa48ff626a24 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServerActionsTestJSON-336218524 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 6b1823e759b44dd7b5b0894e8e1353c8 Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServerActionsTestJSON-336218524-project Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '845b9ee3-4906-4cd0-a346-0093e0f0783a'} Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:19.420865 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Returning 404 to user: Instance 845b9ee3-4906-4cd0-a346-0093e0f0783a could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-14f81768-56c4-453c-8bb5-36cf4cbfc2ab tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a" status: 404 len: 111 microversion: 2.1 time: 0.031750 Sep 23 04:44:19.424849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3523/7107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:19 2022] GET /compute/v2.1/servers/845b9ee3-4906-4cd0-a346-0093e0f0783a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:19.431332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f88c369c-6a25-4273-9159-fe15044de01b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] Calling method '.version_select at 0x7f0c9339c280>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.456327 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f88c369c-6a25-4273-9159-fe15044de01b tempest-ServerActionsTestJSON-336218524 tempest-ServerActionsTestJSON-336218524-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383234453" status: 202 len: 0 microversion: 2.1 time: 0.028712 Sep 23 04:44:19.457223 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3585/7108] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 23 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383234453 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:44:28.902989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1852383381", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "b9a6bcf4-00d6-4946-afd9-f4ce0d14be0a"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:28.964930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] validate_networks() for [('b9a6bcf4-00d6-4946-afd9-f4ce0d14be0a', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:29.393157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:29.393753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:29.394255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:29.394692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:29.395157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:29.404681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:29.405187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:29.405697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:29.406456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:29.406933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:29.407383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:29.414107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=32 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:29.426910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Getting quotas for project 35807488b14e4cd787eba497ce87f886. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:29.432300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Getting quotas for user e59a4076d16f49beade1a59dcf273ee9 and project 35807488b14e4cd787eba497ce87f886. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:29.445254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:29.447620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:29.494593 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1bef8bc0-3400-4699-9bac-a3708c9180de tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730514 Sep 23 04:44:29.495823 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3524/7109] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:29.504919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=35 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:29.505719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:29.510129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e2be7e6-0dae-41e4-8144-f6c0aa7bc34c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:29.511512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e2be7e6-0dae-41e4-8144-f6c0aa7bc34c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:29.571663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e2be7e6-0dae-41e4-8144-f6c0aa7bc34c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:29.579248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e2be7e6-0dae-41e4-8144-f6c0aa7bc34c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1217 microversion: 2.1 time: 0.076100 Sep 23 04:44:29.579824 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3586/7110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:29 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:30.604243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-68fb6910-2e90-4940-b205-fa664bce7311 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:30.606033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-68fb6910-2e90-4940-b205-fa664bce7311 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:30.666105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-68fb6910-2e90-4940-b205-fa664bce7311 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:30.673520 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-68fb6910-2e90-4940-b205-fa664bce7311 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1217 microversion: 2.1 time: 0.075181 Sep 23 04:44:30.674135 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3525/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:30 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:31.697968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a53261b1-3d7d-4582-b806-39f4fe7da73f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:31.706091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a53261b1-3d7d-4582-b806-39f4fe7da73f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:31.767116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a53261b1-3d7d-4582-b806-39f4fe7da73f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:31.775971 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a53261b1-3d7d-4582-b806-39f4fe7da73f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1217 microversion: 2.1 time: 0.083601 Sep 23 04:44:31.789745 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3587/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:31 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:32.800529 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-528f9cbf-326a-45a9-a6ab-4d07ace04a45 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:32.801090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-528f9cbf-326a-45a9-a6ab-4d07ace04a45 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:32.857066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-528f9cbf-326a-45a9-a6ab-4d07ace04a45 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:32.864034 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-528f9cbf-326a-45a9-a6ab-4d07ace04a45 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1217 microversion: 2.1 time: 0.067465 Sep 23 04:44:32.864612 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3526/7113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:32 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:33.886955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:33.887564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:33.895061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.895542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.895980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.896667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.897120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.897576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.960678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:33.968540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e703a23-b6bd-4c7e-acff-72e347af7ab3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1221 microversion: 2.1 time: 0.085997 Sep 23 04:44:33.969091 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3588/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:33 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:34.994012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:34.995096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:35.006441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:35.006958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:35.007434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:35.008178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:35.008649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:35.009095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:35.074054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:35.082461 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-49526ced-e0fe-4e94-9b5c-4828f122be7b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1275 microversion: 2.1 time: 0.094921 Sep 23 04:44:35.083050 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3527/7115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:34 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:36.106820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:36.107495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:36.115852 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:36.116519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:36.116955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:36.117678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:36.118284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:36.118717 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:36.254499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:36.263063 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3095dfeb-1080-452a-8274-8fb394709a63 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1317 microversion: 2.1 time: 0.160253 Sep 23 04:44:36.263738 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3589/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:36 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:36.351806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6c8f71-d923-4a4a-bda2-5534e72f167f", "tag": "8b4e0f41-7c0e-4977-b52a-5c5d49bdc544"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:36.369325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:36.370043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:36.370517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:36.383302 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] Creating event network-changed:8b4e0f41-7c0e-4977-b52a-5c5d49bdc544 for instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f on n-h1-858495-2 Sep 23 04:44:36.388969 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c6fb5ae0-19d5-4312-9fc4-6378515ea65b req-19baa556-deba-4dee-804c-886969aaa955 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041576 Sep 23 04:44:36.389629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3528/7117] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:37.286241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:37.286759 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:37.294149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:37.294641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:37.295085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.295786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:37.296248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:37.296684 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.425708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:37.433968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-acf46fdb-9e28-4c95-9ade-80432eb4d8c0 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1317 microversion: 2.1 time: 0.151176 Sep 23 04:44:37.434560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3590/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:37 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:38.457491 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:38.458242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:38.465204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.465732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.466191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.467405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.467405 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.467839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.597056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:38.604961 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2372cf41-f367-45fb-8779-0b8573595f76 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1317 microversion: 2.1 time: 0.152602 Sep 23 04:44:38.605581 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3529/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:38 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:39.628017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:39.628626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:39.631963 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:44:39.632092 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f (ip 10.222.0.25) !!! Sep 23 04:44:39.647219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:39.647706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:39.648139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:39.648844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:39.649296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:39.649757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:39.787512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6c8f71-d923-4a4a-bda2-5534e72f167f", "name": "network-vif-plugged", "status": "completed", "tag": "8b4e0f41-7c0e-4977-b52a-5c5d49bdc544"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:39.793110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:39.803144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:39.803645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:39.804098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:39.805447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:39.815126 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-32e3aa08-b223-4787-a4ca-9c4daabe9c88 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1317 microversion: 2.1 time: 0.190647 Sep 23 04:44:39.816332 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3591/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:39 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:39.821282 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] Creating event network-vif-plugged:8b4e0f41-7c0e-4977-b52a-5c5d49bdc544 for instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f on n-h1-858495-2 Sep 23 04:44:39.833030 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-0f18d97a-fbd6-41b9-8e3c-9abc3f5706b5 req-a7565b35-a192-4eb7-9efd-38393129311e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049314 Sep 23 04:44:39.833943 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3530/7121] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:44:40.841725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:40.842337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:40.849408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:40.849893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:40.850329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:40.851028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:40.851481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:40.851907 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:40.991726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:40.999457 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-781cbf93-6186-4bc3-8119-2b20c4877a7f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1317 microversion: 2.1 time: 0.162163 Sep 23 04:44:41.000036 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3592/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:40 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:42.025003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:42.025813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:42.032311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:42.032813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:42.033271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:42.034002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:42.034478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:42.034924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:42.162334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:42.170851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6ba0a777-842a-45dd-957d-08662fd1b1a3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.150976 Sep 23 04:44:42.171437 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3531/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:42 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:42.230892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-896449824", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "b9a6bcf4-00d6-4946-afd9-f4ce0d14be0a"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:42.239581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:42.290897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] validate_networks() for [('b9a6bcf4-00d6-4946-afd9-f4ce0d14be0a', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:42.695324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:42.695747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:42.696224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:42.696713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:42.697227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:42.706711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:42.707191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:42.707626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:42.708342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:42.708793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:42.709216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:42.726184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Getting quotas for project 35807488b14e4cd787eba497ce87f886. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:42.731841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Getting quotas for user e59a4076d16f49beade1a59dcf273ee9 and project 35807488b14e4cd787eba497ce87f886. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:42.743779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:42.746672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:42.793197 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-071cf86b-09e9-4378-a3c2-62d5756e8e4d tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566205 Sep 23 04:44:42.794258 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3593/7124] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:42.804825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2a17bbac-ae27-44c1-a708-2f8c77f3ac1e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:42.805487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2a17bbac-ae27-44c1-a708-2f8c77f3ac1e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:42.807489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:42.861776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=10 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:42.866046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2a17bbac-ae27-44c1-a708-2f8c77f3ac1e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:42.873623 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2a17bbac-ae27-44c1-a708-2f8c77f3ac1e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1216 microversion: 2.1 time: 0.072589 Sep 23 04:44:42.874254 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3532/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:42 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:43.897096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:43.897958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:43.905788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:43.906412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:43.906964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:43.907776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:43.908471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:43.909150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:44.003950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:44.014585 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f28f44a-1b66-437a-8a09-249bc13b7bed tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1268 microversion: 2.1 time: 0.121988 Sep 23 04:44:44.015945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3594/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:43 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:45.039942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:45.040595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:45.049215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.049760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.050228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.050972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.051484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.051942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.455840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:45.466045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6c878817-7c19-4d01-9ec2-2c85010a9ce2 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.430009 Sep 23 04:44:45.473016 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3533/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:45 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:45.788596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592daaf3-804d-4dce-aad3-b08761a23e13", "tag": "503e4242-4cfe-45af-bcee-51d2f8c621e5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:45.800834 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.801370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.801808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.816037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] Creating event network-changed:503e4242-4cfe-45af-bcee-51d2f8c621e5 for instance 592daaf3-804d-4dce-aad3-b08761a23e13 on n-h2-858495-2 Sep 23 04:44:45.820883 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-6751e084-edad-49d4-a1b9-123d3b921494 req-a7843645-dcdb-45a0-8f30-2037876d55db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036314 Sep 23 04:44:45.821520 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3595/7128] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:46.489914 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:46.490480 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:46.497342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.497900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.502448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.503206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.503696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.504154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.639385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:46.647274 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-200637b0-92ee-42bd-90f6-69015537b652 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.161713 Sep 23 04:44:46.647883 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3534/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:46 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:47.672479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:47.673185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:47.679477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:47.679958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:47.680398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:47.681093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:47.681585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:47.682017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:47.812304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:47.820255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98bace56-c4d1-486c-b714-c81c6d0fdf0e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.153385 Sep 23 04:44:47.820837 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3596/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:47 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:48.843628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:48.844180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:48.851096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:48.851586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:48.852048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:48.852751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:48.853224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:48.853698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:48.990081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:49.000214 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-21e1520c-adf5-4391-bd7d-534e4bf4d1db tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.160531 Sep 23 04:44:49.000810 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3535/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:48 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:50.023471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:50.024106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:50.031726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.032204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.032638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.033328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.033803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.034258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.159516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:50.167129 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eab9d16e-4671-475d-b45d-63b5b0d76938 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.147580 Sep 23 04:44:50.167704 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3597/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:50 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:51.157567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592daaf3-804d-4dce-aad3-b08761a23e13", "name": "network-vif-plugged", "status": "completed", "tag": "503e4242-4cfe-45af-bcee-51d2f8c621e5"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:51.168956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.169486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.169941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.184464 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] Creating event network-vif-plugged:503e4242-4cfe-45af-bcee-51d2f8c621e5 for instance 592daaf3-804d-4dce-aad3-b08761a23e13 on n-h2-858495-2 Sep 23 04:44:51.189898 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e541c92f-cad2-4295-aa58-0e719df0e334 req-c0e517ff-750f-4f44-af22-8cf4248c6f20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036873 Sep 23 04:44:51.190383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:51.190847 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3536/7133] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:51.191134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:51.198296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.198944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.200292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.201030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.201579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.202088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.380196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:51.387994 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83bbab4e-65fe-4173-a873-c15f1ff764a7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.202037 Sep 23 04:44:51.388822 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3598/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:51 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:52.411367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:52.412096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:52.420144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.420650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.421111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:52.421859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.422341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.422796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:52.552161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:52.560707 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-02634f7e-e0b0-4dec-95fb-0dce5b3be6f5 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1316 microversion: 2.1 time: 0.153678 Sep 23 04:44:52.561291 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3537/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:52 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:53.583896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:53.584424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:53.587249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:53.587924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:53.594468 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.594949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.595387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.596076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.596530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.596956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.733582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:53.742047 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ace23377-eba3-406c-8b9a-a1e55e01d5d4 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1504 microversion: 2.1 time: 0.162131 Sep 23 04:44:53.742648 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3599/7136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:53 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:53.764531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:53.765626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:53.767635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:53.773785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.774290 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.774744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.775451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.775929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.776376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.803539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:53.879164 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0a79381-4e52-4ba9-a4b5-9c00bba0947e tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "DELETE /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 204 len: 0 microversion: 2.1 time: 0.118128 Sep 23 04:44:53.879693 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3538/7137] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:53 2022] DELETE /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:53.888359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:53.888965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:53.894833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.895318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.895841 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.896522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.896971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.897420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.031682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:54.039290 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d0b74619-0af0-47dc-8f88-b92657194fc3 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1510 microversion: 2.1 time: 0.154818 Sep 23 04:44:54.039867 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3600/7138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:53 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:55.063556 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:55.064282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:55.071376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:55.071888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:55.072355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:55.073071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:55.073587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:55.074041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:55.205103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:55.213086 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1178d466-b724-4b7d-b20b-28e258fe9b64 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1510 microversion: 2.1 time: 0.154331 Sep 23 04:44:55.213732 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3539/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:55 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:55.915113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592daaf3-804d-4dce-aad3-b08761a23e13", "name": "network-vif-deleted", "tag": "503e4242-4cfe-45af-bcee-51d2f8c621e5"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:55.928446 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:55.928930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:55.929405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:55.943693 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] Creating event network-vif-deleted:503e4242-4cfe-45af-bcee-51d2f8c621e5 for instance 592daaf3-804d-4dce-aad3-b08761a23e13 on n-h2-858495-2 Sep 23 04:44:55.950634 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-97c6bbfc-61b9-47db-9280-16334ccb1501 req-c824ac4d-d8dd-42b3-ba23-a6a2c94f61e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Sep 23 04:44:55.952595 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3601/7140] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:56.236114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:56.236743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:56.243676 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:56.244176 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:56.244634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.245341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:56.245843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:56.246317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.280938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:56.281452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:56.281911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.282409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lazy-loading 'fault' on Instance uuid 592daaf3-804d-4dce-aad3-b08761a23e13 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:56.322646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:56.331660 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b7aecb19-44f1-40eb-a026-d8337d2e34da tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 200 len: 1306 microversion: 2.1 time: 0.099515 Sep 23 04:44:56.332258 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3540/7141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:56 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:57.355124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.355840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.362670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.363158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.363604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.364300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.364767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.365203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.378643 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 HTTP/1.1 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '592daaf3-804d-4dce-aad3-b08761a23e13'} Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.380284 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 404 to user: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-abb7e0d2-af18-4843-af9d-e665a847829f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 404 len: 111 microversion: 2.1 time: 0.031723 Sep 23 04:44:57.384948 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3602/7142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:57 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:57.391581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.392212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.399135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.399632 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.400090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.400795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.401275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.401742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.533800 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:57.541709 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-732ab87c-8d7e-42f5-acb2-ce329554e751 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.154601 Sep 23 04:44:57.542290 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3541/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:57 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:57.563641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:57.565940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 536d9b6a-f50d-4cb3-b7ac-389cf79a534e] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.571343 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/536d9b6a-f50d-4cb3-b7ac-389cf79a534e/action HTTP/1.1 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 32 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: {"resize": {"flavorRef": "452"}} Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '536d9b6a-f50d-4cb3-b7ac-389cf79a534e', 'body': {'resize': {'flavorRef': '452'}}} Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:57.572895 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 404 to user: Instance 536d9b6a-f50d-4cb3-b7ac-389cf79a534e could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c801fa0a-2d4c-4648-a7b8-d5bd49b589e6 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "POST /compute/v2.1/servers/536d9b6a-f50d-4cb3-b7ac-389cf79a534e/action" status: 404 len: 111 microversion: 2.1 time: 0.014681 Sep 23 04:44:57.578183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3603/7144] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:57 2022] POST /compute/v2.1/servers/536d9b6a-f50d-4cb3-b7ac-389cf79a534e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:57.583790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.584419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.590385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.590886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.591340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.596694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.597178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.597671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.724973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:57.732831 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50728dbf-15e0-49fa-9069-74e36935f283 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.152869 Sep 23 04:44:57.733432 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3542/7145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:57 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:57.755543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.756156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.762989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.763465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.764499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.765185 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.765671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.766095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.891831 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:57.899653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3f0383b-f28a-44e9-9d5f-0550137ff21f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.148141 Sep 23 04:44:57.900217 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3604/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:57 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:57.922422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "905b2989-c5c7-44f8-b7fb-ccd2f0c2af87"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:57.924779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.930957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.931468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.931932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.932657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.933137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.933633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.978112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:57.983368 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: request: POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action HTTP/1.1 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 65 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: {"resize": {"flavorRef": "905b2989-c5c7-44f8-b7fb-ccd2f0c2af87"}} Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: exception: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2a6c8f71-d923-4a4a-bda2-5534e72f167f', 'body': {'resize': {'flavorRef': '905b2989-c5c7-44f8-b7fb-ccd2f0c2af87'}}} Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:57.985729 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 400 to user: Flavor 905b2989-c5c7-44f8-b7fb-ccd2f0c2af87 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b24d884-e4ea-49da-a5ac-1afebf10ba8c tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action" status: 400 len: 107 microversion: 2.1 time: 0.068892 Sep 23 04:44:57.990103 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3543/7147] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:57 2022] POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:44:57.996025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.996649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.003099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.003587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.004033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.004731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.005198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.005669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.135959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:58.144369 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-814f507e-1b5f-43d2-ac23-81413bcfc17b tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.152083 Sep 23 04:44:58.144904 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3605/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:57 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:58.168408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.169041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.175722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.176163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.176614 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.177321 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.177823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.178268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.197770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:58.308524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:58.316990 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4947c470-7b1c-4d6a-b285-300a7733af23 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.152596 Sep 23 04:44:58.317646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3544/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:58.338985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d1029be-09d3-4e47-856a-a3bf31e83511 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d1029be-09d3-4e47-856a-a3bf31e83511 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: request: POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action HTTP/1.1 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 29 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: {"resize": {"flavorRef": ""}} Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '2a6c8f71-d923-4a4a-bda2-5534e72f167f', 'body': {'resize': {'flavorRef': ''}}} Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi '' Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.342544 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d1029be-09d3-4e47-856a-a3bf31e83511 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d1029be-09d3-4e47-856a-a3bf31e83511 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action" status: 400 len: 113 microversion: 2.1 time: 0.008847 Sep 23 04:44:58.346815 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3606/7150] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:58 2022] POST /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:44:58.352162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.352786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.359429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.359924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.360379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.361083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.361590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.362033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.492704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:58.501045 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8863d575-0559-48e0-a175-d7018496c083 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1506 microversion: 2.1 time: 0.152691 Sep 23 04:44:58.501652 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3545/7151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:58.528210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.529086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.536915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.537497 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.537953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.538653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.539120 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.539556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.553385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 HTTP/1.1 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '592daaf3-804d-4dce-aad3-b08761a23e13'} Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:58.554935 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 404 to user: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2d67af4a-f1d4-49eb-9b27-7231814c5da1 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "DELETE /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 404 len: 111 microversion: 2.1 time: 0.033053 Sep 23 04:44:58.559395 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3607/7152] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:58 2022] DELETE /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:58.564879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.565542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 592daaf3-804d-4dce-aad3-b08761a23e13] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.571709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.572232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.572685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.573417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.573891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.574335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.588074 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 HTTP/1.1 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '592daaf3-804d-4dce-aad3-b08761a23e13'} Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:58.589705 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 404 to user: Instance 592daaf3-804d-4dce-aad3-b08761a23e13 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e15cc3e-6a56-42b4-b0e0-04dcf9cbd3e7 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13" status: 404 len: 111 microversion: 2.1 time: 0.030088 Sep 23 04:44:58.594608 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3546/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/592daaf3-804d-4dce-aad3-b08761a23e13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:58.600279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.600785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.606728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.607219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.608236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.608932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.609425 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.609863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.636823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:58.675663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:58.717714 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a85680a0-129b-42e2-8bad-c87fe1b9ebfc tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 204 len: 0 microversion: 2.1 time: 0.120326 Sep 23 04:44:58.718326 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3608/7154] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:58 2022] DELETE /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:58.726924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.727610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.735278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.735773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.736223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.736923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.737424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.737896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.866377 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:58.874522 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5835ad3c-6b2b-46ad-b08f-be91477c3e44 tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1512 microversion: 2.1 time: 0.152156 Sep 23 04:44:58.875111 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3547/7155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:59.898847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:59.899482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:59.902264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:59.908626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.909112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.909590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.910290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.910753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.911186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.050672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:00.059473 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c6402010-bebf-4ac5-b84f-49c34c1240cb tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1512 microversion: 2.1 time: 0.164974 Sep 23 04:45:00.060060 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3609/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:59 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:00.522522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6c8f71-d923-4a4a-bda2-5534e72f167f", "name": "network-vif-deleted", "tag": "8b4e0f41-7c0e-4977-b52a-5c5d49bdc544"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:00.536875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.537582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.538226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.552439 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] Creating event network-vif-deleted:8b4e0f41-7c0e-4977-b52a-5c5d49bdc544 for instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f on n-h1-858495-2 Sep 23 04:45:00.557932 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-683ea3ed-10b5-4fc6-b625-624b8e265742 req-3ddaf042-e7fa-4433-9c41-3c810f60b14b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039707 Sep 23 04:45:00.558727 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3548/7157] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:01.082666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:01.083288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:01.089797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.090292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.090742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.091445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.092409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.092845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.125216 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.125747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.126215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.126671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lazy-loading 'fault' on Instance uuid 2a6c8f71-d923-4a4a-bda2-5534e72f167f {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:45:01.173387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e59a4076d16f49beade1a59dcf273ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35807488b14e4cd787eba497ce87f886', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:01.181501 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75fd8098-fa11-4b80-9dd4-71cda189a58f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 200 len: 1307 microversion: 2.1 time: 0.102828 Sep 23 04:45:01.193568 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3610/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:01 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:02.206542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:02.207262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] [instance: 2a6c8f71-d923-4a4a-bda2-5534e72f167f] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:02.213572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.214075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.214531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.215239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.215713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.216154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.229452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] HTTP exception thrown: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Request method failure captured: Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f HTTP/1.1 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTmsUEuqxGZRk8CIO_Ut3LEdADVY5_hA7Sv2HImYgIIPJf6Ey_gyV1RDYEh4VP8GYUrLj7fgkVAal9jDF5Bd4GlO1YJK0xFQiLsMoGHNzPbFiTnWb0SZGtDT684H59nROfNFYUDaQr88apUvb49I_JG5nz3FU3DhAFuYewxu9gOQI-o Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35807488b14e4cd787eba497ce87f886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35807488b14e4cd787eba497ce87f886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35807488b14e4cd787eba497ce87f886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 35807488b14e4cd787eba497ce87f886 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1451423177 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: e59a4076d16f49beade1a59dcf273ee9 Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-ServersNegativeTestJSON-1451423177-project Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '2a6c8f71-d923-4a4a-bda2-5534e72f167f'} Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:02.231066 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] Returning 404 to user: Instance 2a6c8f71-d923-4a4a-bda2-5534e72f167f could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-28256375-2bfd-488f-8820-0940fa8e275f tempest-ServersNegativeTestJSON-1451423177 tempest-ServersNegativeTestJSON-1451423177-project] 10.222.0.25 "GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f" status: 404 len: 111 microversion: 2.1 time: 0.031248 Sep 23 04:45:02.236202 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3549/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:02 2022] GET /compute/v2.1/servers/2a6c8f71-d923-4a4a-bda2-5534e72f167f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:32.420347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:32.421753 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:32.597981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-13ae8aab-ae2a-4af0-9855-073ea70f7e14 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: .version_select at 0x7f0c8b10c8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1500960664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9XZ8/Dr2Ib5CZEFGYzImrimfgtKNU+TKwnp7tp6rsh/x3WbtqqVwC7hqJoGrroQQtmP9EvfQD3hfCCylLW95BepzMD8njWh8tnEdbCp7D0vGXbSErQ1sBAR810Z9Wcew=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:32.613418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-13ae8aab-ae2a-4af0-9855-073ea70f7e14 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:32.618554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-13ae8aab-ae2a-4af0-9855-073ea70f7e14 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:32.644494 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-13ae8aab-ae2a-4af0-9855-073ea70f7e14 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.229661 Sep 23 04:45:32.645110 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3611/7160] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:45:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:32.701760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-482054116", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1500960664", "networks": [{"uuid": "0b055a58-0d42-4e4f-ab49-e24fd0cf2f02"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:32.714658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:32.715580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:32.774012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] validate_networks() for [('0b055a58-0d42-4e4f-ab49-e24fd0cf2f02', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:45:33.190477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:33.190956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:33.191458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:33.191890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:33.192329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:33.201724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.202230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.202694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.203513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.204492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.204947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.223303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:33.228794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:33.243863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:45:33.246543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:45:33.295005 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fbfb3e6-c4df-4387-858b-7c87ad4a460f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597496 Sep 23 04:45:33.295768 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3550/7161] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:45:33.307262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d65b638c-ccc0-4b38-913e-3b7a62861195 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:33.308035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d65b638c-ccc0-4b38-913e-3b7a62861195 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:33.364799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d65b638c-ccc0-4b38-913e-3b7a62861195 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:33.372211 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d65b638c-ccc0-4b38-913e-3b7a62861195 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1262 microversion: 2.1 time: 0.068934 Sep 23 04:45:33.372789 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3612/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:33 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:34.396571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:34.397209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:34.404707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:34.405219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:34.405711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:34.407388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:34.407872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:34.408329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:34.492466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.501821 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8010dd3f-a973-48ca-b7c1-31205d0c4050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1314 microversion: 2.1 time: 0.108975 Sep 23 04:45:34.503012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3551/7163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:34 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1314 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:35.525844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:35.527658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:35.539367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.540382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.541049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.543877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.544703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.545586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.703075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.711347 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-271ca1ea-f2ed-4202-b7b5-65525902d8c7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.190717 Sep 23 04:45:35.712161 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3613/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:35 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:36.098522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ceaac83-c680-4621-8394-50102733b8bc", "tag": "8394a1ac-5518-4954-8a82-df4d1b023c91"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:36.124394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.125205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.126364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.138707 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] Creating event network-changed:8394a1ac-5518-4954-8a82-df4d1b023c91 for instance 5ceaac83-c680-4621-8394-50102733b8bc on n-h1-858495-2 Sep 23 04:45:36.145096 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8003bac2-5341-4eb6-bc5c-b5299412b621 req-17204831-5fe1-4e37-b7b6-739c07e862a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050360 Sep 23 04:45:36.146359 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3552/7165] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:36.735281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:36.737166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:36.745323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.745943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.746360 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.747061 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.747517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.747936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.898755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.907378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca1ed642-2d91-4620-8745-f1722e8870bb tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.176440 Sep 23 04:45:36.907973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3614/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:36 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:37.932069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:37.932813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:37.939773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.940270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.940721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.941456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.941928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.942370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:38.077467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:38.086355 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ea02ed16-eea2-4de2-82de-8de8bcfadc1f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.159336 Sep 23 04:45:38.086954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3553/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:37 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:39.110005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:39.110540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:39.117461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.117950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.118395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.119097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.119557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.119991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.253646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.261243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6f1397f9-cbc0-4d0e-bdd7-c937eddc8cd1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.155241 Sep 23 04:45:39.261843 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3615/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:39 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:40.285612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:40.286247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:40.294655 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.295172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.295634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.296359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.296836 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.297284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.432170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:40.440570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2799a8ea-8ce8-4876-a0c4-4388bc31eb27 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.159680 Sep 23 04:45:40.441140 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3554/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:40 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:41.462769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:41.463525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:41.470879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.471377 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.471828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:41.472539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.473033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.473487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:41.603802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:41.612308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fa300856-2fad-41d8-846d-ae3161516593 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.153464 Sep 23 04:45:41.612883 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3616/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:41 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:42.041539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ceaac83-c680-4621-8394-50102733b8bc", "name": "network-vif-plugged", "status": "completed", "tag": "8394a1ac-5518-4954-8a82-df4d1b023c91"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:42.055250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.055749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.056196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.068367 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] Creating event network-vif-plugged:8394a1ac-5518-4954-8a82-df4d1b023c91 for instance 5ceaac83-c680-4621-8394-50102733b8bc on n-h1-858495-2 Sep 23 04:45:42.074602 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a44cd2bf-6aec-46e8-8a81-3c31d6f2c01f req-0af596f3-7df5-4b05-bc7b-dae11e21b99b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037227 Sep 23 04:45:42.075388 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3555/7171] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:42.636311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:42.636923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:42.643865 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.644351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.644788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.645504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.645962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.646390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.782501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:42.790910 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5d952671-26db-4129-a678-5e5b230c3ef1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1362 microversion: 2.1 time: 0.158786 Sep 23 04:45:42.791490 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3617/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:42 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:43.815610 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:43.816949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:43.820019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:43.820787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:43.826864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:43.827369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:43.827830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:43.828544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:43.829045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:43.829524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:43.964508 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:43.973668 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6a40b00b-08a8-4226-91ae-d5d6e66afdbf tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1554 microversion: 2.1 time: 0.162296 Sep 23 04:45:43.974268 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3556/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:43 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:43.996277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:43.996828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:43.998710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:44.005296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:44.005812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:44.006253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:44.006946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:44.007403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:44.007832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:44.138355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.146225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36c10cdd-638b-4c29-a133-e7b90b28777e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1554 microversion: 2.1 time: 0.153838 Sep 23 04:45:44.146805 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3618/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:43 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:45.779111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39e339d2-300d-41e1-be0d-0be582ad6c24"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:45.781521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:45.788545 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.789047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.789533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:45.790241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.790714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.791160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:46.031772 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d0d6b6a-bc63-414b-91aa-480e5eb1f37e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256426 Sep 23 04:45:46.032705 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3557/7175] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:45:45 2022] POST /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:56.742927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:56.743442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:56.745879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:56.746600 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:56.753002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:56.753530 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:56.753975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:56.754669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:56.755124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:56.755549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:56.835174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lazy-loading 'services' on Instance uuid 5ceaac83-c680-4621-8394-50102733b8bc {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:45:56.906248 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1a549bc-5d5a-424e-9628-b0ef19efb4f0 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments/39e339d2-300d-41e1-be0d-0be582ad6c24" status: 202 len: 0 microversion: 2.1 time: 0.167213 Sep 23 04:45:56.906853 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3619/7176] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:45:56 2022] DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments/39e339d2-300d-41e1-be0d-0be582ad6c24 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:45:56.914483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:56.915447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:56.920042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:56.922582 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:56.930687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:56.931260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:56.931805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:56.932560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:56.933036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:56.933554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:56.966182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b70f4b56-a116-49b6-98e3-219a7c8c1ad3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053634 Sep 23 04:45:56.966760 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3558/7177] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:45:56 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:57.979195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:57.981738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:57.989607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:57.990096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:57.990536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:57.991234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:57.991694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:57.992128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.022100 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-519cc5ea-2d5a-4954-84b4-30d2f9f0a42d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047268 Sep 23 04:45:58.022677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3620/7178] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:45:57 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:59.034944 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:59.037274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:59.044841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:59.045366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:59.045838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:59.046584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:59.047055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:59.047514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:59.083870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7ad9f3f4-fe54-4c39-82f7-517f9d6d42f3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053172 Sep 23 04:45:59.088919 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3559/7179] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:45:59 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:00.096328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:00.098572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:00.105546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:00.106036 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:00.106475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:00.107202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:00.107661 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:00.108094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:00.142253 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-036a5deb-0eda-4980-b5e2-fbc27d6fc1ce tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 Sep 23 04:46:00.142824 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3621/7180] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:00 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:01.155499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:01.157799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:01.165631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:01.166138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:01.166594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:01.167312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:01.167786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:01.168239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:01.198518 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-60f4ba79-5f2f-4f77-9ae5-2c271cf25c83 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 Sep 23 04:46:01.199102 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3560/7181] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:01 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:02.211146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.213373 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:02.220163 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.220601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.221069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.221795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.222260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.223204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.252305 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0c177327-ec62-49f7-90a9-4ef48bb8927e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045205 Sep 23 04:46:02.252871 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3622/7182] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:02 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:46:02.264021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.264537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:02.271417 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.271918 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.272380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.273099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.273603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.274052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.356879 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance 5ceaac83-c680-4621-8394-50102733b8bc is not attached to volume 39e339d2-300d-41e1-be0d-0be582ad6c24 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments/39e339d2-300d-41e1-be0d-0be582ad6c24 HTTP/1.1 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 5ceaac83-c680-4621-8394-50102733b8bc is not attached to volume 39e339d2-300d-41e1-be0d-0be582ad6c24 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '5ceaac83-c680-4621-8394-50102733b8bc', 'id': '39e339d2-300d-41e1-be0d-0be582ad6c24'} Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 39e339d2-300d-41e1-be0d-0be582ad6c24. Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ceaac83-c680-4621-8394-50102733b8bc is not attached to volume 39e339d2-300d-41e1-be0d-0be582ad6c24 Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:02.371738 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ceaac83-c680-4621-8394-50102733b8bc is not attached to volume 39e339d2-300d-41e1-be0d-0be582ad6c24 Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance 5ceaac83-c680-4621-8394-50102733b8bc is not attached to volume 39e339d2-300d-41e1-be0d-0be582ad6c24 {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b1a0b52-9743-4eed-9cef-eb95c42c9849 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments/39e339d2-300d-41e1-be0d-0be582ad6c24" status: 404 len: 154 microversion: 2.1 time: 0.113664 Sep 23 04:46:02.376475 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3561/7183] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:46:02 2022] DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc/os-volume_attachments/39e339d2-300d-41e1-be0d-0be582ad6c24 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:46:05.721322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:05.721878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:05.728953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.729476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.731285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:05.732000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.732461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.733226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:05.760858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:46:05.841006 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c3227dc1-82d0-4da1-878a-e4cc4aedcea9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 204 len: 0 microversion: 2.1 time: 0.123087 Sep 23 04:46:05.841829 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3623/7184] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:46:05 2022] DELETE /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:46:05.851083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:05.851860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:05.862207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.862718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.863180 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:05.863932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.864409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.864861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:06.104826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:06.113581 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11b6b189-3138-4d76-a75d-e823454ff69d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1560 microversion: 2.1 time: 0.266982 Sep 23 04:46:06.114315 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3562/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:05 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1560 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:07.138666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:07.139399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:07.147992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.148475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.148906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.149617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.150072 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.150494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.332074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:07.340405 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01f681ce-1ddf-4deb-94cb-bfc6f104f636 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 200 len: 1560 microversion: 2.1 time: 0.206674 Sep 23 04:46:07.340986 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3624/7186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:07 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:07.857791 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ceaac83-c680-4621-8394-50102733b8bc", "name": "network-vif-deleted", "tag": "8394a1ac-5518-4954-8a82-df4d1b023c91"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:07.869585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.870091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.870794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.883930 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] Creating event network-vif-deleted:8394a1ac-5518-4954-8a82-df4d1b023c91 for instance 5ceaac83-c680-4621-8394-50102733b8bc on n-h1-858495-2 Sep 23 04:46:07.888918 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b21307fb-3bbf-4347-943c-6960af0e7530 req-fd36b752-ed6e-4dd3-93df-8fe6f2700ff4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039079 Sep 23 04:46:07.889574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3563/7187] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:08.364979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:08.365676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 5ceaac83-c680-4621-8394-50102733b8bc] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:08.372144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:08.372628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:08.373095 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:08.373785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:08.374238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:08.374685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:08.392758 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc HTTP/1.1 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '5ceaac83-c680-4621-8394-50102733b8bc'} Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:46:08.394633 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance 5ceaac83-c680-4621-8394-50102733b8bc could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-331d565d-d88c-4325-87a3-e9dc52da0acd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc" status: 404 len: 111 microversion: 2.1 time: 0.035754 Sep 23 04:46:08.398692 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3625/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:08 2022] GET /compute/v2.1/servers/5ceaac83-c680-4621-8394-50102733b8bc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:46:08.405635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb9b8012-b06d-4702-bef6-3f969cdb434d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '.version_select at 0x7f0c8ab14670>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:08.410370 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb9b8012-b06d-4702-bef6-3f969cdb434d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [1fa0ad32-b2c2-4c5c-943b-934eb6a3b0c4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:46:09.418214 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb9b8012-b06d-4702-bef6-3f969cdb434d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [1fa0ad32-b2c2-4c5c-943b-934eb6a3b0c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 53424. Sep 23 04:46:09.438247 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb9b8012-b06d-4702-bef6-3f969cdb434d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1500960664" status: 202 len: 0 microversion: 2.1 time: 1.036809 Sep 23 04:46:09.438847 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3564/7189] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 04:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1500960664 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:09.456110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-26fa2269-963c-4276-83fa-3a90b494ee95 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: .version_select at 0x7f0c8a028280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-547726340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaJGxPsiOvH39okOeMu0MTU9782tNBFdU36EqsMpq617iy24TSqSOd1SXUJwj9mLzC5UCfGTnWg7KatQ5c29oJKaIObvA6szZeW997NG7+ytLlS4vswAw8wjaqmdD4kkA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:09.473492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-26fa2269-963c-4276-83fa-3a90b494ee95 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:09.478706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-26fa2269-963c-4276-83fa-3a90b494ee95 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:09.501925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-26fa2269-963c-4276-83fa-3a90b494ee95 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049833 Sep 23 04:46:09.502544 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3626/7190] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:46:09 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:09.554165 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1394573805", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-547726340", "networks": [{"uuid": "0b055a58-0d42-4e4f-ab49-e24fd0cf2f02"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:09.606226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] validate_networks() for [('0b055a58-0d42-4e4f-ab49-e24fd0cf2f02', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:09.972192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:09.972622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:09.973685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:09.974120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:09.974596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:09.983419 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:09.983919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:09.984376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:09.985122 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:09.985621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:09.986069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:10.006820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:10.012115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:10.024367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:10.026915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:10.073479 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7ba41cf-1d11-43ef-98e8-f2430e4f82a2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523852 Sep 23 04:46:10.074153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3565/7191] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:10.085724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c742300-e288-43b8-bb52-b1c386599f53 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:10.086432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c742300-e288-43b8-bb52-b1c386599f53 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:10.140876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c742300-e288-43b8-bb52-b1c386599f53 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:10.151177 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c742300-e288-43b8-bb52-b1c386599f53 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1262 microversion: 2.1 time: 0.069710 Sep 23 04:46:10.152596 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3627/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:10 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:11.179052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:11.179683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:11.187096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.187631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.188087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.188817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.189537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.189983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.275010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:11.282836 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3eabddef-add2-49ea-b77a-4e8af9923480 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1332 microversion: 2.1 time: 0.110210 Sep 23 04:46:11.283417 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3566/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:11 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:12.306534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:12.307094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:12.313895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.314386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.314827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.315531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.315983 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.316408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.664071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:12.672447 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-45f2143f-c47c-4381-94ff-45d48a8be6c8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.370607 Sep 23 04:46:12.673067 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3628/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:12 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:12.862389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d78fcef-704b-44c7-b1b2-d79794034b4d", "tag": "1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:12.874246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.875066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.875066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.886452 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] Creating event network-changed:1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e for instance 9d78fcef-704b-44c7-b1b2-d79794034b4d on n-h2-858495-2 Sep 23 04:46:12.891335 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-458c475a-7992-4dbb-9766-28c81d1ed9b6 req-90c10d0c-1ce6-441f-8b23-9e3d6f05cc0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032731 Sep 23 04:46:12.891916 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3567/7195] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:13.697195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:13.697896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:13.704669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:13.705159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:13.705788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:13.706898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:13.707359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:13.707789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:13.843345 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:13.851174 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-65fac176-e583-4b98-9cee-ece33546c0ed tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.158382 Sep 23 04:46:13.851776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3629/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:13 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:14.881663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:14.882388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:14.888621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.889123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.889606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:14.890308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.890778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.891223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:15.019586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:15.027513 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6b4252b-f4b5-430b-b98f-6e47c184d2b3 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.151709 Sep 23 04:46:15.028095 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3568/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:14 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:16.050930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:16.051541 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:16.058893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.059378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.059814 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.060508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.060967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.061426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.188550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:16.196873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d60c12c-5a25-4f4b-b94a-dd342984aec1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.149843 Sep 23 04:46:16.197490 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3630/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:16 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:17.219745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:17.220366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:17.226823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.227247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.227885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.228742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.229215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.229826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.359817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:17.367568 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d3e7671-7845-48f1-a015-108bd34fdb4b tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.151935 Sep 23 04:46:17.368156 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3569/7199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:18.390795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:18.391407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:18.398584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:18.399064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:18.399511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:18.400202 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:18.400657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:18.401088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:18.528310 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:18.536475 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3455a50f-50f6-4f30-9e43-3e23d6b2e3ba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.149555 Sep 23 04:46:18.537149 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3631/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:18 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:19.560304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.560931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:19.568179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.568678 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.569127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.569878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.570347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.570798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.668291 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d78fcef-704b-44c7-b1b2-d79794034b4d", "name": "network-vif-plugged", "status": "completed", "tag": "1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:19.682568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.683679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.684223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.696094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] Creating event network-vif-plugged:1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e for instance 9d78fcef-704b-44c7-b1b2-d79794034b4d on n-h2-858495-2 Sep 23 04:46:19.701556 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e87c66e4-cb9a-470b-8ec2-d3ecebae2c42 req-063b08c4-59c2-494c-bbbc-4855646008c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Sep 23 04:46:19.702471 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3632/7201] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:19.712370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:19.721566 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-10fac5ab-3da7-42eb-afaf-5ba5e01052e5 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.164996 Sep 23 04:46:19.722368 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3570/7202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:19 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:20.742512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:20.747802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:20.748518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:20.755037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.755525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.755966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.757515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.757973 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.758406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.886955 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:20.894552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d183b5ea-e1a6-41b3-b6c5-d23dccbcdb73 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1362 microversion: 2.1 time: 0.153645 Sep 23 04:46:20.895127 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3633/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:20 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:21.918226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:21.918845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:21.922732 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:21.923430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:21.934579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.935076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.935524 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.936235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.936702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.937148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.069324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:22.077341 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a118fac4-7abd-45d3-8965-1d7d488000c2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1554 microversion: 2.1 time: 0.162965 Sep 23 04:46:22.077955 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3571/7204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:21 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:22.099890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.101114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:22.107910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.108390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.108829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.109556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.110019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.110448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.238303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:22.245986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfddf79d-d00e-4554-8120-15e8fe1e81f9 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1554 microversion: 2.1 time: 0.149972 Sep 23 04:46:22.246566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3634/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:22 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:23.748194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "409721b9-d1e9-4cae-92e1-79b4142824fc"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:23.750673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:23.758736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.759398 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.759856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.760566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.761039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.761520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:24.032089 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a41a6369-7ac0-4e3d-9cf6-189f7d565515 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288087 Sep 23 04:46:24.032674 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3572/7206] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:46:23 2022] POST /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:34.740951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:34.741543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:34.744175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:34.744977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:34.750311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.750813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.751258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.752002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.752469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.752898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.838441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lazy-loading 'services' on Instance uuid 9d78fcef-704b-44c7-b1b2-d79794034b4d {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:34.915453 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6ddcf81f-e6d5-4688-957e-c6c0fe18776e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments/409721b9-d1e9-4cae-92e1-79b4142824fc" status: 202 len: 0 microversion: 2.1 time: 0.177513 Sep 23 04:46:34.916065 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3635/7207] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:46:34 2022] DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments/409721b9-d1e9-4cae-92e1-79b4142824fc => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:34.922693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:34.923934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:34.928555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:34.931584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:34.940345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.940967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.941468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.942206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.942657 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.943100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.979781 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-985c5bf7-70a8-46b9-a4a0-d59b7a1a49d2 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058985 Sep 23 04:46:34.984583 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3573/7208] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:34 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:35.992871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:35.995250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:36.001591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:36.002074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:36.002507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:36.003200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:36.003649 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:36.004071 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:36.035578 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9f6bcceb-43f8-4c85-b67e-a88e4792b30c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Sep 23 04:46:36.036406 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3636/7209] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:35 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:37.048559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:37.051233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:37.059169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.059679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.060140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.060904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.061397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.061850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.094391 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a13dd7e0-f99c-409c-bd9c-0c3d428ec3df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049920 Sep 23 04:46:37.094998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3574/7210] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:37 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:38.107192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:38.109499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:38.116783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.117213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.117680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:38.118374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.118974 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.119252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:38.151377 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-83e72c03-16ef-40ad-8dd2-3fcc56ab98ab tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048134 Sep 23 04:46:38.151950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3637/7211] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:38 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:39.164373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:39.166599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:39.173609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:39.174115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:39.174601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:39.175320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:39.175799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:39.176249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:39.206760 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d53d4491-9c2f-4252-8794-99c9de5b8f46 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Sep 23 04:46:39.207345 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3575/7212] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:39 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:40.219822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:40.222063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:40.228917 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.229438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.229887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.230587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.231046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.231479 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.261742 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b9058dca-e58d-4bed-b20d-e24e5c14adf4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045925 Sep 23 04:46:40.262335 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3638/7213] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:46:40 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:46:40.273307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:40.273831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:40.280714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.281209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.281691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.282391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.282856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.283298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.362147 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d is not attached to volume 409721b9-d1e9-4cae-92e1-79b4142824fc Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments/409721b9-d1e9-4cae-92e1-79b4142824fc HTTP/1.1 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d is not attached to volume 409721b9-d1e9-4cae-92e1-79b4142824fc Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': '9d78fcef-704b-44c7-b1b2-d79794034b4d', 'id': '409721b9-d1e9-4cae-92e1-79b4142824fc'} Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 409721b9-d1e9-4cae-92e1-79b4142824fc. Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d is not attached to volume 409721b9-d1e9-4cae-92e1-79b4142824fc Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:40.363772 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d is not attached to volume 409721b9-d1e9-4cae-92e1-79b4142824fc Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d is not attached to volume 409721b9-d1e9-4cae-92e1-79b4142824fc {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c70173a0-f341-4010-96a3-b6e27e282605 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments/409721b9-d1e9-4cae-92e1-79b4142824fc" status: 404 len: 154 microversion: 2.1 time: 0.096036 Sep 23 04:46:40.368629 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3576/7214] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:46:40 2022] DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d/os-volume_attachments/409721b9-d1e9-4cae-92e1-79b4142824fc => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:46:43.712703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:43.713230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:43.720466 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.720882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.721326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.722057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.722693 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.723289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.751246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:46:43.832685 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-68ded003-f85b-4d5f-ba2b-93d234fa7e67 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 204 len: 0 microversion: 2.1 time: 0.124434 Sep 23 04:46:43.833639 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3639/7215] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:46:43 2022] DELETE /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:46:43.842183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:43.842806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:43.849880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.850411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.850862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.851579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.852046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.852485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.990100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:43.998051 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3c120be-e8c2-4b6a-8c3d-c30d13d0ad2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1560 microversion: 2.1 time: 0.159751 Sep 23 04:46:43.998736 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3577/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:43 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:45.021751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:45.022450 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:45.030032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:45.030515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:45.030979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:45.031793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:45.032277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:45.032702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:45.160669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:45.168591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2b99279d-2283-47f0-a23a-af6a280f8f59 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1560 microversion: 2.1 time: 0.151117 Sep 23 04:46:45.169173 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3640/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:45 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:46.181659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d78fcef-704b-44c7-b1b2-d79794034b4d", "name": "network-vif-deleted", "tag": "1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:46.193722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.194296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.194821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.198052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:46.198716 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:46.205854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.206342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.206782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.207456 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] Creating event network-vif-deleted:1dcc51c5-2e49-4236-a3f3-8e1c5e52bd2e for instance 9d78fcef-704b-44c7-b1b2-d79794034b4d on n-h2-858495-2 Sep 23 04:46:46.207620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.208063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.208574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.214065 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-fc3b5ffc-199e-435a-8806-fb432a6c700d req-764c6531-9c01-4f38-82d5-506fce4b3a01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160398 Sep 23 04:46:46.217874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3578/7218] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:46.247471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.247895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.248344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.248798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lazy-loading 'fault' on Instance uuid 9d78fcef-704b-44c7-b1b2-d79794034b4d {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:46.290520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:46.298385 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eed1357d-3aaf-414e-8320-0e116f3babc8 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 200 len: 1352 microversion: 2.1 time: 0.110909 Sep 23 04:46:46.298968 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3641/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:46 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:47.323355 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:47.323976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: 9d78fcef-704b-44c7-b1b2-d79794034b4d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:47.330215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:47.330713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:47.331162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:47.331859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:47.332324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:47.332766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:47.346501 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d HTTP/1.1 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '9d78fcef-704b-44c7-b1b2-d79794034b4d'} Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:47.348108 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance 9d78fcef-704b-44c7-b1b2-d79794034b4d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6ca0008-c386-4e4e-b784-1080fe159050 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d" status: 404 len: 111 microversion: 2.1 time: 0.031968 Sep 23 04:46:47.352584 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3579/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:47 2022] GET /compute/v2.1/servers/9d78fcef-704b-44c7-b1b2-d79794034b4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:46:47.358341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38624df4-0522-4d16-a58e-ef14d4588aba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '.version_select at 0x7f0c89dd61f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:47.378412 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38624df4-0522-4d16-a58e-ef14d4588aba tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-547726340" status: 202 len: 0 microversion: 2.1 time: 0.023851 Sep 23 04:46:47.378996 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3642/7221] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-547726340 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:47.396498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e997c45-7185-4817-bceb-9287cf7c8ad4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: .version_select at 0x7f0c89bdfca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-628969958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIBLSf563KM6osRKCys1LxawhQiTRlYE8zf8sHR0gMGYvMmtaLPiSGhg1HuZ51KvWRNcnT5N9NwbeVdmyEia55hV6gpHW9Pk0Xshogd9WNAP3HZG7IqAoKlcUSPIjOOMw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:47.412747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2e997c45-7185-4817-bceb-9287cf7c8ad4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:47.417982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-2e997c45-7185-4817-bceb-9287cf7c8ad4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:47.440840 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e997c45-7185-4817-bceb-9287cf7c8ad4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048250 Sep 23 04:46:47.441456 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3580/7222] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:46:47 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:47.491842 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1287598855", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-628969958", "networks": [{"uuid": "0b055a58-0d42-4e4f-ab49-e24fd0cf2f02"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:47.545139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] validate_networks() for [('0b055a58-0d42-4e4f-ab49-e24fd0cf2f02', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:47.917153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:47.917622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:47.918105 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:47.918521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:47.918999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:47.927711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:47.928196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:47.928641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:47.929399 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:47.929870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:47.930303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:47.947247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:47.952615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Getting quotas for user 0fab7a9081b2472fb8c764b4f4bb8322 and project 4db1213022ac44079eb5ecfe0f51a5ff. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:47.965408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:47.967972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:48.017933 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-46f5d2b4-5bef-49ed-9bf8-e421815b7d2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530038 Sep 23 04:46:48.018588 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3643/7223] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:46:48.031490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-19a7a4c5-acc9-43f6-8ca0-8bddd4aa211d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:48.032243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-19a7a4c5-acc9-43f6-8ca0-8bddd4aa211d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:48.088052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-19a7a4c5-acc9-43f6-8ca0-8bddd4aa211d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:48.096472 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-19a7a4c5-acc9-43f6-8ca0-8bddd4aa211d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1262 microversion: 2.1 time: 0.069041 Sep 23 04:46:48.097227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3581/7224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:48 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:49.121091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:49.122523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:49.130334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:49.130962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:49.131502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:49.132343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:49.132898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:49.134116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:49.205134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:49.215495 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4ef946d7-35ea-4c7c-a92e-2b9ca6d7e710 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1322 microversion: 2.1 time: 0.099370 Sep 23 04:46:49.216441 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3644/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:49 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.239680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:50.240247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:50.247345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.247743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.248196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.248909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.249457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.249843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.492533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:50.504486 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-55e97414-ae7f-48ff-9ac6-cb2d2c373dda tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.268590 Sep 23 04:46:50.505512 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3582/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:50 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.640670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c8e4e6-e26e-4faa-b613-78bdf4459fc6", "tag": "fbe8d98d-a687-4f00-956f-b73ff2433328"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:50.654467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.654954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.655384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.666954 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] Creating event network-changed:fbe8d98d-a687-4f00-956f-b73ff2433328 for instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 on n-h2-858495-2 Sep 23 04:46:50.674550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d634e9f1-c3f1-44f4-81e7-5b539eab3963 req-c86d1cdf-7ff3-44b8-9bd6-ec753778cda9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039316 Sep 23 04:46:50.675495 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3645/7227] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:51.528168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:51.528792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:51.535705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.536202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.536905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.537637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.538107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.538546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.672128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:51.680435 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a8c70191-ebc1-4518-9e56-da37846b3880 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.156611 Sep 23 04:46:51.681012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3583/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:51 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:52.703571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:52.704277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:52.711556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.712495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.712866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.713725 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.714186 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.714619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.842881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.850574 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-daeb2810-fa0a-4170-9506-75886efc7164 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.151390 Sep 23 04:46:52.851154 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3646/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:52 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:53.874392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:53.874966 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:53.881793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:53.882297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:53.882753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:53.884084 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:53.884558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:53.885010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:54.017069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.026053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-463c046d-8303-4886-84e7-3c570127cf76 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.155738 Sep 23 04:46:54.026880 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3584/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:53 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:55.048615 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:55.049234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:55.056224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.056706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.057146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.057873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.058336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.058765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.184224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:55.191866 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8d82371-1b48-4691-be2c-03054ea8e674 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.147207 Sep 23 04:46:55.192452 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3647/7231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:55 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:56.216204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:56.216861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:56.223780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:56.224278 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:56.224731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:56.225462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:56.225937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:56.226379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:56.357899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:56.366239 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-768ed992-7fdf-4e3b-9562-b40df670c065 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.155434 Sep 23 04:46:56.366842 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3585/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:56 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:57.390313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:57.390922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:57.397775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.398254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.398689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.399903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.400356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.400788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.530458 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:57.538456 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e14c47d8-e37b-4106-9aa3-58d977aa6393 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.151990 Sep 23 04:46:57.539045 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3648/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:57 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:57.919369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c8e4e6-e26e-4faa-b613-78bdf4459fc6", "name": "network-vif-plugged", "status": "completed", "tag": "fbe8d98d-a687-4f00-956f-b73ff2433328"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:57.929838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.929838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.930125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.941152 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] Creating event network-vif-plugged:fbe8d98d-a687-4f00-956f-b73ff2433328 for instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 on n-h2-858495-2 Sep 23 04:46:57.946571 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d8a13a83-5ebc-4495-9f45-bbc571c00e30 req-01a2f823-2cd9-4aff-9d05-2765e19b99b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087415 Sep 23 04:46:57.947157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3586/7234] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:58.562733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:58.563395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:58.565414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:58.566294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:58.573113 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.573598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.574051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.574755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.575221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.575660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.714819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:58.722658 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b982f305-6bd6-45ea-b0dd-a6e7dc321039 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1362 microversion: 2.1 time: 0.163935 Sep 23 04:46:58.723242 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3649/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:58 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:59.743173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:59.748775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:59.749532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:59.756010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.756514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.756975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.757724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.758204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.758654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.886479 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:59.894278 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d90514b8-f49b-41b4-b651-c5d39e586c2e tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1555 microversion: 2.1 time: 0.152168 Sep 23 04:46:59.894863 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3587/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:59 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:59.917222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:59.918004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:59.925212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.925736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.926173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.926869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.927325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.927751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.066485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:00.075255 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ed02119-cdd9-4b8b-b5c1-65d7a1c66e2c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1555 microversion: 2.1 time: 0.161993 Sep 23 04:47:00.075255 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3650/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:59 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:01.762457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d12770c9-c591-45d1-8115-5029058881ac"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:01.764879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:01.771711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.772208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.772685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.773408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.773882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.774325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:02.036441 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d9b7c69-fcb4-4232-a466-348daf5d675c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "POST /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278100 Sep 23 04:47:02.037265 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3588/7238] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:47:01 2022] POST /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:12.763633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.764155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:12.766674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.767328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.774242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.774792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.775268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.776573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.777027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.777488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.861663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lazy-loading 'services' on Instance uuid c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:12.932894 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10e118c9-bd4f-4408-82c8-317b4eade4df tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments/d12770c9-c591-45d1-8115-5029058881ac" status: 202 len: 0 microversion: 2.1 time: 0.173776 Sep 23 04:47:12.933517 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3651/7239] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:47:12 2022] DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments/d12770c9-c591-45d1-8115-5029058881ac => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:47:12.940032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.940835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.945570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.948589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:12.957267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.957818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.958262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.958992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.959464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.959910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.993196 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1c2759d-4477-45f7-b514-5cd530282bcd tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055048 Sep 23 04:47:12.993815 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3589/7240] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:47:14.007110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:14.009558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:14.016748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.017236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.017711 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.018419 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.018880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.019315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.050235 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f5c2fe5-5aba-473a-acad-7c257b0550f7 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Sep 23 04:47:14.050799 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3652/7241] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:14 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:15.063208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:15.065466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:15.072878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.073510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.074287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.074673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.075139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.075686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.110909 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0546f524-f2bc-4d5e-83cd-1723b7a6e669 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051722 Sep 23 04:47:15.111496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3590/7242] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:15 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:16.123677 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:16.125851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:16.133339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.133854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.134293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.135660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.136116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.136550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.166707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5eef50cb-61f6-47e7-a51f-4d981b67db2a tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047882 Sep 23 04:47:16.167274 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3653/7243] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:16 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:17.179196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:17.181374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:17.187878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.188373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.188824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.189555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.190021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.190461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.220826 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a6db8cfe-bb76-4156-9557-ea615e5f62d4 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Sep 23 04:47:17.221415 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3591/7244] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:18.234014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.236221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.242646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.243131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.243588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.244899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.245371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.245801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.273785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ad72c045-1d27-4542-9ae9-418ddc65634d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043863 Sep 23 04:47:18.274506 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3654/7245] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:47:18.286490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.287013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.294762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.295299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.295758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.296466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.296940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.297410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.373661 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 is not attached to volume d12770c9-c591-45d1-8115-5029058881ac Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: request: DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments/d12770c9-c591-45d1-8115-5029058881ac HTTP/1.1 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 is not attached to volume d12770c9-c591-45d1-8115-5029058881ac Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'server_id': 'c8c8e4e6-e26e-4faa-b613-78bdf4459fc6', 'id': 'd12770c9-c591-45d1-8115-5029058881ac'} Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d12770c9-c591-45d1-8115-5029058881ac. Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 is not attached to volume d12770c9-c591-45d1-8115-5029058881ac Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:18.375371 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 is not attached to volume d12770c9-c591-45d1-8115-5029058881ac Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 is not attached to volume d12770c9-c591-45d1-8115-5029058881ac {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0bb7a25d-495d-489a-b0e0-8832dee3163c tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments/d12770c9-c591-45d1-8115-5029058881ac" status: 404 len: 154 microversion: 2.1 time: 0.094460 Sep 23 04:47:18.380049 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3592/7246] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:47:18 2022] DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6/os-volume_attachments/d12770c9-c591-45d1-8115-5029058881ac => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:21.734949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.735505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.742550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.743165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.743678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.744552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.745062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.745762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.776792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:21.852921 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-789dd5e7-f72c-4078-8444-d295c538ec9f tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 204 len: 0 microversion: 2.1 time: 0.128066 Sep 23 04:47:21.853032 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3655/7247] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:21 2022] DELETE /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:21.861716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.862991 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.870781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.871297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.871832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.872639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.873113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.873624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.004548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:22.013252 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7c35db4-6211-457a-bc71-8555e229f562 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1561 microversion: 2.1 time: 0.155797 Sep 23 04:47:22.013875 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3593/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:23.036616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:23.037319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:23.045087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:23.045612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:23.046054 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:23.046748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:23.047201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:23.047630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:23.178449 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:23.186162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3378b830-228e-4d05-a430-200a86dc17cc tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1561 microversion: 2.1 time: 0.153823 Sep 23 04:47:23.186743 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3656/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:23 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:24.049305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c8e4e6-e26e-4faa-b613-78bdf4459fc6", "name": "network-vif-deleted", "tag": "fbe8d98d-a687-4f00-956f-b73ff2433328"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:24.065261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.065978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.066626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.080997 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] Creating event network-vif-deleted:fbe8d98d-a687-4f00-956f-b73ff2433328 for instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 on n-h2-858495-2 Sep 23 04:47:24.088244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-36eeeed2-c651-4aa1-8852-e1516ef87cee req-063cb62b-f7ec-42f9-ae9b-62a051204d62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043564 Sep 23 04:47:24.088867 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3594/7250] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:24.209888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:24.210620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:24.217329 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.217855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.218306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.219017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.219546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.219987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.253085 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.253698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.254151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.254508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lazy-loading 'fault' on Instance uuid c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:24.300690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab7a9081b2472fb8c764b4f4bb8322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db1213022ac44079eb5ecfe0f51a5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:24.308515 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-70aa5540-9617-44c9-8e57-4bcbb727f86d tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 200 len: 1352 microversion: 2.1 time: 0.102602 Sep 23 04:47:24.309094 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3657/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:24 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:25.332375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.333137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] [instance: c8c8e4e6-e26e-4faa-b613-78bdf4459fc6] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:25.340561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.341069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.341572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.342301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.342788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.343242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.357424 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] HTTP exception thrown: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Request method failure captured: Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 HTTP/1.1 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTnnNfKTFo8bz1ReHkwFXNcOrLuBuxyY9bQ4VnNza6j_4l3drxboBIWGRk2-bTH7h-DakHLThXz2E2eu0WwYgcC7oFSVbVZ_wXEc70gWCRgBaPuWRNi1qOWPpBLZBnHVUjhNm-8KhpfTb5VkupvPT5nF7hNPphJeSue2Bdi8SGamDvM Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4db1213022ac44079eb5ecfe0f51a5ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 4db1213022ac44079eb5ecfe0f51a5ff Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1053993630 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 0fab7a9081b2472fb8c764b4f4bb8322 Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1053993630-project Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'c8c8e4e6-e26e-4faa-b613-78bdf4459fc6'} Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.359120 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Returning 404 to user: Instance c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34a49637-3ca0-42fc-97c6-822360ba3b56 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6" status: 404 len: 111 microversion: 2.1 time: 0.032630 Sep 23 04:47:25.363626 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3595/7252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/servers/c8c8e4e6-e26e-4faa-b613-78bdf4459fc6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:25.369281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c1d3a718-3aa2-4271-8f7f-05b5c2e841e1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] Calling method '.version_select at 0x7f0c8a94d820>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.389629 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c1d3a718-3aa2-4271-8f7f-05b5c2e841e1 tempest-TestEncryptedCinderVolumes-1053993630 tempest-TestEncryptedCinderVolumes-1053993630-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-628969958" status: 202 len: 0 microversion: 2.1 time: 0.024083 Sep 23 04:47:25.390209 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3658/7253] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 23 04:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-628969958 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:47:52.137825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec85efa1-584b-4957-87ba-7d0106de9e3a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: .version_select at 0x7f0c89c53160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2075410830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaeI7jwqkSNPK9bX4pFp1J/oiklhr68mQn+6HF7ZzNoMF0RabmTWatBPaUG3l5vqcA1Iyvf9wmgUgnKr+s60ikDXUeQaJOLoSdlRUuQNj25ZSo/MdAtIE8HZjtRlZev4w=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:52.144147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=14 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:52.144809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=34 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:52.157218 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ec85efa1-584b-4957-87ba-7d0106de9e3a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for project 04090d474a69491bbafc38edd0586226. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:52.162433 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-ec85efa1-584b-4957-87ba-7d0106de9e3a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for user 7065f524ed594ee7ab55c6f9e4c55c72 and project 04090d474a69491bbafc38edd0586226. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:52.186940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec85efa1-584b-4957-87ba-7d0106de9e3a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053398 Sep 23 04:47:52.187534 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3596/7254] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:47:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:52.233648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:52.234471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:52.238487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-872069938", "imageRef": "30b2926a-d23d-4792-8823-e011f7f1fe07", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2075410830", "networks": [{"uuid": "1b5aed1e-52a3-4ed1-8d1d-3ca21443167d"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:52.294643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] validate_networks() for [('1b5aed1e-52a3-4ed1-8d1d-3ca21443167d', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:47:52.655906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:52.656338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:52.656850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:52.657267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:52.657708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:52.666976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.667464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.667904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:52.669147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.669642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.670075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:52.688082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for project 04090d474a69491bbafc38edd0586226. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:52.693297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for user 7065f524ed594ee7ab55c6f9e4c55c72 and project 04090d474a69491bbafc38edd0586226. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:52.705868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:52.708133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30b2926a-d23d-4792-8823-e011f7f1fe07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:52.756190 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-971afd5c-fc9d-4aae-9d40-2cf0e3a16bd7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524708 Sep 23 04:47:52.757063 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3659/7255] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:47:52.767834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38cd6d06-f94d-4aa1-803a-95b899a169c7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:52.768478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38cd6d06-f94d-4aa1-803a-95b899a169c7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:52.824322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38cd6d06-f94d-4aa1-803a-95b899a169c7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:52.831797 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38cd6d06-f94d-4aa1-803a-95b899a169c7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1258 microversion: 2.1 time: 0.067890 Sep 23 04:47:52.832389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3597/7256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:52 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:53.855168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:53.857127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:53.864916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:53.865437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:53.865889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:53.866723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:53.867428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:53.868034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:53.934451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:53.942183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c4f0af6-0e3c-429e-b7e8-6fa522224ae9 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1328 microversion: 2.1 time: 0.091114 Sep 23 04:47:53.942758 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3660/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:53 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:54.967903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:54.968543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:54.977275 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.977814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.978266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:54.978986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.979464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.979908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:55.122352 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:55.131142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-46e264ea-ef39-4065-965a-7984c711ad1d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.168232 Sep 23 04:47:55.132080 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3598/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:54 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:56.156971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:56.157637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:56.164798 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.165853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.166482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:56.167366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.168013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.168614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:56.309094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:56.317744 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-98142129-ada3-40c4-a56f-f46316888639 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.165220 Sep 23 04:47:56.318347 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3661/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:56 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:57.341931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:57.342933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:57.350541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.351052 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.351539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.352263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.352737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.353182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.515679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:57.520890 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-35ab261f-0066-4571-a544-eec92e44a91e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.183689 Sep 23 04:47:57.521526 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3599/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:57 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:58.546145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:58.546760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:58.553742 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.554224 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.554683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.555372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.555823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.556248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.697884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:58.706678 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c7685078-8acf-4007-a367-e144015a88bc tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.165214 Sep 23 04:47:58.707486 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3662/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:58 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:59.733663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:59.734318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:59.742239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.743130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.743827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:59.744690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.745237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.745941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:59.892595 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:59.900897 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7be4d4a0-bab0-4197-8130-f451dd389910 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.172379 Sep 23 04:47:59.901533 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3600/7262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:59 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:00.924215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:00.924815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:00.932132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.932623 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.933064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.933802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.934447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.934878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.075177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.082918 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b4a3c93-6c4e-4554-bcd6-1f48b445d577 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.162611 Sep 23 04:48:01.083507 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3663/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:00 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:02.105937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:02.107070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:02.114211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.115333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.115796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.116516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.116989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.117460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.246681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:02.255256 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18212e9a-50ce-48ff-9f42-94649849ce04 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.153242 Sep 23 04:48:02.255910 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3601/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:02 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:02.433775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:02.443342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.443819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.444253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.455707 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] Creating event network-changed:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:48:02.461162 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4c42fd65-bb81-4b41-8ac8-898a21d262be req-86f54ce9-2140-46b0-a4e5-3e412c9b4374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169729 Sep 23 04:48:02.462147 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3664/7265] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:03.279840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:03.280472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:03.282372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:03.288728 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.289223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.289696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.290414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.291116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.291559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.422866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:03.430807 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d3d27a34-c3ce-4213-be28-340f6a0ab9e0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.155400 Sep 23 04:48:03.431389 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3602/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:03 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:04.449881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:04.450672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:04.455934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:04.456654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:04.463512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.464003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.464448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.465391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.465648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.466086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.593526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.601231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b5ee511-d7ee-41ae-9ca5-e99e89433c4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.152327 Sep 23 04:48:04.601837 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3665/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:05.624671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:05.625327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:05.632212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:05.632708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:05.633160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:05.633887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:05.634357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:05.634799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:05.763845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:05.771624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fa517989-3382-49a1-9c10-b5b1fae90112 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.151400 Sep 23 04:48:05.772214 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3603/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:05 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:06.796358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:06.797094 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:06.804176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.804800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.805246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.805994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.806504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.806873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.934555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.942289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97786b1a-4577-46cd-b07a-ba8382de6849 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.149836 Sep 23 04:48:06.942883 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3666/7269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:06 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:07.965493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:07.966660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:07.974259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.974788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.975274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.976243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.976793 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.977306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:08.105108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:08.113601 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-171fa16a-4e26-4970-b4f9-b4f73aeef0a4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.152040 Sep 23 04:48:08.114180 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3604/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:07 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:08.885978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "name": "network-vif-plugged", "status": "completed", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:08.896688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:08.897170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:08.897630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:08.909392 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] Creating event network-vif-plugged:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:48:08.914361 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e890c8cb-4195-45c7-9578-45c9ed817de4 req-00ab6763-e33a-4fd7-b2ab-a77e5304c539 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Sep 23 04:48:08.915023 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3667/7271] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:09.136478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:09.137217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:09.144616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.145116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.145591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.146300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.146769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.147209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.275161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.282858 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-30c72a3e-4b10-40f9-892a-c175599f0da5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1358 microversion: 2.1 time: 0.150316 Sep 23 04:48:09.283443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3605/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:09 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:10.306613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.307264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.314229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.314714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.315152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.315848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.316304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.316733 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.447302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.456591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1b2298bf-1963-438a-986e-6ea2b5b40658 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1548 microversion: 2.1 time: 0.155132 Sep 23 04:48:10.457185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3668/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:10.479229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.479854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.487467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.487978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.488434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.489173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.489673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.490120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.618760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.627179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f03fff0-9038-4af3-a5af-c3db7201eeff tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1548 microversion: 2.1 time: 0.151793 Sep 23 04:48:10.627755 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3606/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:10.649193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.653924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.654694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Searching by: {'deleted': False, 'project_id': '04090d474a69491bbafc38edd0586226'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:48:10.659886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.660365 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.660801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.661557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.662012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.662437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.690001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:48:10.716289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b0eaecb1-424d-4ffa-8f6d-0ecf5e17ce60 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070395 Sep 23 04:48:10.716886 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3669/7275] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:10.728406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.729037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.737958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.738464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.739059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.739779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.740253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.740706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.872166 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.880037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6e4866cc-1bbe-419f-be88-c567cf29098f tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1548 microversion: 2.1 time: 0.155506 Sep 23 04:48:10.880619 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3607/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:12.425435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cda62b7-5d41-47a6-9831-30d8aca91516"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:12.427881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:12.434671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.435157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.435597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.436325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.436782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.437212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.672552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0925e941-50ab-4fbe-b713-86dd7be539c6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251218 Sep 23 04:48:12.673200 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3670/7277] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:48:12 2022] POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:25.702440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:25.703113 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:25.705521 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:25.706193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=60 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:25.712834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:25.713341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:25.713848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:25.714701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:25.715223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:25.715733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:25.849059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:25.858069 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9674a7e2-c3dd-4d9c-91be-a6dc94bf94e5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1594 microversion: 2.1 time: 0.159865 Sep 23 04:48:25.858655 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3608/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:25 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:27.839250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:27.840460 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:27.841135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:27.846177 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:27.858616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:27.859129 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:27.859575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:27.872590 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] Creating event network-changed:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:48:27.877790 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-0a074b0b-c86a-417b-b56d-7ae9f88512b6 req-83f94d22-6628-4d21-837a-c06822ae53cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040311 Sep 23 04:48:27.878788 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3671/7279] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:28.962963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1959060844"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:28.963533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:28.971161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:28.971672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:28.972137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:28.972874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:28.973375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:28.974023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.110583 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.security_group_api [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Adding security group ba212e1d-183f-4373-bb1a-a27aaed134c4 to port fee69b53-75cf-4db9-a78d-8b2762398ef1 Sep 23 04:48:29.428037 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e51f6ddf-be40-45c5-b131-b02a23c25d30 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action" status: 202 len: 0 microversion: 2.1 time: 0.469052 Sep 23 04:48:29.429271 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3609/7280] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:48:28 2022] POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:29.438374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.439300 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:29.445542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.446101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.446977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.447368 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.447890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.448390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.605688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.614633 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9ea1dea6-8ca8-4e85-8f31-6b33a72fb2c4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1760 microversion: 2.1 time: 0.181631 Sep 23 04:48:29.615223 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3672/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:29.893330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:29.902909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.903450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.904525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.915938 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] Creating event network-changed:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:48:29.921499 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-bf7b456a-8b9b-4142-ab35-2b01c16e00ed req-7266d0f7-7717-4259-99f6-7092f00cc3d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Sep 23 04:48:29.922222 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3610/7282] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:09.393758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:09.394546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:09.395788 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:50:09.395970 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action (ip 10.222.0.25) !!! Sep 23 04:50:09.398493 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 23 04:50:09.404875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:09.407124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:09.417152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.417670 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.418108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.418797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.419244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.419783 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.496239 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f238f847-d398-4cbe-be8f-f04b458c7419 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action" status: 202 len: 0 microversion: 2.1 time: 0.104033 Sep 23 04:50:09.496875 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3673/7283] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:09 2022] POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:50:09.505045 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:09.505883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:09.507105 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 04:50:09.507240 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c (ip 10.222.0.25) !!! Sep 23 04:50:09.509078 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:50:09.509231 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c (ip 10.222.0.25) !!! Sep 23 04:50:09.518910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:09.519631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:09.534735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.535240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.535694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.536411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.536921 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.537389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.689603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:09.698578 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-012bb86a-aa0a-42ed-a758-976f28887057 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1762 microversion: 2.1 time: 0.196351 Sep 23 04:50:09.699175 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3611/7284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:09 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1762 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:10.723577 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:10.724233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:10.730441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:10.730928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:10.731371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:10.732063 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:10.732521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:10.732952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:10.887549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:10.895785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dfe5c375-2fec-4bc3-9e1b-f30e30797ea0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1760 microversion: 2.1 time: 0.177688 Sep 23 04:50:10.896356 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3674/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:10 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:25.047721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:25.048493 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:25.052769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1959060844"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:25.053325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:25.060077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.060579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.061607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.062315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.062790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.063242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.261607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.security_group_api [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Removing security group ba212e1d-183f-4373-bb1a-a27aaed134c4 from port fee69b53-75cf-4db9-a78d-8b2762398ef1 Sep 23 04:51:25.562759 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6a913c73-1448-4e9e-a16c-906d489b5f1e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action" status: 202 len: 0 microversion: 2.1 time: 0.516277 Sep 23 04:51:25.563577 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3612/7286] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:25 2022] POST /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:25.575145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:25.584552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:25.585846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:25.588587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.589173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.589750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.605593 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] Creating event network-changed:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:51:25.613092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5d02101e-9d9c-43e6-a4f8-d1d8ff2e54c3 req-1a4672e1-780b-4f97-8315-2414024cfa81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043260 Sep 23 04:51:25.614154 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3675/7287] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:26.795351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:26.795951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:26.802461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.803035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.803559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.804336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.804874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.805411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.886147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lazy-loading 'services' on Instance uuid 77973c85-62da-44e6-be47-7f6571bfdf9c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:51:26.958577 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [1fe0ee23-cfbb-4bf7-b290-0b857fbbaaa0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 04:51:27.632387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:27.644046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.644620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.645151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:27.656898 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] Creating event network-changed:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:51:27.662152 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8246f9a1-bb8f-4254-8865-11e2fe4bcae1 req-fb07003a-59c6-400c-ba9c-c602bdc0b0b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034683 Sep 23 04:51:27.662790 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3676/7288] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:27.966162 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [1fe0ee23-cfbb-4bf7-b290-0b857fbbaaa0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54160. Sep 23 04:51:27.970409 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94b8bbed-3534-4fb2-990d-15ef2ce5eea3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments/3cda62b7-5d41-47a6-9831-30d8aca91516" status: 202 len: 0 microversion: 2.1 time: 1.179948 Sep 23 04:51:27.971026 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3613/7289] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:51:26 2022] DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments/3cda62b7-5d41-47a6-9831-30d8aca91516 => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:27.979930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:27.982504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:27.989140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.989666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.990478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:27.991347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.991826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.992274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.023912 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-02dd53f5-feab-4322-84ac-96248d8cd038 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 Sep 23 04:51:28.024640 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3677/7290] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:27 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:29.037036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:29.039501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:29.047435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.047943 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.048403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.049127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.049631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.050354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.081960 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5383700f-3134-44b6-86fb-f7a839a5cecf tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049338 Sep 23 04:51:29.082536 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3614/7291] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:29 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:30.095402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:30.097903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:30.104637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.105123 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.105607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:30.106354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.106809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.107235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:30.136592 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9bdbbc6b-761d-439c-ab3c-e662137375be tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Sep 23 04:51:30.137165 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3678/7292] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:30 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:31.149971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:31.152058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:31.159123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.159631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.160094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.160818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.161295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.161770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.199095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6fa45b12-664c-4502-84c6-024be2d963d4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053351 Sep 23 04:51:31.199698 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3615/7293] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:31 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:32.211650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:32.213861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:32.221049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.221571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.222012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.222718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.223175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.223607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.254939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d27d3e8c-e3da-4f62-bd7d-184d31fbf6db tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Sep 23 04:51:32.255516 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3679/7294] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:32 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:33.270716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:33.274169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:33.285715 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:33.288569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:33.291285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:33.293443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:33.293928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:33.294378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:33.323791 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5c79861d-9fee-4a92-b2b4-066666f2161d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060151 Sep 23 04:51:33.324360 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3616/7295] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:51:33 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:33.335017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:33.335517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:33.342754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:33.343237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:33.343679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:33.344371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:33.344826 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:33.345252 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:33.517402 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] HTTP exception thrown: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c is not attached to volume 3cda62b7-5d41-47a6-9831-30d8aca91516 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Request method failure captured: Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments/3cda62b7-5d41-47a6-9831-30d8aca91516 HTTP/1.1 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTppOVRiHx_zAuYSgh-967MNN5UCGZwfn6VRacku_4wYFYJNMsupBv1KOLxCeDR2TmH19AIVFSn4d4U2YYG_YwIPtAiX-h-CPFseZSS_afZsGXeVFdIKef79gaFJF1oj2DWOylyQ5rOg4PKW1LS4Vh08URf2LILfYXSR0fT9EeqWJWo Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04090d474a69491bbafc38edd0586226"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04090d474a69491bbafc38edd0586226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7065f524ed594ee7ab55c6f9e4c55c72 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c is not attached to volume 3cda62b7-5d41-47a6-9831-30d8aca91516 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '77973c85-62da-44e6-be47-7f6571bfdf9c', 'id': '3cda62b7-5d41-47a6-9831-30d8aca91516'} Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3cda62b7-5d41-47a6-9831-30d8aca91516. Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c is not attached to volume 3cda62b7-5d41-47a6-9831-30d8aca91516 Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:33.519375 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c is not attached to volume 3cda62b7-5d41-47a6-9831-30d8aca91516 Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Returning 404 to user: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c is not attached to volume 3cda62b7-5d41-47a6-9831-30d8aca91516 {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75c234e6-370f-44f2-949c-b485ca69e082 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments/3cda62b7-5d41-47a6-9831-30d8aca91516" status: 404 len: 154 microversion: 2.1 time: 0.189921 Sep 23 04:51:33.523884 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3680/7296] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:51:33 2022] DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c/os-volume_attachments/3cda62b7-5d41-47a6-9831-30d8aca91516 => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:36.771488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:36.772011 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:36.779115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.780913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.781401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.782133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.782613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.783070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.808825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:51:36.883806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4915ff7c-8a2d-4b92-975e-51461ee5a1f5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 204 len: 0 microversion: 2.1 time: 0.115816 Sep 23 04:51:36.884807 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3617/7297] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:36 2022] DELETE /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:51:36.893443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:36.894069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:36.902319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.902822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.903322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.904067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.904571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.905589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.042768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:37.050873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f423bee2-776e-4cd4-b1b0-67eadf0ba5a0 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1554 microversion: 2.1 time: 0.161687 Sep 23 04:51:37.051443 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3681/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:36 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:38.075025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:38.075749 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:38.083259 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.083760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.084219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.084928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.085442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.085892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.216267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:38.224769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-441763de-3455-4c9b-8df9-20814557c74c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1554 microversion: 2.1 time: 0.154136 Sep 23 04:51:38.230049 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3618/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:38 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:38.902630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77973c85-62da-44e6-be47-7f6571bfdf9c", "name": "network-vif-deleted", "tag": "fee69b53-75cf-4db9-a78d-8b2762398ef1"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:38.914481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.914997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.915775 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.928282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] Creating event network-vif-deleted:fee69b53-75cf-4db9-a78d-8b2762398ef1 for instance 77973c85-62da-44e6-be47-7f6571bfdf9c on n-h1-858495-2 Sep 23 04:51:38.933423 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-10f45ab4-a291-47d8-a2ae-1007819bee15 req-d9bfd7f3-ff96-4359-91ed-0ef493695f9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034528 Sep 23 04:51:38.934064 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3682/7300] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:39.250320 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:39.250964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:39.258865 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.259364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.259815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.260530 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.261237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.261870 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.299415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.299913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.300635 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.301101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lazy-loading 'fault' on Instance uuid 77973c85-62da-44e6-be47-7f6571bfdf9c {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:51:39.347759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:39.355664 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-702d0351-84d4-47f3-abb0-ba4d3efb118e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 200 len: 1348 microversion: 2.1 time: 0.109967 Sep 23 04:51:39.356263 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3619/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:39 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:40.381812 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:40.382515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 77973c85-62da-44e6-be47-7f6571bfdf9c] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:40.388749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.389912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.390356 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.391053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.391511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.391944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.404976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] HTTP exception thrown: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Request method failure captured: Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c HTTP/1.1 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTppOVRiHx_zAuYSgh-967MNN5UCGZwfn6VRacku_4wYFYJNMsupBv1KOLxCeDR2TmH19AIVFSn4d4U2YYG_YwIPtAiX-h-CPFseZSS_afZsGXeVFdIKef79gaFJF1oj2DWOylyQ5rOg4PKW1LS4Vh08URf2LILfYXSR0fT9EeqWJWo Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04090d474a69491bbafc38edd0586226"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04090d474a69491bbafc38edd0586226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7065f524ed594ee7ab55c6f9e4c55c72 Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '77973c85-62da-44e6-be47-7f6571bfdf9c'} Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:40.406601 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Returning 404 to user: Instance 77973c85-62da-44e6-be47-7f6571bfdf9c could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-abc08833-4f7a-42a5-a1e4-51f24448fe24 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c" status: 404 len: 111 microversion: 2.1 time: 0.031406 Sep 23 04:51:40.411359 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3683/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:40 2022] GET /compute/v2.1/servers/77973c85-62da-44e6-be47-7f6571bfdf9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:40.416842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c4b1b1da-f7c4-4ea6-94f2-05f18ffed20d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '.version_select at 0x7f0c882e1280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:40.441673 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c4b1b1da-f7c4-4ea6-94f2-05f18ffed20d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2075410830" status: 202 len: 0 microversion: 2.1 time: 0.028599 Sep 23 04:51:40.442262 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3620/7303] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 04:51:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2075410830 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:49.591720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b59ada8f-d1a4-4d1f-9371-6ae0d0c3bbd5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: .version_select at 0x7f0c8a6ed310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1129688778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYh5qdMVTs8Y5AFGNs3ID4hMVwyjaNtbD7tSTW4SYW8IndZTrT1H27Qt4GK1Iuc5V4zKNMiabVoMEn/Sa4wiSrvtwVnbRqLxS4etA6ZY3ivCPoUXqzhLpDrUXtISD5BDA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:49.612598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b59ada8f-d1a4-4d1f-9371-6ae0d0c3bbd5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for project 04090d474a69491bbafc38edd0586226. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:49.617679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-b59ada8f-d1a4-4d1f-9371-6ae0d0c3bbd5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for user 7065f524ed594ee7ab55c6f9e4c55c72 and project 04090d474a69491bbafc38edd0586226. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:49.644306 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b59ada8f-d1a4-4d1f-9371-6ae0d0c3bbd5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057462 Sep 23 04:51:49.644912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3684/7304] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:51:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:49.692258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:49.697130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-619381658", "imageRef": "42b9ba48-1b70-4b0d-9ef0-ddc163f5c2bd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1129688778", "networks": [{"uuid": "1b5aed1e-52a3-4ed1-8d1d-3ca21443167d"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:49.751424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] validate_networks() for [('1b5aed1e-52a3-4ed1-8d1d-3ca21443167d', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:51:50.172578 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:51:50.173029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:51:50.173577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:51:50.174038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:51:50.174474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:51:50.183690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.184199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.184658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.185428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.185910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.186980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.204622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for project 04090d474a69491bbafc38edd0586226. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:50.209900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Getting quotas for user 7065f524ed594ee7ab55c6f9e4c55c72 and project 04090d474a69491bbafc38edd0586226. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:50.222243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:51:50.224478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42b9ba48-1b70-4b0d-9ef0-ddc163f5c2bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:51:50.270731 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-85fb19e5-426d-4d4e-a8d3-85003d774fbb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580405 Sep 23 04:51:50.271393 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3621/7305] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:51:50.282611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8e62cef9-a530-4eca-bc2f-71d3960dc12a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:50.283287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8e62cef9-a530-4eca-bc2f-71d3960dc12a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:50.338135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8e62cef9-a530-4eca-bc2f-71d3960dc12a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:50.345225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8e62cef9-a530-4eca-bc2f-71d3960dc12a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1258 microversion: 2.1 time: 0.066806 Sep 23 04:51:50.345912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3685/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:50 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:51.370242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:51.370977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:51.378771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.379288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.379746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.380466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.381118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.381760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.454081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:51.465750 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d221ac6d-e8ac-4d9e-ae6e-ca120954f943 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1318 microversion: 2.1 time: 0.100672 Sep 23 04:51:51.466996 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3622/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:51 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:52.488086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:52.488706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:52.490673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=38 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:52.498386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:52.499115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:52.499563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:52.500277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:52.500743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:52.501169 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:52.678455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:52.686525 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7deec2fa-bb51-41dd-aedd-5eda7567aa1b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.202266 Sep 23 04:51:52.687206 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3686/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:52 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:53.710336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:53.710983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:53.718112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.718564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.719078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.719753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.720230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.720809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.862888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:53.871600 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d10f6a39-b606-4524-9f0a-1a5056994851 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.165229 Sep 23 04:51:53.872298 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3623/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:53 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:54.896816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:54.897547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:54.906009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.906505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.906953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:54.907674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.908138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.908786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.063962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:55.072087 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b6b1f4c-f562-4cc0-89fa-17aa1c18f442 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.179670 Sep 23 04:51:55.072672 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3687/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:54 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:56.097307 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:56.098231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:56.101009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:56.107373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.108763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.109220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.109993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.110471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.111139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.265850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.273679 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-728fc688-9136-4df3-981e-1f71639d37f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.180367 Sep 23 04:51:56.274270 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3624/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:56 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:57.299077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:57.300568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:57.304144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:57.310116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.310719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.311167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.311883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.312338 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.312769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.452731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:57.465676 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-41029ee7-a55d-41ff-9358-4a74c19c72d7 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.171252 Sep 23 04:51:57.466690 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3688/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:57 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:58.490224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:58.490903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:58.497919 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.498509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.499484 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:58.500206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.500681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.501128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:58.643597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:58.651836 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2833a188-c3a0-46ca-be0e-f65913416384 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.165519 Sep 23 04:51:58.652894 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3625/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:58 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:59.677289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:59.677861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:59.684784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:59.685276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:59.685756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:59.686971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:59.687431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:59.687869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:59.813905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.821594 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-78a1b8dc-b3b5-4205-a2f4-dd909e9c63ad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.148520 Sep 23 04:51:59.822180 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3689/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:59 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:00.844988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:00.845704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:00.848363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:00.849035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:00.854671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.855172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.855622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:00.856323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.856790 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.857229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:00.989588 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:00.997526 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1cf69f76-1d74-4b95-a717-c28ca61c9470 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.157110 Sep 23 04:52:00.998117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3626/7315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:00 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:02.020830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:02.021380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:02.023226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:02.028928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.029433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.030379 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.031076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.031535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.031968 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.160415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:02.168123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cd6702c-ecac-43f3-8bc2-b17d14a4dd11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.151462 Sep 23 04:52:02.168709 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3690/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:02 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:03.191956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:03.192716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:03.199972 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.200489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.200953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.201717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.202203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.202660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.503940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.511904 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bd02296a-e8af-4625-b679-f7d87b1cef10 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.323950 Sep 23 04:52:03.512500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3627/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:03 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:03.889746 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:03.899381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.899966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.900474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.912457 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] Creating event network-changed:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:52:03.917512 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-09ec12ad-979a-43cc-b40b-a1d6127a44cb req-8c342501-c288-4177-9234-670a9dd20609 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096869 Sep 23 04:52:03.918118 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3691/7318] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:04.535128 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:04.535764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:04.542662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.543163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.543619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.544323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.544799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.545246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.671989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.679982 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a0bdb8d7-c8fe-460b-90c1-c2385363fca4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.148768 Sep 23 04:52:04.680557 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3628/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:04 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:05.703374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:05.704114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:05.711154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:05.711638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:05.712078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:05.712774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:05.713233 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:05.713701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:05.847062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:05.854660 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5868bc5-b4aa-4e65-9823-f1cb1ae27261 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.156200 Sep 23 04:52:05.855269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3692/7320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:05 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:06.876519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:06.877143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:06.884001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.884499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.884951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.885682 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.886157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.886599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.020422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:07.028556 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-92bde3af-6993-42ed-b3ef-9c7ffb47aa4a tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.156032 Sep 23 04:52:07.029219 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3629/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:06 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:08.051837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:08.052350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:08.059211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.059695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.060158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:08.060851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.061307 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.061758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:08.190663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:08.198496 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2ae08513-51f4-4c2d-934d-6d0985f47f9e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.150896 Sep 23 04:52:08.199072 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3693/7322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:08 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:09.222389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:09.223044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:09.230150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:09.230691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:09.231132 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:09.232718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:09.233729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:09.234720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:09.284974 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "name": "network-vif-plugged", "status": "completed", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:09.301101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:09.301897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:09.302354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:09.314035 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] Creating event network-vif-plugged:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:52:09.319903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-930fbccd-c9c5-475f-920a-9798ed39e7fd req-65abab11-07a3-449c-811e-cf0f0a210136 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104340 Sep 23 04:52:09.320355 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3630/7323] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:09.372441 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:09.380335 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0d564c81-ffdb-446d-b8b1-bd9a0cb37d99 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.162883 Sep 23 04:52:09.380923 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3694/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:09 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:10.404971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:10.405766 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:10.412036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.412532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.412986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.413708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.414178 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.414626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.547662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.555588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-176eac80-8100-43fc-89cb-bf012d8cc5f3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1358 microversion: 2.1 time: 0.155857 Sep 23 04:52:10.556162 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3631/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:10 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:11.578471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.579082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:11.585992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.586474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.586911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.587604 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.588064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.588493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.716159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:11.724704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38ac5641-3e9e-4536-b80c-4da758d8a327 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1548 microversion: 2.1 time: 0.150045 Sep 23 04:52:11.725222 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3695/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:11.747349 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.747994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:11.755036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.755534 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.755984 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.756686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.757155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.757621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.885138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:11.893498 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9e1ce25f-da19-4b3d-a86b-98caf26fdaad tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1548 microversion: 2.1 time: 0.150010 Sep 23 04:52:11.894085 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3632/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:11.915573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.920322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:11.921122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Searching by: {'deleted': False, 'project_id': '04090d474a69491bbafc38edd0586226'} {{(pid=128724) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:52:11.926394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.927128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.927563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.928287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.928739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.929176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.952381 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.multi_cell_list [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:52:11.978639 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-16b39734-16a2-4321-a6dc-f886b6640d11 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.066798 Sep 23 04:52:11.979161 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3696/7328] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:11.990832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.991653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:11.998196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.998697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.999148 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.999927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:12.000391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:12.000832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:12.134153 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:12.142130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-795cee6a-bd44-47f6-b8d8-53e9c0b4d386 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1548 microversion: 2.1 time: 0.155364 Sep 23 04:52:12.142709 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3633/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:13.645770 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6dc0320-c885-49df-af56-ce1e7d90d20a"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:13.648154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:13.654964 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.655455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.655896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.656589 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.657045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.657504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.910066 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5a0f7ae7-8a9e-421d-85c2-54f548431db5 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268184 Sep 23 04:52:13.910683 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3697/7330] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 23 04:52:13 2022] POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:24.698985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:24.699619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:24.702264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=19 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:24.703546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=70 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:24.709381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.709892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.710347 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.711060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.711537 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.711986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.838942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.847250 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d90d57b-bcb6-4a1b-8248-1ce3b1f6be4c tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1594 microversion: 2.1 time: 0.152173 Sep 23 04:52:24.847844 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3634/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:24 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:26.509754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:26.511049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=19 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:26.511719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:26.516722 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:26.526702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:26.527193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:26.527642 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:26.540665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] Creating event network-changed:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:52:26.546067 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e5eac218-89c6-4479-b66f-a2141a570cec req-4130de2b-b5fe-4927-8aec-50a3c30e3283 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038000 Sep 23 04:52:26.549776 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3698/7332] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:27.521142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-895773501"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:27.521736 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:27.529930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.530566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.531182 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.531996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.532580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.533077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.669253 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.network.security_group_api [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Adding security group 65008bb1-7a63-472f-8b1f-bf043f3cab6c to port fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 Sep 23 04:52:27.985839 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11193070-5dba-47d6-87c3-c59dd01b8e57 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action" status: 202 len: 0 microversion: 2.1 time: 0.469286 Sep 23 04:52:27.986575 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3635/7333] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:27 2022] POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:27.996962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:27.997703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:28.010754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.011259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.011703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.012420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.012885 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.013317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.168115 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.176755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1d0eab8d-d0dc-4136-ba83-ac5b57f921b4 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1759 microversion: 2.1 time: 0.185566 Sep 23 04:52:28.177653 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3699/7334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:27 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:28.561558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:28.571830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.572327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.572777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.585061 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] Creating event network-changed:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:52:28.590292 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-e9054375-c59b-4f1a-aa17-8e6b3751c4b7 req-1effa3f4-bf53-4551-90e4-1ac2193eb2c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033369 Sep 23 04:52:28.590908 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3636/7335] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:16.348731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:16.349402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=8 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:16.394254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:16.396617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.402544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.403025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.403463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.404180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.404632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.405056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.476668 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-523a2b6d-4b94-4252-adb6-1d69ab36b678 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action" status: 202 len: 0 microversion: 2.1 time: 0.132756 Sep 23 04:53:16.477548 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3700/7336] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:53:16 2022] POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:53:16.487292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.488017 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.490206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:16.490880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:16.497268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.497809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.498414 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.499144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.499707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.500162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.727609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.736590 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31a90db3-7f91-4338-94d4-a7e98cd355bb tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1751 microversion: 2.1 time: 0.253940 Sep 23 04:53:16.737270 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3637/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1751 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:17.760266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.760977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.768628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.769111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.769578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.770276 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.770731 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.771164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.931957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.940503 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3f2c8ece-48ae-4809-902c-501733eee4df tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.184608 Sep 23 04:53:17.941073 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3701/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:18.964374 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:18.964998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:18.972637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.973127 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.973609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:18.974311 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.974779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.975220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.117232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.125801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2edc0ce1-a283-4978-bb46-6a090fec6044 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.165295 Sep 23 04:53:19.127150 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3638/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:18 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:20.149507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:20.150047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:20.156876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.157416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.157881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.158579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.159041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.159476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.303308 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.311755 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6d0f47f9-0c4b-4ec3-9151-cc0dda9a6c37 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.166393 Sep 23 04:53:20.312333 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3702/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:20 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:21.336191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:21.336783 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:21.343713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.344216 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.344684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.345934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.346415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.346863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.486748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:21.496424 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d1f9a6e-2fa2-463f-b077-1b6cca90fe93 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.164226 Sep 23 04:53:21.497047 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3639/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:21 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:22.519183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:22.519795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:22.526576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.527057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.527489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.528176 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.528634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.529057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.675591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.683926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-75c61ff1-f2da-4f07-a7a1-ed8cc9ad1579 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.168982 Sep 23 04:53:22.684499 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3703/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:22 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:23.708304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:23.708936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:23.715844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.716342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.716795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.717587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.718013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.718460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.863087 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:23.871470 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0bdd4308-abdf-42c4-938a-90f283a038f6 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.167757 Sep 23 04:53:23.872055 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3640/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:23 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:24.896277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:24.896809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:24.903586 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.904065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.904499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.905184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.905664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.906088 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.049044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.057505 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5aadddc9-49a0-45eb-ab51-2dfc6eae02b8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.166144 Sep 23 04:53:25.058078 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3704/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:24 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:26.081740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.082393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:26.089190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.089738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.090195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.090903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.091378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.091826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.239034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:26.247343 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-345c3efa-dd60-4db8-8f5c-1de4e43f509d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.170053 Sep 23 04:53:26.247934 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3641/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:27.270881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:27.271499 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:27.278691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.279181 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.279626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.280322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.280815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.281222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.422769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:27.431908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33eac533-20b2-45ae-aed9-643bd50b074e tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1756 microversion: 2.1 time: 0.164927 Sep 23 04:53:27.432488 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3705/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:27 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:28.454617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:28.455253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:28.462397 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.462904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.463357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.464081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.464554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.465007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.609681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.618492 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b3d59edc-3427-4a43-9633-25765f12ceb3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1759 microversion: 2.1 time: 0.167824 Sep 23 04:53:28.619073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3642/7347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:28 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:31.922258 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:54:31.922817 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:54:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action (ip 10.222.0.25) !!! Sep 23 04:54:31.923897 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 04:54:31.924031 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:54:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action (ip 10.222.0.25) !!! Sep 23 04:54:31.925009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=12 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:31.925786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:31.931051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-895773501"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:31.931843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:31.942389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:31.942908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:31.943344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:31.944033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:31.944486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:31.944912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:32.072784 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.network.security_group_api [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Removing security group 65008bb1-7a63-472f-8b1f-bf043f3cab6c from port fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 Sep 23 04:54:32.374560 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52535c52-973f-4471-9d1d-6a7870c3fdd3 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action" status: 202 len: 0 microversion: 2.1 time: 0.454499 Sep 23 04:54:32.375315 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3706/7348] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:31 2022] POST /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:32.382179 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 04:54:32.382606 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 04:54:32.384820 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:54:32.384956 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 04:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 04:54:32.386535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=12 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:32.387527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=36 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:32.402403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:32.415033 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:32.415535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:32.416039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:32.429806 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] Creating event network-changed:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:54:32.435915 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-49fd11a7-00f5-4692-86e2-4d6a2396235b req-fecebcf6-dc35-4639-a8ab-06bfc7c3455c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055802 Sep 23 04:54:32.437153 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3643/7349] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:54:33.710178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:33.710685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:33.716520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.717001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.717465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.718166 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.718616 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.719039 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.801564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lazy-loading 'services' on Instance uuid 20a0879a-bcff-4fdc-b244-7344c225fe3a {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:33.875121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cfaf9046-957a-4277-aaaf-8be4460c130b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments/f6dc0320-c885-49df-af56-ce1e7d90d20a" status: 202 len: 0 microversion: 2.1 time: 0.169944 Sep 23 04:54:33.875919 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3707/7350] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:54:33 2022] DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments/f6dc0320-c885-49df-af56-ce1e7d90d20a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:33.886776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:33.889179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:33.895956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.896468 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.897129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.897891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.898373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.898818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.932759 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-64d8d3cc-f965-499d-a590-1a4b8a2d1b80 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051710 Sep 23 04:54:33.933500 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3644/7351] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:33 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:34.455283 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:34.482133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.482718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.483249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:34.495149 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] Creating event network-changed:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:54:34.500250 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-29813fd2-74c1-4b01-adfe-15de120ac347 req-00eab113-ad5f-4657-b27e-0dd30d9530c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049043 Sep 23 04:54:34.500969 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3708/7352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:34.946685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:34.950375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:34.964130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.968564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.969376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:34.970363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.971353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.972809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.017641 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-823e4645-ae8c-41f4-8e3d-731e1017a2e8 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074950 Sep 23 04:54:35.019630 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3645/7353] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:34 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:36.032401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:36.034829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:36.040992 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.041500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.041938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.042626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.043077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.043511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.075007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c2778a31-c16d-44c5-b99c-766f9fd0845b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047690 Sep 23 04:54:36.075796 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3709/7354] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:36 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:37.088057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:37.090315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:37.097742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.098239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.098689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:37.099393 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.099861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.100302 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:37.130185 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d26ab494-f4ee-40b0-bc21-815d4b34b532 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046146 Sep 23 04:54:37.130805 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3646/7355] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:37 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:38.142844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:38.145064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:38.152101 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.152588 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.153024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.153899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.154560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.155014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.190367 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5bc964b4-8e2c-41ad-98fb-43cdd58492ef tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051596 Sep 23 04:54:38.190937 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3710/7356] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:38 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:39.202952 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.205120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.212585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.213088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.213580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.214288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.214763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.215207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.244444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-edd1e77f-f710-43e7-b05c-bdd0390f4a59 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045446 Sep 23 04:54:39.245028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3647/7357] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 23 04:54:39 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:54:39.256378 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.257193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.264024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.264513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.264960 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.265686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.266151 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.266585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.340772 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] HTTP exception thrown: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a is not attached to volume f6dc0320-c885-49df-af56-ce1e7d90d20a Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Request method failure captured: Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: request: DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments/f6dc0320-c885-49df-af56-ce1e7d90d20a HTTP/1.1 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTppOVRiHx_zAuYSgh-967MNN5UCGZwfn6VRacku_4wYFYJNMsupBv1KOLxCeDR2TmH19AIVFSn4d4U2YYG_YwIPtAiX-h-CPFseZSS_afZsGXeVFdIKef79gaFJF1oj2DWOylyQ5rOg4PKW1LS4Vh08URf2LILfYXSR0fT9EeqWJWo Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04090d474a69491bbafc38edd0586226"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04090d474a69491bbafc38edd0586226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7065f524ed594ee7ab55c6f9e4c55c72 Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a is not attached to volume f6dc0320-c885-49df-af56-ce1e7d90d20a Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'server_id': '20a0879a-bcff-4fdc-b244-7344c225fe3a', 'id': 'f6dc0320-c885-49df-af56-ce1e7d90d20a'} Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6dc0320-c885-49df-af56-ce1e7d90d20a. Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a is not attached to volume f6dc0320-c885-49df-af56-ce1e7d90d20a Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:39.342471 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a is not attached to volume f6dc0320-c885-49df-af56-ce1e7d90d20a Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Returning 404 to user: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a is not attached to volume f6dc0320-c885-49df-af56-ce1e7d90d20a {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5e174248-1f55-4311-a1c2-0ab84929931d tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments/f6dc0320-c885-49df-af56-ce1e7d90d20a" status: 404 len: 154 microversion: 2.1 time: 0.092198 Sep 23 04:54:39.348461 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3711/7358] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 23 04:54:39 2022] DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a/os-volume_attachments/f6dc0320-c885-49df-af56-ce1e7d90d20a => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:54:42.591498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:42.592150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:42.599471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.599973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.600426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.601140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.601640 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.602085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.631938 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:54:42.711683 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-67f543aa-2659-4c74-8338-df8003777311 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 204 len: 0 microversion: 2.1 time: 0.124195 Sep 23 04:54:42.712478 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3648/7359] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:54:42 2022] DELETE /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:54:42.721714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:42.722911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:42.731455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.731951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.732396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.733117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.733611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.734053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.866940 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:42.875428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-52653827-02a0-4e62-9562-d1f0fbf3a21b tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1554 microversion: 2.1 time: 0.158363 Sep 23 04:54:42.876066 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3712/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:42 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:43.899281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:43.900007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:43.906854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.907361 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.907821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.908533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.909009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.909488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.036100 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:44.044596 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3630796f-63de-4054-aa3e-4e5e485aaa71 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1554 microversion: 2.1 time: 0.149629 Sep 23 04:54:44.045188 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3649/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:43 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:45.050513 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0879a-bcff-4fdc-b244-7344c225fe3a", "name": "network-vif-deleted", "tag": "fcf1ffdd-b2e0-4bde-9a53-575ead5b6663"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:45.061886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.062371 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.062809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.070438 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:45.071250 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:45.074656 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] Creating event network-vif-deleted:fcf1ffdd-b2e0-4bde-9a53-575ead5b6663 for instance 20a0879a-bcff-4fdc-b244-7344c225fe3a on n-h2-858495-2 Sep 23 04:54:45.079818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.080233 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-62dd0b92-3377-4466-8023-7176f8cd01b1 req-1cb0cfe2-0d14-4d5a-88e5-5ff30fe4b213 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Sep 23 04:54:45.080378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.080898 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3713/7362] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:45.081060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.084723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.085222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.085705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.153653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065f524ed594ee7ab55c6f9e4c55c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04090d474a69491bbafc38edd0586226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.162130 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-76857e11-5b91-4ae9-a4f5-6336f02e7f40 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 200 len: 1343 microversion: 2.1 time: 0.096143 Sep 23 04:54:45.162717 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3650/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:45 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 1343 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:46.187486 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.188191 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] [instance: 20a0879a-bcff-4fdc-b244-7344c225fe3a] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:46.195000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.195494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.195938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.196635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.197092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.197555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.210794 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] HTTP exception thrown: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Request method failure captured: Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a HTTP/1.1 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTppOVRiHx_zAuYSgh-967MNN5UCGZwfn6VRacku_4wYFYJNMsupBv1KOLxCeDR2TmH19AIVFSn4d4U2YYG_YwIPtAiX-h-CPFseZSS_afZsGXeVFdIKef79gaFJF1oj2DWOylyQ5rOg4PKW1LS4Vh08URf2LILfYXSR0fT9EeqWJWo Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04090d474a69491bbafc38edd0586226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04090d474a69491bbafc38edd0586226"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04090d474a69491bbafc38edd0586226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 04090d474a69491bbafc38edd0586226 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720154999 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 7065f524ed594ee7ab55c6f9e4c55c72 Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestMinimumBasicScenario-1720154999-project Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '20a0879a-bcff-4fdc-b244-7344c225fe3a'} Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:46.212406 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Returning 404 to user: Instance 20a0879a-bcff-4fdc-b244-7344c225fe3a could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-573c9665-43af-45fb-8666-4f2eb9bae130 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a" status: 404 len: 111 microversion: 2.1 time: 0.031508 Sep 23 04:54:46.217302 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3714/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:46 2022] GET /compute/v2.1/servers/20a0879a-bcff-4fdc-b244-7344c225fe3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:54:46.222592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0daab667-7d30-4e5c-af68-776fb2fc8531 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] Calling method '.version_select at 0x7f0c8a3b4820>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.246505 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0daab667-7d30-4e5c-af68-776fb2fc8531 tempest-TestMinimumBasicScenario-1720154999 tempest-TestMinimumBasicScenario-1720154999-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1129688778" status: 202 len: 0 microversion: 2.1 time: 0.027668 Sep 23 04:54:46.247089 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3651/7365] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Sep 23 04:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1129688778 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:55.127189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4df7438f-a9dd-466c-855f-a783d3b231fa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: .version_select at 0x7f0c89f75940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1633135936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpJ+6GDAm2O6gKKkBpqaKyru4Dtcr0knbjOlHtE1GLxfdSkwaJK1RBgnlzX7GLWp5a0fNDPRtLKUM2RIqOdfbvRdFTSZ+EkfywCIg9gm+Hg0SxwSWx+QUZz03CfZgH89Q=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:55.143376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4df7438f-a9dd-466c-855f-a783d3b231fa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:54:55.149596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-4df7438f-a9dd-466c-855f-a783d3b231fa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:54:55.177718 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4df7438f-a9dd-466c-855f-a783d3b231fa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.209678 Sep 23 04:54:55.178318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3715/7366] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:54:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:01.220237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-535950602", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "f1d54693-c4db-4178-a1c0-6a01a1b701eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1633135936", "security_groups": [{"name": "tempest-secgroup-smoke-1149852318"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:01.232429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:01.233131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:01.355725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] validate_networks() for [('f1d54693-c4db-4178-a1c0-6a01a1b701eb', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:55:01.792935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:55:01.793410 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:55:01.793912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:55:01.794372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:55:01.794842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:55:01.816691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.817200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.817700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.818460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.818936 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.819385 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.844496 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:55:01.851648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:55:01.866147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:55:01.869004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:55:01.933620 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-917ed231-562f-42ea-a86e-381c670f8ebc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714312 Sep 23 04:55:01.940537 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3652/7367] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:55:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:55:01.947440 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0f1285ae-e48b-4f20-890b-3bcbb00f1b84 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.948774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0f1285ae-e48b-4f20-890b-3bcbb00f1b84 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.955887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:01.957255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:02.036969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0f1285ae-e48b-4f20-890b-3bcbb00f1b84 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.045428 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0f1285ae-e48b-4f20-890b-3bcbb00f1b84 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1266 microversion: 2.1 time: 0.102670 Sep 23 04:55:02.046449 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3716/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:01 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:03.070797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:03.075293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:03.090631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.092191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.092986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.094233 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.094741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.095363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.241857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:03.254234 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-800d9893-ef15-47fa-8cef-cc64499ee4b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1326 microversion: 2.1 time: 0.189755 Sep 23 04:55:03.255304 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3653/7369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:03 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1326 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:04.278997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:04.279596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:04.287777 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.288507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.288966 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.289695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.290155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.290593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.422459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.431003 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8776b406-306e-4ef7-a0c2-2de51a08456b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.155941 Sep 23 04:55:04.431837 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3717/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:04 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:04.805681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17317b8-cde0-45aa-adaf-e56e0c752a69", "tag": "8e073613-196c-4e89-8437-a7a5c35c647c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:04.818124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.818691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.819481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.834666 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] Creating event network-changed:8e073613-196c-4e89-8437-a7a5c35c647c for instance b17317b8-cde0-45aa-adaf-e56e0c752a69 on n-h1-858495-2 Sep 23 04:55:04.840150 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-8a33a3aa-6992-4dd0-b4c0-903a875a1b04 req-4affc6aa-c0f0-45a5-8126-1b1034b99f17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127293 Sep 23 04:55:04.841081 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3654/7371] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:05.454645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.455945 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.465413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.466149 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.466581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.467692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.467899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.468328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.602888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.610647 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6051c8fa-749f-40a5-85d9-1a3322ffc7f4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.159921 Sep 23 04:55:05.611745 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3718/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:06.635700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:06.636426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:06.642604 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.643112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.643601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.644318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.644886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.645271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.786342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:06.794551 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b6aa780-e5c7-46b7-b2c8-b72d6c643053 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.164392 Sep 23 04:55:06.795137 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3655/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:06 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:07.823700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:07.824301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:07.831335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.831854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.832295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.833025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.833514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.834020 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.970631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:07.978831 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4c577fc8-6971-4514-8daf-da8480cf9d1d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.159033 Sep 23 04:55:07.979412 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3719/7374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:07 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:09.002631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:09.003286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:09.011765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:09.012265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:09.012717 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:09.013462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:09.013932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:09.014372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:09.147880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:09.155665 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dd7692d8-fa0d-4f09-8a5d-e982712f3e62 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.157440 Sep 23 04:55:09.156247 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3656/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:08 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:10.179280 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:10.179894 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:10.186192 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.186678 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.187122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.187811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.188271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.188701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.316292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:10.323980 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d43f0bd9-0fa7-47f5-b3c0-fbd1a028679e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.149969 Sep 23 04:55:10.324560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3720/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:10 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:10.929522 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17317b8-cde0-45aa-adaf-e56e0c752a69", "name": "network-vif-plugged", "status": "completed", "tag": "8e073613-196c-4e89-8437-a7a5c35c647c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:10.940187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.940711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.941143 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.953549 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] Creating event network-vif-plugged:8e073613-196c-4e89-8437-a7a5c35c647c for instance b17317b8-cde0-45aa-adaf-e56e0c752a69 on n-h1-858495-2 Sep 23 04:55:10.959157 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-dcee8c07-53b6-4426-805a-66a58175abfb req-8b468daf-0b84-4517-abfb-0ba2839e84d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 Sep 23 04:55:10.959811 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3657/7377] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:11.347462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:11.348069 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:11.354838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:11.355321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:11.355761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:11.356454 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:11.356912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:11.357344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:11.494511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:11.502215 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e9c3bccf-7f79-4a68-9ddb-f993b3a42cd4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1392 microversion: 2.1 time: 0.159132 Sep 23 04:55:11.503379 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3721/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:11 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:12.522818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:12.523642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:12.529094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:12.529879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:12.537234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.537753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.538212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.538917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.539453 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.539905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.668550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:12.676410 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dc9ac747-f689-4d75-844e-4f315504974f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1563 microversion: 2.1 time: 0.154563 Sep 23 04:55:12.676987 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3658/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:12 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:12.699250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:12.699867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:12.701730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:12.708288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.708773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.709213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.709961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.710418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.710910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.844057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:12.852243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c7a3f1a-3344-4333-ba46-288a80cc7bc0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1563 microversion: 2.1 time: 0.156911 Sep 23 04:55:12.852816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3722/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:12 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:14.697270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:14.697947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:14.698674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17317b8-cde0-45aa-adaf-e56e0c752a69", "tag": "8e073613-196c-4e89-8437-a7a5c35c647c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:14.707298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:14.707812 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:14.708264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:14.709186 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:14.709494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:14.709686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:14.709986 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:14.710424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:14.711197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:14.722217 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] Creating event network-changed:8e073613-196c-4e89-8437-a7a5c35c647c for instance b17317b8-cde0-45aa-adaf-e56e0c752a69 on n-h1-858495-2 Sep 23 04:55:14.729458 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-2fa24c73-e4e8-4278-9f50-43a9aab9acdd req-98d0b2c8-e5f5-4ce1-b406-2a75e3ff7643 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033567 Sep 23 04:55:14.730318 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3723/7381] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:14.867471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:14.875539 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2fb83455-7ff9-45f7-81ee-5b981d779e96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1563 microversion: 2.1 time: 0.182504 Sep 23 04:55:14.876391 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3659/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:14 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:38.128621 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=17 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:38.129402 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=38 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:38.133606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:38.135873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:38.142734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.143220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.144384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.145121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.145664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.146106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.199319 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2340edbd-cff2-4966-85b1-711bc9f5004e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action" status: 200 len: 24574 microversion: 2.1 time: 0.072789 Sep 23 04:55:38.200175 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3724/7383] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:38 2022] POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:55:49.247969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:49.248551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:49.250627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:49.251298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=36 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:49.258296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:49.258808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:49.259266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:49.259979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:49.260455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:49.260899 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:49.326164 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7e9347a-b318-4fef-81fe-246f83caec4a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action" status: 202 len: 0 microversion: 2.1 time: 0.082250 Sep 23 04:55:49.326801 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3660/7384] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:49 2022] POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:49.335735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:49.336724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:49.339501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:49.340304 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:49.347597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:49.348090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:49.348867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:49.349691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:49.350152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:49.350584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:49.488778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:49.496507 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-00811d00-f94c-42b8-a099-3c81dc114552 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1687 microversion: 2.1 time: 0.165114 Sep 23 04:55:49.497088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3725/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:49 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:50.522313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:50.523039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:50.529245 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:50.529782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:50.530246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:50.530959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:50.531436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:50.531913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:50.666399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:50.674361 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a21b0a2f-74ae-4f5e-ab57-5d6c08a55cb7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1667 microversion: 2.1 time: 0.157947 Sep 23 04:55:50.674941 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3661/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:50 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:51.768034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:51.770155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:51.780539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.781033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.781509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.782215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.782685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.783118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.832917 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-606f4588-15b3-4907-9bed-e7a7e3ea37c1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action" status: 200 len: 32645 microversion: 2.1 time: 0.069406 Sep 23 04:55:51.833589 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3726/7387] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:51 2022] POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action => generated 32645 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:55:51.845103 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:51.845684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:51.852734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.853268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.853813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.854559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.855209 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.855661 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.925224 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ab283cbc-ec35-4a16-bba6-69a4a5b09dfd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action" status: 202 len: 0 microversion: 2.1 time: 0.083813 Sep 23 04:55:51.929198 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3662/7388] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:51 2022] POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:51.935201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:51.935911 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:51.943254 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.943744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.944190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.944896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.945447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.945811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.079478 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:52.088378 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-38016b06-951d-4d2e-b62b-dba297bf0c0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1674 microversion: 2.1 time: 0.157456 Sep 23 04:55:52.088957 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3727/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:51 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:53.113542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:53.114505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:53.121063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.121592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.122056 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.122780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.123260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.123709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.259142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:53.267043 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cbb57876-b278-4ed0-a7cf-34117a9160c0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1682 microversion: 2.1 time: 0.158627 Sep 23 04:55:53.268197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3663/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:53 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:53.366208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:53.368416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:53.377073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.377591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.378030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.378718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.379170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.379599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.429208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90cad6b8-05ac-4289-8d6f-16da529a4a34 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action" status: 200 len: 38325 microversion: 2.1 time: 0.066692 Sep 23 04:55:53.430188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3728/7391] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:53 2022] POST /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69/action => generated 38325 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:55:54.402331 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:54.402854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:54.405222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17317b8-cde0-45aa-adaf-e56e0c752a69", "tag": "8e073613-196c-4e89-8437-a7a5c35c647c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:54.410451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.410962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.411487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.412243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.412720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.413570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.418878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.419895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.420526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.434034 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] Creating event network-changed:8e073613-196c-4e89-8437-a7a5c35c647c for instance b17317b8-cde0-45aa-adaf-e56e0c752a69 on n-h1-858495-2 Sep 23 04:55:54.439746 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-63477649-6e12-4d7c-bbd9-03bd58b98882 req-18f1004a-e7de-4c45-9004-59ff561b00ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038703 Sep 23 04:55:54.440341 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:54.440754 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3729/7392] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:54.533731 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-18919fca-0fcb-43be-994b-ac430cfecf96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 204 len: 0 microversion: 2.1 time: 0.134397 Sep 23 04:55:54.537594 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3664/7393] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:54 2022] DELETE /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:54.544456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:54.545534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:54.553685 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.554305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.555245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.556193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.556825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.557266 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.697395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:54.705735 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-254c335c-9520-4636-ae7f-c31ef1f074a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1688 microversion: 2.1 time: 0.166318 Sep 23 04:55:54.706529 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3730/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:54 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:55.730565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:55.731283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:55.738110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.738606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.739059 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.739773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.740228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.740667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.875504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:55.883688 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4da70ad4-5a5e-4baf-8cff-18500b62150b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1688 microversion: 2.1 time: 0.157507 Sep 23 04:55:55.884269 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3665/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:55 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:56.523680 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17317b8-cde0-45aa-adaf-e56e0c752a69", "name": "network-vif-deleted", "tag": "8e073613-196c-4e89-8437-a7a5c35c647c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:56.536581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.537131 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.537555 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.548218 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] Creating event network-vif-deleted:8e073613-196c-4e89-8437-a7a5c35c647c for instance b17317b8-cde0-45aa-adaf-e56e0c752a69 on n-h1-858495-2 Sep 23 04:55:56.553076 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-21f4f3d4-abea-412d-8b66-df3c264602b6 req-ed3f0fc4-00a8-4543-8a3b-d90aac4e11c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Sep 23 04:55:56.553728 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3731/7396] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:56.907345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:56.908471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:56.915421 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.916137 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.916597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.917306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.917957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.918560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.952821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.953318 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.953801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.954264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lazy-loading 'fault' on Instance uuid b17317b8-cde0-45aa-adaf-e56e0c752a69 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:56.996751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:57.005913 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1650ceee-935c-42f9-a3a0-d73ea3268d01 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 200 len: 1356 microversion: 2.1 time: 0.101913 Sep 23 04:55:57.006675 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3666/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:56 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:58.035303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:58.036042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: b17317b8-cde0-45aa-adaf-e56e0c752a69] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:58.042323 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:58.042776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:58.043219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:58.043915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:58.044374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:58.044813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:58.058610 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] HTTP exception thrown: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Request method failure captured: Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 HTTP/1.1 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTweO0Cz1aRsHI2y8UM4LvbiSnbxe57foStAkDgsj4z1BSChOe5mf33Y7CVCEn4lR4iI58GcejGnG4YONjJcFba_7Z8aEMcIpCG7FxuUZQHyeAoFfV5VKpmeDo_MU-5DKoGye20v-7T50lDZhks6YimBes-TclRDbO96tqZuzUPqfww Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 733540c92364442c91622c60b9cad842 Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b17317b8-cde0-45aa-adaf-e56e0c752a69'} Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:55:58.060342 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Returning 404 to user: Instance b17317b8-cde0-45aa-adaf-e56e0c752a69 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-242ad2c1-aa44-41ec-bf0f-4b2f7e8ea715 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69" status: 404 len: 111 microversion: 2.1 time: 0.032180 Sep 23 04:55:58.065223 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3732/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:58 2022] GET /compute/v2.1/servers/b17317b8-cde0-45aa-adaf-e56e0c752a69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:56:01.348986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7f89d349-f536-43d7-a936-7a2188f5009c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '.version_select at 0x7f0c8a43d430>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:01.369403 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7f89d349-f536-43d7-a936-7a2188f5009c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1633135936" status: 202 len: 0 microversion: 2.1 time: 0.024360 Sep 23 04:56:01.370004 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3667/7399] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Sep 23 04:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1633135936 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:56:01.396963 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-69ec7b30-3605-4601-b4d9-26551b81a7a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: .version_select at 0x7f0c89e23040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2144257359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+S3HWoRah3Jp10nrOJplQjhFvJHOAFX+qIuPuUlPWb1ZXjmxyMYF7J/XXDYOCQIvu8zmuxeIaCppV8fPsFh+V/7gpjaED6czPUbuGu8sigbCsYHT75Q0Hkt03Lr3Saw=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:01.414413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-69ec7b30-3605-4601-b4d9-26551b81a7a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:56:01.419567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-69ec7b30-3605-4601-b4d9-26551b81a7a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:56:01.443774 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-69ec7b30-3605-4601-b4d9-26551b81a7a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050682 Sep 23 04:56:01.444393 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3733/7400] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:56:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:06.964020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1306193784", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "1152d0c2-5e8c-4ab5-a3fa-05c4420c8a92"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2144257359", "security_groups": [{"name": "tempest-secgroup-smoke-1428630516"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:07.001644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:07.104138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] validate_networks() for [('1152d0c2-5e8c-4ab5-a3fa-05c4420c8a92', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:56:07.616247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:56:07.616683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:56:07.617173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:56:07.618183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:56:07.618675 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:56:07.628460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:07.629019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:07.629513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.630258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:07.630726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:07.631169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.653090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:56:07.658975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:56:07.671549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:56:07.674594 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:56:07.726140 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8f1e8d70-4036-4ecd-8a84-e008f939dc96 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767203 Sep 23 04:56:07.733201 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3668/7401] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:56:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:56:07.739037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bffda5d4-f268-4900-9cca-be46627bee6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:07.739663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bffda5d4-f268-4900-9cca-be46627bee6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:07.809299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bffda5d4-f268-4900-9cca-be46627bee6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:07.816352 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bffda5d4-f268-4900-9cca-be46627bee6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1267 microversion: 2.1 time: 0.082166 Sep 23 04:56:07.817269 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3734/7402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:07 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:08.842967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.843697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:08.851558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:08.852511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:08.853152 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:08.854872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:08.855708 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:08.856474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:08.939612 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:08.952758 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5d1c53b9-f1f0-4050-a9ba-f139abeef3f6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1327 microversion: 2.1 time: 0.117147 Sep 23 04:56:08.955209 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3669/7403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:09.977106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:09.977751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:09.979924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=32 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:09.990249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:09.990672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:09.991125 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:09.991847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:09.992321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:09.992756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:10.205344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:10.213878 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd9d5b6b-a28e-471a-a6b8-720721a766a0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.240898 Sep 23 04:56:10.221504 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3735/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:09 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:10.498540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facb36ae-a839-49a8-863a-c63b440a4065", "tag": "97a8aee9-a6cb-42f7-a136-9f4b2f245039"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:10.512645 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:10.513258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:10.513856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:10.525618 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] Creating event network-changed:97a8aee9-a6cb-42f7-a136-9f4b2f245039 for instance facb36ae-a839-49a8-863a-c63b440a4065 on n-h1-858495-2 Sep 23 04:56:10.531532 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c59d59b2-e914-4895-b11d-8a9f37ee435b req-de1f8212-8fe4-4c53-bccb-fe0792091998 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035909 Sep 23 04:56:10.532858 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3670/7405] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:11.237903 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:11.238520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:11.246324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.246862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.247433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.249082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.249961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.250412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.382311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:11.389945 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1650d6b1-c1a9-4df8-9579-5ba9fddbe99f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.155958 Sep 23 04:56:11.390523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3736/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:11 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:12.415008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:12.415725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:12.422805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.423305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.423754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.424461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.424929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.425389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.581054 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:12.589095 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d46d50da-f592-4185-b2dc-e9ec040b78ca tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.179482 Sep 23 04:56:12.589700 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3671/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:12 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:13.612924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:13.613607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:13.621554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.622042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.622483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:13.623382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.624257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.624695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:13.757797 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:13.765520 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-867b5220-4b70-4267-9aee-401a9c553081 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.157105 Sep 23 04:56:13.766625 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3737/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:13 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:14.789692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:14.790315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:14.797373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.797873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.798324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.799028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.799499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.799945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.930220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:14.938458 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-69b8d865-73b8-4e29-8137-26aaecebe664 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.152480 Sep 23 04:56:14.939037 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3672/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:14 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:15.238666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facb36ae-a839-49a8-863a-c63b440a4065", "name": "network-vif-plugged", "status": "completed", "tag": "97a8aee9-a6cb-42f7-a136-9f4b2f245039"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:15.249542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.250032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.251083 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:15.262877 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] Creating event network-vif-plugged:97a8aee9-a6cb-42f7-a136-9f4b2f245039 for instance facb36ae-a839-49a8-863a-c63b440a4065 on n-h1-858495-2 Sep 23 04:56:15.267986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-994f1009-4a94-4ba2-a1a1-c6ee1207b661 req-c88ccf91-c989-4fa1-8fc9-699cd83fa76c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 Sep 23 04:56:15.268599 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3738/7410] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:15.961990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:15.962758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:15.970164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.970662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.971117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:15.971823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.972299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.972781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.105249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:16.113269 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9b87b3b9-2283-4c2e-9d0c-a3798f46cffa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1393 microversion: 2.1 time: 0.155197 Sep 23 04:56:16.113873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3673/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:15 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:17.137524 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:17.138231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:17.144845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.145411 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.145861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.146554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.147013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.147445 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.285359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:17.292998 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-da60d753-cee9-4ab8-8e29-8345d03fea90 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1564 microversion: 2.1 time: 0.160670 Sep 23 04:56:17.293599 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3739/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:17 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:17.315701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:17.316337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:17.323262 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.323763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.324221 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.324924 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.325429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.325904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.454665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:17.462728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8680be19-6871-456b-a5bc-7a364dd62612 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1564 microversion: 2.1 time: 0.151351 Sep 23 04:56:17.463329 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3674/7413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:17 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:19.029707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:19.030526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:19.032569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facb36ae-a839-49a8-863a-c63b440a4065", "tag": "97a8aee9-a6cb-42f7-a136-9f4b2f245039"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:19.033253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:19.037971 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:19.038804 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:19.040567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.041070 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.041635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.042398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.042915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.043552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.047848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.048671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.049202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.063574 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] Creating event network-changed:97a8aee9-a6cb-42f7-a136-9f4b2f245039 for instance facb36ae-a839-49a8-863a-c63b440a4065 on n-h1-858495-2 Sep 23 04:56:19.068985 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-b71a4ecd-6a81-4647-8604-5872480d6122 req-72310ebc-a2af-4076-99c0-5ee870b8e7c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040920 Sep 23 04:56:19.069656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3675/7414] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:19.275477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:19.284112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5ba74f0-e4a3-4dca-8133-159a8e7450ba tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1564 microversion: 2.1 time: 0.258522 Sep 23 04:56:19.284806 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3740/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:19 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:42.587651 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:42.588541 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=36 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:42.593078 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:42.595394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:42.602819 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.603317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.603770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.604471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.604939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.605401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.659408 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44ee6930-932c-4579-a2ee-7cf9b3542eb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action" status: 200 len: 24571 microversion: 2.1 time: 0.073366 Sep 23 04:56:42.660045 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3676/7416] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:56:42 2022] POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:56:53.689575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:53.691833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:53.694667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:53.695383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=32 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:53.701127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.701638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.702146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.702848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.703305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.703736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.778717 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66e60475-71fe-4e6f-bc95-b736ae6282c2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action" status: 202 len: 0 microversion: 2.1 time: 0.092770 Sep 23 04:56:53.779266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3741/7417] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:56:53 2022] POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:56:53.788064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:53.788778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:53.792648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:53.793298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:53.797876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.798370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.798823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.799549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.800000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.800444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.119904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:54.128036 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-bc3df777-c625-4606-b359-88952afc1aec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1675 microversion: 2.1 time: 0.344090 Sep 23 04:56:54.128879 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3677/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:53 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1675 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:55.154236 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:55.154962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:55.161018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.162135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.162583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.163270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.163724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.164241 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.396156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:55.403866 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd96e6a9-d050-4b0d-973a-2469e15b8c44 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.255544 Sep 23 04:56:55.404437 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3742/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:55 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:56.429140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:56.430008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:56.438088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.438585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.439040 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.439744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.440214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.440658 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.569591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:56.577566 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-115c15a4-0ebc-4fff-8f91-c14d90c30d3a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.153855 Sep 23 04:56:56.578144 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3678/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:56 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:57.600026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:57.600690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:57.607813 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.608358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.608799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.609542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.609999 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.610452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.738448 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:57.746175 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6cb2db35-0c88-46bc-8de9-8630fc034eec tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.150059 Sep 23 04:56:57.746757 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3743/7421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:57 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:58.769247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:58.769955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:58.777452 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:58.777957 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:58.778409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:58.779114 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:58.779585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:58.780029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:58.911814 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:58.919631 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-264dd1e3-72b1-499c-95bc-5ecaa3f02166 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.154367 Sep 23 04:56:58.920210 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3679/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:58 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:59.943500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:59.944118 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:59.950887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.951367 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.951800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.952485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.952936 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.953376 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:00.082535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:00.090795 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5ebaf2d2-2a17-4633-ad25-994c948c54ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.151287 Sep 23 04:57:00.091372 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3744/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:59 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:01.115634 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:01.116160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:01.123055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.123548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.124000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.124701 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.125170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.125643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.257181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:01.265198 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2261c06-8284-4cd5-9461-f2d47b1f6321 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.154028 Sep 23 04:57:01.265849 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3680/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:01 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:02.288221 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:02.288835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:02.295335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:02.295884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:02.296333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:02.297025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:02.297515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:02.297946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:02.431517 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:02.439317 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cdbcfb52-11de-4c16-8457-82f6870c4fb9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.155197 Sep 23 04:57:02.439883 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3745/7425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:02 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:03.463691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:03.464399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:03.471314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:03.471810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:03.472261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:03.472967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:03.473467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:03.473928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:03.602686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:03.610509 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-43b72a8c-6996-47db-97cb-6ac0da946a6c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.150833 Sep 23 04:57:03.611090 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3681/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:03 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:04.632928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:04.633576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:04.640507 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:04.640994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:04.641461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:04.642154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:04.642612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:04.643045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:04.775339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:04.783000 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-18d0af30-e61c-4378-9a11-66adda468062 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.154014 Sep 23 04:57:04.783576 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3746/7427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:04 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:05.808317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:05.808962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:05.816029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:05.816531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:05.816989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:05.817740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:05.818214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:05.818662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:05.950130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:05.957867 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7fadea81-3111-43ce-a74f-dece7a5407ff tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.153504 Sep 23 04:57:05.958459 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3682/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:05 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:06.982387 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:06.983025 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:06.990352 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.990833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.991267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:06.991962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.992413 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.992836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:07.128165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:07.136491 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6a601b18-4b58-4210-9385-9f289b499485 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.158647 Sep 23 04:57:07.137071 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3747/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:06 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:08.159525 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:08.160147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:08.167504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.168009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.168633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.169380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.169930 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.170367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.300543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:08.308777 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9004f44-567f-411f-958d-f5d10dacd702 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.153211 Sep 23 04:57:08.309387 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3683/7430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:08 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:09.331857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:09.332977 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:09.340091 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:09.340573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:09.341015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:09.341747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:09.342277 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:09.342706 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:09.478052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:09.486020 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-359db1a3-0925-4b85-8eb3-9ff0324d3ad4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1680 microversion: 2.1 time: 0.158276 Sep 23 04:57:09.486593 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3748/7431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:09 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:10.509516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:10.510154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:10.517063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:10.517613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:10.518079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:10.518792 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:10.519270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:10.519723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:10.647664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:10.656636 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fe92c70-a08c-4420-bcf7-c154aba84306 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1683 microversion: 2.1 time: 0.151103 Sep 23 04:57:10.657219 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3684/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:10 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:36.850875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:36.853052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:36.855298 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=16 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:36.855958 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:36.862741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.863222 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.863660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:36.864348 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.864947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.865395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:36.920919 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d73e46f9-327c-4e4e-8472-4020d0972447 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action" status: 200 len: 69119 microversion: 2.1 time: 0.074572 Sep 23 04:57:36.921600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3749/7433] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:36 2022] POST /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065/action => generated 69119 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:57:44.007834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:44.008370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:44.011547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facb36ae-a839-49a8-863a-c63b440a4065", "tag": "97a8aee9-a6cb-42f7-a136-9f4b2f245039"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:44.012003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=16 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:44.012644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=48 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:44.017195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.017744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.018430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.020105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.020818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.021391 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.027065 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.027563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.028004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.039765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] Creating event network-changed:97a8aee9-a6cb-42f7-a136-9f4b2f245039 for instance facb36ae-a839-49a8-863a-c63b440a4065 on n-h1-858495-2 Sep 23 04:57:44.045766 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1d4c4dda-9420-4cae-a8f6-dfc8c7693e85 req-66219ace-060b-4399-a472-337646a1ec93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038873 Sep 23 04:57:44.046602 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3750/7434] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:44.049287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:57:44.135015 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-29fc6669-949d-4479-99e5-0464ce51439b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 204 len: 0 microversion: 2.1 time: 0.131487 Sep 23 04:57:44.138829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3685/7435] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 04:57:44 2022] DELETE /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:57:44.147626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:44.148350 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:44.155140 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.155639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.156904 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.158009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.158477 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.159106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.634273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:44.642205 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-647b8b70-bad8-49de-b8a1-479362515dfc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1689 microversion: 2.1 time: 0.500850 Sep 23 04:57:44.642786 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3751/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:44 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1689 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:45.667627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:45.668289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:45.676348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.676863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.677606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.678337 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.678823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.679274 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.825282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:45.834712 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-74baaca8-4167-4608-b4bc-cadd7bf879de tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 200 len: 1689 microversion: 2.1 time: 0.171479 Sep 23 04:57:45.835311 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3686/7437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:45 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:46.118924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facb36ae-a839-49a8-863a-c63b440a4065", "name": "network-vif-deleted", "tag": "97a8aee9-a6cb-42f7-a136-9f4b2f245039"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:46.129509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:46.130000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:46.130438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.141541 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] Creating event network-vif-deleted:97a8aee9-a6cb-42f7-a136-9f4b2f245039 for instance facb36ae-a839-49a8-863a-c63b440a4065 on n-h1-858495-2 Sep 23 04:57:46.146925 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b0a479db-2131-4e83-b79b-45e6ea67c767 req-c152c9a4-5b6d-4e18-ae55-988df2c5466d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032510 Sep 23 04:57:46.147523 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3752/7438] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:46.859565 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:46.860200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: facb36ae-a839-49a8-863a-c63b440a4065] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:46.866748 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:46.867265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:46.867727 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.868444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:46.868922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:46.869394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.883312 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] HTTP exception thrown: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Request method failure captured: Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 HTTP/1.1 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTweO0Cz1aRsHI2y8UM4LvbiSnbxe57foStAkDgsj4z1BSChOe5mf33Y7CVCEn4lR4iI58GcejGnG4YONjJcFba_7Z8aEMcIpCG7FxuUZQHyeAoFfV5VKpmeDo_MU-5DKoGye20v-7T50lDZhks6YimBes-TclRDbO96tqZuzUPqfww Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 733540c92364442c91622c60b9cad842 Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'facb36ae-a839-49a8-863a-c63b440a4065'} Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:57:46.885020 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Returning 404 to user: Instance facb36ae-a839-49a8-863a-c63b440a4065 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8b97b24e-e876-49ef-9063-711ec1712baa tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065" status: 404 len: 111 microversion: 2.1 time: 0.031316 Sep 23 04:57:46.889956 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3687/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:46 2022] GET /compute/v2.1/servers/facb36ae-a839-49a8-863a-c63b440a4065 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:57:49.936033 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-00ea5d53-21c5-4a7c-93e4-093a4d801862 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '.version_select at 0x7f0c89e181f0>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:49.957343 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-00ea5d53-21c5-4a7c-93e4-093a4d801862 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2144257359" status: 202 len: 0 microversion: 2.1 time: 0.026596 Sep 23 04:57:49.957855 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3753/7440] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Sep 23 04:57:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2144257359 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:57:49.983071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e8d13424-7f49-446d-bd69-63911951d82c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: .version_select at 0x7f0c8aa2eca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-565232998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX8mWV5gt94UW5WIe712I0h1nNjDV2AFO/seOPnwk/ketPdXTMkv7AEABWtVME9fzvQG3ZyhryAFMJYtm/iAvHVatmKtpLayHkSwVBs9LnPqPTAf4H194pfWRryrJtreg=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:50.000573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e8d13424-7f49-446d-bd69-63911951d82c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:57:50.005779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-e8d13424-7f49-446d-bd69-63911951d82c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:57:50.030295 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e8d13424-7f49-446d-bd69-63911951d82c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051055 Sep 23 04:57:50.030905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3688/7441] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 04:57:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:55.575622 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:57:55.576106 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 04:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 23 04:57:55.581906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-163627218", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "7ae3f7be-325c-45d9-8c91-e4e3199d8818"}], "key_name": "tempest-TestNetworkAdvancedServerOps-565232998", "security_groups": [{"name": "tempest-secgroup-smoke-862133589"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:55.694878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] validate_networks() for [('7ae3f7be-325c-45d9-8c91-e4e3199d8818', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:57:56.134942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:56.177965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:57:56.178393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:57:56.179016 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:57:56.179438 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:57:56.180093 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:57:56.190064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:56.190959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:56.191404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:56.192142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:56.192806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:56.193243 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:56.211398 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:57:56.216704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:57:56.230838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:57:56.233274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:57:56.285562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-80dcb652-e529-4ece-80f2-47fd17a3d58f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711623 Sep 23 04:57:56.286124 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3754/7442] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 04:57:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:57:56.299643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2384a5e-f512-4f68-8be0-4c9e34251ab9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:56.300786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2384a5e-f512-4f68-8be0-4c9e34251ab9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:56.371650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2384a5e-f512-4f68-8be0-4c9e34251ab9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:56.397609 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2384a5e-f512-4f68-8be0-4c9e34251ab9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1265 microversion: 2.1 time: 0.090071 Sep 23 04:57:56.399364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3689/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:56 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:57.427776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:57.428518 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:57.447213 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:57.447766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:57.449543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:57.451811 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:57.452877 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:57.453896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:57.553159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:57.561893 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-156d22b3-0900-4881-8e9f-343d6481323e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1335 microversion: 2.1 time: 0.144099 Sep 23 04:57:57.562816 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3755/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:57 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:58.588489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:58.589264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:58.591647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:58.602380 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.603149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.603384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.604124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.604664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.605068 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.751892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:58.760852 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2ca11e98-81dd-4cbe-b36a-5afb4ba077d4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.176930 Sep 23 04:57:58.767643 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3690/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:58 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:58.960931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:58.981108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.981871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.982606 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.999928 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] Creating event network-changed:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h1-858495-2 Sep 23 04:57:59.006870 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-d7c285da-5a57-4fc0-983b-e2b55c9e0827 req-f9d480c1-a8eb-470b-bf9a-86791b56a487 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050673 Sep 23 04:57:59.008219 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3756/7446] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:59.784677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:59.785330 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:59.792616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:59.793112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:59.793593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:59.794299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:59.794768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:59.795212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:59.927975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:59.935870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1f693ba-b9dc-4d01-a3ae-c86dfe7e19e8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.155131 Sep 23 04:57:59.936443 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3691/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:59 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:00.961133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:00.961864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:00.967985 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:00.968470 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:00.968906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:00.969622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:00.970079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:00.970509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:01.103455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:01.111077 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c6a1187-453d-49de-9f5c-9004e1cc6369 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.155645 Sep 23 04:58:01.111656 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3757/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:00 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:02.134664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:02.135422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:02.142382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:02.142883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:02.143335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:02.144683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:02.145155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:02.145628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:02.278646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:02.286467 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a120ab56-733e-4071-9564-39cdd82eae0f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.155765 Sep 23 04:58:02.287042 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3692/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:02 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:03.309922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:03.310545 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:03.317406 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:03.317899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:03.318342 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:03.319049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:03.319509 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:03.319941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:03.452474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:03.461176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-bb963c28-4170-4180-b53c-a1625a760fb8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.155122 Sep 23 04:58:03.461813 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3758/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:03 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:03.765271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "name": "network-vif-plugged", "status": "completed", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:03.777063 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:03.777593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:03.778048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:03.791257 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] Creating event network-vif-plugged:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h1-858495-2 Sep 23 04:58:03.796497 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-3ce132cd-0168-482f-b390-a61075da9243 req-f4816c4d-d5f3-4cda-b89f-699e3d2b85d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105070 Sep 23 04:58:03.797110 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3693/7451] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:04.484198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:04.484853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:04.492363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:04.492850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:04.493293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:04.494017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:04.494489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:04.494923 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:04.626982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:04.634552 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-faece5eb-471c-47f1-aaa6-50329cca2846 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1390 microversion: 2.1 time: 0.154326 Sep 23 04:58:04.635130 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3759/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:04 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:05.658418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:05.659134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:05.666184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:05.666679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:05.667131 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:05.667832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:05.668303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:05.668742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:05.799566 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:05.808365 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cf418aae-ded6-4824-a662-fadcef8fa7b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1563 microversion: 2.1 time: 0.154230 Sep 23 04:58:05.809094 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3694/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:05 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:05.831117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:05.831736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:05.838809 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:05.839295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:05.839735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:05.840424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:05.840882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:05.841311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:05.972832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:05.980632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-184f58ec-a3f3-4855-91d0-96f5c1f3769b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1563 microversion: 2.1 time: 0.153384 Sep 23 04:58:05.981216 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3760/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:05 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:07.844189 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:07.845912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:07.847487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:07.849077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:07.851425 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:07.872464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:07.873021 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:07.873451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:07.874780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:07.875456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:07.876827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:07.928136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:07.936662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:07.938941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:07.939671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:07.940107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:07.953037 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] Creating event network-changed:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h1-858495-2 Sep 23 04:58:07.960335 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-b7881e4f-22a9-4bbb-ab49-2276cc1617c8 req-2c58e7a3-5756-47ed-b39c-9dad93896092 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120442 Sep 23 04:58:07.960950 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3761/7455] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:58:08.076841 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:08.093585 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7424b84e-d0ba-4f52-892a-2f13523c4ade tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1563 microversion: 2.1 time: 0.258072 Sep 23 04:58:08.114316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3695/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:07 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1563 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:31.349701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=36 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:31.354179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:31.356431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:31.363366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.363847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.364286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.364975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.365481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.365902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.427208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-42813dae-5ba6-497e-875e-0efbd7a4658d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action" status: 200 len: 24572 microversion: 2.1 time: 0.079026 Sep 23 04:58:31.427869 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3762/7457] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:58:31 2022] POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:58:42.443120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:42.445477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:42.447554 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:42.448284 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=32 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:42.454463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.454967 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.456034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.456721 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.457195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.457672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.543047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:42.549199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Old instance type m1.heat2, new instance type m1.heat {{(pid=128723) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:58:42.556161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:58:42.556598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:58:42.557090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:58:42.557550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:58:42.557985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:58:42.620416 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2bb20892-b961-4063-a483-384c305126e7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action" status: 202 len: 0 microversion: 2.1 time: 0.182107 Sep 23 04:58:42.621084 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3696/7458] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:58:42 2022] POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:58:42.630305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:42.631014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:42.633874 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:42.634697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:42.640651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.641139 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.641613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.642351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.643407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.643838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.784055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:42.793028 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9b34a91e-cb4d-4b09-8e22-be287e0b04c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1691 microversion: 2.1 time: 0.167424 Sep 23 04:58:42.793652 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3763/7459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:42 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:43.818962 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:43.819607 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:43.828371 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:43.828891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:43.829840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:43.830704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:43.831177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:43.831623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:43.974440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:43.982555 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fec3c62e-c3e4-4d3e-83d6-54ff92461d7b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1691 microversion: 2.1 time: 0.167892 Sep 23 04:58:43.983132 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3697/7460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:43 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:45.012247 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:45.012819 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:45.022052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.022557 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.022997 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.023715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.024175 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.024698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.165552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:45.173410 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-72be6635-7d46-4a07-b853-6ee0e84ccad3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1691 microversion: 2.1 time: 0.170631 Sep 23 04:58:45.173987 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3764/7461] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:45 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:46.198038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:46.198690 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:46.204824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:46.205325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:46.205911 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:46.207167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:46.207648 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:46.208098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:46.335875 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:46.343755 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1fa22dfc-e30c-437c-8b29-eab10cb87252 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.149993 Sep 23 04:58:46.344342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3698/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:46 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:47.367407 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:47.368040 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:47.374511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.374979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.375416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:47.376103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.376554 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.376982 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:47.509708 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:47.517342 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-886482b8-59f7-4fda-849d-de408085d884 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.153970 Sep 23 04:58:47.517945 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3765/7463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:47 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:48.541239 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:48.541912 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:48.548699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:48.549200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:48.550340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:48.551308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:48.551787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:48.552236 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:48.681568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:48.689414 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d86ac65d-8b92-4ee0-a2a4-2146a09be987 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.152048 Sep 23 04:58:48.689998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3699/7464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:48 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:49.712938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:49.713592 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:49.720416 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.720843 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.721285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.722002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.722462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.722895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.850270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:49.858006 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7702f5c-2765-4add-9884-f6974090c03a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.149474 Sep 23 04:58:49.858581 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3766/7465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:49 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:50.882354 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:50.883010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:50.890028 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:50.890527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:50.890986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:50.891689 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:50.892162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:50.892609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:51.024372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:51.033089 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-dcbe3f5c-7706-4690-bd7c-f3331b49e614 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.154908 Sep 23 04:58:51.034117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3700/7466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:50 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:52.056401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:52.057019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:52.063891 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.064312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.064778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:52.065625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.066082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.066587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:52.208774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:52.216607 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2823ae9-ae38-419b-8163-b58bf73db5f8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.164135 Sep 23 04:58:52.217183 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3767/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:52 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:53.242659 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:53.243293 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:53.250366 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:53.250861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:53.251313 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:53.252014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:53.252994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:53.253467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:53.387843 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:53.395667 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1eddc58-cd9d-405a-b199-f80430f10767 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.156951 Sep 23 04:58:53.396279 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3701/7468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:53 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:54.418941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:54.419558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:54.426748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.427230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.427667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.428358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.428817 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.429244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.563815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:54.571608 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a35e6ce9-7ac2-453e-bd9b-ffd6078aebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.156645 Sep 23 04:58:54.572193 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3768/7469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:54 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:55.594904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:55.595461 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:55.603050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.603532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.603985 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:55.604691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.605164 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.605644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:55.741023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:55.749737 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-790f0948-8125-4235-8d24-134777a863e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.158748 Sep 23 04:58:55.750364 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3702/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:55 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:56.773496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:56.774067 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:56.780922 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:56.781433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:56.781872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:56.782561 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:56.783046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:56.783981 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:56.912107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:56.919922 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7372e03b-b3b3-43d4-a839-814456cea745 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.150464 Sep 23 04:58:56.920502 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3769/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:56 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:57.944187 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:57.944816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:57.951752 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:57.952253 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:57.952705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:57.953441 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:57.953923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:57.954369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:58.084691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:58.092535 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-44be706f-a1ce-44ca-959d-46f214663e86 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.152247 Sep 23 04:58:58.093117 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3703/7472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:57 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:59.117230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:59.117800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:59.124646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.125134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.125609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.126309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.126767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.127195 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.259694 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:59.267577 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e8b3b180-2487-4f77-b446-1a563033d9e3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.154233 Sep 23 04:58:59.268663 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3770/7473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:59 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:00.291384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:00.292042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:00.300154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.300740 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.301592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.302504 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.303035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.303539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.471387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:00.479415 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40a05add-3bae-49af-9dd6-16cfd47160a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.192080 Sep 23 04:59:00.479992 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3704/7474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:00 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:01.503576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:01.504190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:01.511263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:01.511751 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:01.512211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:01.512909 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:01.513384 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:01.513846 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:01.647112 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:01.654745 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c5c3b53c-adf5-4046-ac1c-fd0aa7afd866 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1696 microversion: 2.1 time: 0.155167 Sep 23 04:59:01.655313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3771/7475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:01 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:02.507720 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "name": "network-vif-unplugged", "status": "completed", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:02.518517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:02.519019 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:02.519986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:02.532012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Creating event network-vif-unplugged:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h2-858495-2 Sep 23 04:59:02.538024 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:59:02.549405 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-31da3a07-0ae0-4cb5-aec4-f2e65fc82d71 req-fcb4a26b-8eca-4df0-b48c-d6efddf6f4fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045333 Sep 23 04:59:02.550060 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3705/7476] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:02.679282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:02.679976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:02.686762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:02.687257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:02.687730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:02.688433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:02.688902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:02.689331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:02.882773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:02.890471 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-933ca0f2-f5fd-4fcc-a35e-03d8a34f8914 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1695 microversion: 2.1 time: 0.215408 Sep 23 04:59:02.891188 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3772/7477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:02 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:03.917074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:03.917743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:03.923931 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:03.924439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:03.924897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:03.925627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:03.926540 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:03.926903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:04.064698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:04.072608 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b91a0c30-52d9-479e-baef-e6e84c7eef9f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1693 microversion: 2.1 time: 0.160828 Sep 23 04:59:04.073192 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3706/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:03 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:04.568634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:04.578839 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:04.579319 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:04.579749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:04.591102 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Creating event network-changed:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h2-858495-2 Sep 23 04:59:04.596231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858495-2', 'n-h1-858495-2'} {{(pid=128724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:59:04.607135 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fc7d1ba2-95b3-4369-a384-ed53c663ba8e req-bc2ea72a-c56d-4cec-b037-84940677908d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042862 Sep 23 04:59:04.607795 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3773/7479] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:05.096624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:05.097951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:05.104913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.105539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.106007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.106758 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.107240 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.107700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.237893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:05.245755 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a7d458e0-152c-4fc5-b083-c5a16d1d43d0 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1693 microversion: 2.1 time: 0.153082 Sep 23 04:59:05.246351 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3707/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:05 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:06.271882 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:06.272580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:06.278847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:06.279331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:06.279767 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:06.280456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:06.280905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:06.281330 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:06.482699 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:06.491223 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2614ebda-3ca1-4168-ac3e-f5f7c6aaebf8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1693 microversion: 2.1 time: 0.224555 Sep 23 04:59:06.491805 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3774/7481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:06 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:07.514579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:07.515207 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:07.522125 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.522624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.523075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.523778 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.524249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.524694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.655334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:07.663209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ff4ae25e-7bbc-43f7-8995-e32be47a24d3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1690 microversion: 2.1 time: 0.152514 Sep 23 04:59:07.663805 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3708/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:07 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:07.686313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:07.686856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:07.694271 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.694748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.695183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.695867 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.696316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.696738 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.023700 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-baff1ad9-4c79-407d-8aa2-dda8029d33ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action" status: 204 len: 0 microversion: 2.1 time: 0.340494 Sep 23 04:59:08.024869 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3775/7483] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:59:07 2022] POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:59:08.036850 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:08.038140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:08.046858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.047667 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.048360 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.049159 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.049742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.050279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.507364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:08.515244 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e505f96e-7854-4bb2-9632-56769a2755cd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1690 microversion: 2.1 time: 0.484205 Sep 23 04:59:08.516161 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3709/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:08 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1690 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:08.538853 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:08.539565 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:08.545792 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.546287 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.546732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.547433 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.547898 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.548332 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.684081 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:08.693507 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c5b33dd-b1ba-4594-91b4-3ce4130cf3a8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1690 microversion: 2.1 time: 0.159352 Sep 23 04:59:08.694143 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3776/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:08 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:09.717422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:09.718067 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:09.724823 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:09.725325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:09.726375 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:09.727121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:09.727601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:09.728047 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:09.860219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:09.867940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-59b88f2e-515a-40ea-9ec8-e434b32cfb02 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1682 microversion: 2.1 time: 0.154529 Sep 23 04:59:09.868503 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3710/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:09 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:11.115750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "name": "network-vif-plugged", "status": "completed", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:11.127596 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:11.128084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:11.128523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:11.139114 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] Creating event network-vif-plugged:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h2-858495-2 Sep 23 04:59:11.144176 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-e3751ff8-ee6c-461c-b72c-3acfdaa54288 req-2a39a254-a7d3-43c6-8624-530f13edb5e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032806 Sep 23 04:59:11.145468 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3777/7487] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:40.091363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:40.093621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:40.096773 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=34 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:40.097626 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:40.104908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.105464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.106303 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.107212 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.107692 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.108149 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.181863 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-df01f36d-b3c4-49e0-b418-1774f876e151 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action" status: 200 len: 24572 microversion: 2.1 time: 0.094271 Sep 23 04:59:40.182517 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3711/7488] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 04:59:40 2022] POST /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10/action => generated 24572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:00:04.063014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=30 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:04.065029 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:04.066403 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 23 05:00:04.071559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:04.072520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:04.073190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:04.078460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:04.079579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:04.082289 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:04.082987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:04.083432 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.084492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:04.085126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:04.085590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.085782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:04.086350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:04.086810 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.099884 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] Creating event network-changed:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h2-858495-2 Sep 23 05:00:04.105298 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-621237cc-34c0-4482-969e-3d3207fd665d req-8317e5a6-eae3-4580-b583-7b026862f34c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042103 Sep 23 05:00:04.106051 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3712/7489] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:04.113296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:04.201216 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-912619fe-d82b-491f-8de0-bd94c52c4042 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 204 len: 0 microversion: 2.1 time: 0.140228 Sep 23 05:00:04.202364 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3778/7490] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:04 2022] DELETE /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:00:04.215551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:04.216288 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:04.223283 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:04.223801 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:04.224268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.225006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:04.225519 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:04.225977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.710145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:04.718736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6f9d4bc-841f-4ad3-81fd-001605685824 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1688 microversion: 2.1 time: 0.511242 Sep 23 05:00:04.719316 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3713/7491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:04 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1688 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:05.743047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:05.744333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:05.750715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:05.751215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:05.751669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:05.752942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:05.753437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:05.753908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:05.893469 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:05.914601 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dd1d407d-6154-4ec2-94e2-d12f810eb44c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 200 len: 1688 microversion: 2.1 time: 0.175619 Sep 23 05:00:05.915590 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3779/7492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:05 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:06.292223 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10", "name": "network-vif-deleted", "tag": "a76071fe-9547-4612-9062-98fe7c3e1eb2"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:06.305199 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.305953 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.306762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.321588 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] Creating event network-vif-deleted:a76071fe-9547-4612-9062-98fe7c3e1eb2 for instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 on n-h2-858495-2 Sep 23 05:00:06.326870 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-9f8e73fe-8439-4799-9176-4626d999a519 req-0ddd1f7c-1040-4deb-997d-46253d8c2cb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093910 Sep 23 05:00:06.327496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3714/7493] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:06.940855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:06.941535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:06.948334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.948829 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.949274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.950010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.950473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.950906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.964572 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] HTTP exception thrown: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Request method failure captured: Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 HTTP/1.1 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLTweO0Cz1aRsHI2y8UM4LvbiSnbxe57foStAkDgsj4z1BSChOe5mf33Y7CVCEn4lR4iI58GcejGnG4YONjJcFba_7Z8aEMcIpCG7FxuUZQHyeAoFfV5VKpmeDo_MU-5DKoGye20v-7T50lDZhks6YimBes-TclRDbO96tqZuzUPqfww Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 733540c92364442c91622c60b9cad842 Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10'} Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:00:06.966231 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Returning 404 to user: Instance f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-eae193ea-cd73-4de3-97e6-f39b446de671 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10" status: 404 len: 111 microversion: 2.1 time: 0.030692 Sep 23 05:00:06.971540 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3780/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:06 2022] GET /compute/v2.1/servers/f09e70c2-dd1c-458e-87a2-0bb7ebbfdf10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:10.338691 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-eafc038f-0fea-4eb2-b8c7-542682d852b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '.version_select at 0x7f0c8836ea60>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:10.358970 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-eafc038f-0fea-4eb2-b8c7-542682d852b3 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-565232998" status: 202 len: 0 microversion: 2.1 time: 0.025312 Sep 23 05:00:10.363277 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3715/7495] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Sep 23 05:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-565232998 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:10.383164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-82e00f52-0273-47ba-bdf7-447abc390c26 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: .version_select at 0x7f0c89e1e670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1352659206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWX31eDwLF2+SU+U4tjn1gDZ/8396FN8d4fYVoHnegSsUWBlTciT82ZG4iz+DqJjl0rvilrh8UzIEsp8VbjNYSaT/txFGq8LrMxAfZmIazj8CdTGTGIJ7o9Ixt0/t1/WA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:10.400830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-82e00f52-0273-47ba-bdf7-447abc390c26 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:00:10.405951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-82e00f52-0273-47ba-bdf7-447abc390c26 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:00:10.434672 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-82e00f52-0273-47ba-bdf7-447abc390c26 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055447 Sep 23 05:00:10.435275 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3781/7496] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 05:00:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:15.744289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1772327570", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "0a372f77-1a8a-4c4b-a2c4-87caa12037a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1352659206", "security_groups": [{"name": "tempest-secgroup-smoke-1123749695"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:15.861623 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] validate_networks() for [('0a372f77-1a8a-4c4b-a2c4-87caa12037a5', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:00:16.277466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:00:16.278105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:00:16.278613 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:00:16.279083 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:00:16.279549 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:00:16.288961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:16.289515 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:16.289975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:16.290726 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:16.291203 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:16.291647 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:16.309817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:00:16.315959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:00:16.329325 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:00:16.332416 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:00:16.391008 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d43805f1-ccb0-4ab1-828b-6ece6a594a68 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651563 Sep 23 05:00:16.392259 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3716/7497] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:00:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:00:16.408941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ff2249c-bdf9-4954-971f-9a3556bb8329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:16.410135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ff2249c-bdf9-4954-971f-9a3556bb8329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:16.484017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ff2249c-bdf9-4954-971f-9a3556bb8329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:16.491770 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ff2249c-bdf9-4954-971f-9a3556bb8329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1267 microversion: 2.1 time: 0.087236 Sep 23 05:00:16.492349 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3782/7498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:16 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:17.516465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:17.518251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:17.535225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:17.536536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:17.537874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:17.538785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:17.557705 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:17.558624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:17.633227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:17.641460 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-195c3deb-3cbb-485a-8e13-20547a59799a tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1337 microversion: 2.1 time: 0.129872 Sep 23 05:00:17.642106 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3717/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:17 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:18.672358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:18.672991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:18.677092 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:18.689762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.690785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.691605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.692687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.693157 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.693619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.848772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:18.857604 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a7d8f4ea-976f-47aa-ab76-1f85e0bab0c6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.196500 Sep 23 05:00:18.858709 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3783/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:18 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:19.386339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdaccdd-ce19-434b-9890-3f2d90293296", "tag": "427412f1-33c4-43d4-82f4-5b0b27c5912a"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:19.398724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:19.399231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:19.399680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:19.412099 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] Creating event network-changed:427412f1-33c4-43d4-82f4-5b0b27c5912a for instance cfdaccdd-ce19-434b-9890-3f2d90293296 on n-h1-858495-2 Sep 23 05:00:19.417513 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-d96a997b-39c4-4837-8496-9c3e433d4c0a req-113618bc-7c65-4ca9-9674-7fad7af8e7fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 Sep 23 05:00:19.418127 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3718/7501] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:19.882429 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:19.882988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:19.889820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:19.890312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:19.890756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:19.891821 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:19.892303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:19.892795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.021369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:20.029095 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a02fb79d-599a-4e4c-930d-db31c9d58610 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.150941 Sep 23 05:00:20.029756 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3784/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:19 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:21.054430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:21.055151 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:21.062267 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:21.063123 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:21.063587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:21.064890 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:21.065388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:21.065908 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:21.200370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:21.208296 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e39e796f-6411-466d-a530-5e0440011856 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.159689 Sep 23 05:00:21.209112 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3719/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:21 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:22.231154 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:22.231760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:22.238660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.239144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.239581 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:22.240273 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.240730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.241158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:22.370347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:22.379138 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-887a8d8a-78ca-4956-bd15-5dd119b830c9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.151613 Sep 23 05:00:22.379312 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3785/7504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:22 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:23.402482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:23.403105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:23.410724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:23.411224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:23.411671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:23.412400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:23.412869 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:23.413308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:23.548201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:23.556158 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-cadae508-058b-4ceb-8910-e2cb263ba2a6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.157644 Sep 23 05:00:23.556743 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3720/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:23 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:24.558848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdaccdd-ce19-434b-9890-3f2d90293296", "name": "network-vif-plugged", "status": "completed", "tag": "427412f1-33c4-43d4-82f4-5b0b27c5912a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:24.571975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.573806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.573806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.580650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:24.581266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:24.584311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] Creating event network-vif-plugged:427412f1-33c4-43d4-82f4-5b0b27c5912a for instance cfdaccdd-ce19-434b-9890-3f2d90293296 on n-h1-858495-2 Sep 23 05:00:24.589064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.589241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.589784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.590126 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-45bd1a78-4acb-4641-9264-80ffcbd9e905 req-a9695996-d088-4535-ab4f-9724c799b2f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Sep 23 05:00:24.590498 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.590748 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3786/7506] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:24.591298 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.591743 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.733111 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:24.740979 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-db708190-2019-4405-a270-1804a7c3e721 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.165861 Sep 23 05:00:24.741590 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3721/7507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:24 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:25.764210 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:25.764971 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:25.773334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:25.773856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:25.774294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:25.774996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:25.775452 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:25.775880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:25.910220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:25.918655 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1e6c6b36-7b77-4178-9af6-8c3e84b9fcc9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1393 microversion: 2.1 time: 0.158718 Sep 23 05:00:25.919232 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3787/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:25 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:26.943383 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:26.944008 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:26.946816 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:26.947495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:26.954032 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.954538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.954989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.955693 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.956162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.956603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:27.090016 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:27.097985 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-36c1c18f-634c-4cc1-9fb6-d13a9b6c2b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1564 microversion: 2.1 time: 0.159252 Sep 23 05:00:27.098555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3722/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:26 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:27.120626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:27.121303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:27.123394 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:27.129779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:27.130272 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:27.130720 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:27.131428 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:27.131896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:27.132331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:27.263713 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:27.272045 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f60aee4b-7e37-495a-bcb0-30b64cbdcd1b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1564 microversion: 2.1 time: 0.155304 Sep 23 05:00:27.272626 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3788/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:27 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:28.865296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:28.866294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:28.867208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdaccdd-ce19-434b-9890-3f2d90293296", "tag": "427412f1-33c4-43d4-82f4-5b0b27c5912a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:28.873105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:28.873951 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:28.874625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.877954 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:28.878515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:28.879049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.883323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:28.883839 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:28.884305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.891431 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] Creating event network-changed:427412f1-33c4-43d4-82f4-5b0b27c5912a for instance cfdaccdd-ce19-434b-9890-3f2d90293296 on n-h1-858495-2 Sep 23 05:00:28.896800 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-c420be4a-0caf-4c2d-991a-335492d67b1e req-568831a8-a8f8-4d39-89d1-e15f69e48317 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033347 Sep 23 05:00:28.897631 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3789/7511] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:29.029903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:29.038378 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0456febe-69be-4cab-a0c7-08c1f783a145 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1564 microversion: 2.1 time: 0.177673 Sep 23 05:00:29.039243 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3723/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:28 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:52.283744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:52.284489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=34 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:52.288789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:52.291053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:52.298316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:52.298802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:52.299244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:52.300201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:52.300658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:52.301087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:52.365372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4fd3b55-4892-44ad-8472-96f061484329 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action" status: 200 len: 24537 microversion: 2.1 time: 0.083376 Sep 23 05:00:52.366301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3790/7513] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:52 2022] POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action => generated 24537 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:01:03.424138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:03.426958 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:03.427631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=50 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:03.433768 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:03.434309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:03.434771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:03.459487 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Going to try to stop instance {{(pid=128723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 05:01:03.502376 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7a0d891e-502a-4b8b-a7f3-999b84de1927 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action" status: 202 len: 0 microversion: 2.1 time: 0.082013 Sep 23 05:01:03.503021 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3724/7514] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:01:03 2022] POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:01:03.512723 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:03.513455 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:03.516279 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:03.516928 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:03.524225 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:03.524854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:03.525309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:03.526038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:03.526501 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:03.526931 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:03.660820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:03.669050 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4d09d629-4747-49b1-9113-46750dc2a1ef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.160648 Sep 23 05:01:03.669657 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3791/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:03 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:04.695373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:04.696099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:04.702399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:04.702909 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:04.703372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:04.704091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:04.704573 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:04.705026 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:04.836004 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:04.844072 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-11d5e19c-3f39-4984-ab32-cf2e24846bc4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.154477 Sep 23 05:01:04.844654 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3725/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:04 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:05.867629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:05.868173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:05.875259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:05.875745 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:05.876183 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:05.876879 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:05.877333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:05.877818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:06.010939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:06.018632 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4dcc6e58-3b9f-45ba-b3f2-272523a8dee9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.155022 Sep 23 05:01:06.019211 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3792/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:05 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:07.042772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:07.043411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:07.050575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:07.051706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:07.052173 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:07.052900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:07.053400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:07.053856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:07.183247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:07.191079 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7fd17a74-2201-4b80-bc77-4c693007c6ea tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.152335 Sep 23 05:01:07.191656 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3726/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:07 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:08.213447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:08.214055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:08.220757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:08.221437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:08.221880 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:08.222573 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:08.223028 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:08.223473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:08.355908 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:08.366184 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-0dda6ab6-f8f8-480e-80be-892367f56783 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.156631 Sep 23 05:01:08.366769 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3793/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:08 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:09.390306 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:09.390939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:09.398467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:09.398961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:09.399412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:09.400119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:09.400589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:09.401029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:09.528834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:09.537182 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8516215f-fdbe-428d-b438-8c8f57576cef tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.150912 Sep 23 05:01:09.537794 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3727/7520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:09 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:10.560538 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:10.561204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:10.568244 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:10.568732 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:10.569203 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:10.569941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:10.570397 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:10.570825 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:10.705653 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:10.714012 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3fbded5b-a9b8-4b9a-ac01-77876d46c6e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.157546 Sep 23 05:01:10.714600 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3794/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:10 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:11.737369 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:11.737935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:11.745598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:11.746102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:11.746562 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:11.747271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:11.747745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:11.748195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:11.875774 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:11.883482 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f1a836f7-6250-4113-b1e3-d81459ea8863 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.150194 Sep 23 05:01:11.884059 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3728/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:11 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:12.907152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:12.907776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:12.914655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.915145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.915593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.916295 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.916761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.917197 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.046078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:13.054675 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-96c5d919-eb4c-4cb8-94c7-55c0dcb05a58 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.151431 Sep 23 05:01:13.055254 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3795/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:12 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:14.078561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:14.079193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:14.086844 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:14.087339 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:14.087815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:14.088547 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:14.089048 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:14.089527 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:14.224950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:14.232866 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ce3917df-21fc-4264-9d72-34b335af5b05 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.158252 Sep 23 05:01:14.233487 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3729/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:14 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:15.256556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:15.257803 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:15.267847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:15.268351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:15.268801 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:15.270196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:15.270672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:15.271109 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:15.403521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:15.411247 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ab1dcb33-8db2-4904-8b05-c5c01b4cb89f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.159141 Sep 23 05:01:15.411832 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3796/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:15 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:16.435130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:16.435759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:16.442243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:16.442747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:16.443202 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:16.443939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:16.444407 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:16.444848 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:16.577776 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:16.585561 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-33d7c590-9cb9-48ab-a063-97ced77f1e6f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.154325 Sep 23 05:01:16.586142 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3730/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:16 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:17.609173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:17.609905 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:17.617064 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:17.617605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:17.618068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:17.618774 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:17.619237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:17.619674 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:17.747456 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:17.755810 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-09054c8e-c3dc-4aa4-8d72-9f4e21df8588 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1693 microversion: 2.1 time: 0.151309 Sep 23 05:01:17.756388 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3797/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:17 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:18.778835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:18.779392 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:18.786925 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:18.787432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:18.787887 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:18.788603 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:18.789074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:18.789543 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:18.925172 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:18.933801 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-75f6da37-af6f-4374-8c5d-036ba4040716 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1670 microversion: 2.1 time: 0.159274 Sep 23 05:01:18.934392 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3731/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:18 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:20.028967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:20.031201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:20.038750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.039262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.039866 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.040786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.041414 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.041855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.090665 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e4d31f41-6680-4ac3-8a6c-c2c5f8bc8b48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action" status: 200 len: 38390 microversion: 2.1 time: 0.065515 Sep 23 05:01:20.091308 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3798/7529] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:01:20 2022] POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action => generated 38390 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:01:20.103959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:20.111564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.112069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.112526 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.135094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Going to try to start instance {{(pid=128723) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 05:01:20.183747 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ec819b3b-26c6-489d-8f44-c1b2a8860fb6 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action" status: 202 len: 0 microversion: 2.1 time: 0.083095 Sep 23 05:01:20.184539 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3732/7530] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:01:20 2022] POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:01:20.194288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:20.194990 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:20.202549 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.203457 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.204519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.205426 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.205893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.206324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.343180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:20.351131 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-06ec4f81-0f84-4d54-9b17-558a0bb8e5da tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1679 microversion: 2.1 time: 0.161653 Sep 23 05:01:20.351717 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3799/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:20 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:21.375775 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:21.376535 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:21.383606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:21.384115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:21.384575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:21.385286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:21.385787 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:21.386243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:21.525886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:21.533676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-507c0680-0017-4797-bf25-2a400981a8ab tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1683 microversion: 2.1 time: 0.162224 Sep 23 05:01:21.534264 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3733/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:21 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:47.727255 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:47.729531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:47.732333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=18 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:47.732988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=52 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:47.734170 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:01:47.734338 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action (ip 10.222.0.25) !!! Sep 23 05:01:47.744108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.744593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.745035 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.745760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.746218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.746646 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.802386 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8de20148-9c02-4c42-900e-a242ba92d3d8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action" status: 200 len: 62948 microversion: 2.1 time: 0.079039 Sep 23 05:01:47.803038 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3800/7533] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:01:47 2022] POST /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296/action => generated 62948 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:01:55.185195 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:55.185741 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:55.187389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdaccdd-ce19-434b-9890-3f2d90293296", "tag": "427412f1-33c4-43d4-82f4-5b0b27c5912a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:55.188175 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=20 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:55.188858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:55.196434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.196955 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.197451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.198454 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.198941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.199426 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.200062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.200794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.201299 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.212979 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] Creating event network-changed:427412f1-33c4-43d4-82f4-5b0b27c5912a for instance cfdaccdd-ce19-434b-9890-3f2d90293296 on n-h1-858495-2 Sep 23 05:01:55.218311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-1d10c661-44d0-4186-b41a-010691214f4a req-842292e6-d8b1-4cd2-b7ee-71e653d1b6f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034948 Sep 23 05:01:55.219501 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3801/7534] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:01:55.228286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:01:55.312928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-689f5a9e-2ee8-4cea-bf52-e5f3dd6d43a1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 204 len: 0 microversion: 2.1 time: 0.131332 Sep 23 05:01:55.313173 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3734/7535] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:01:55 2022] DELETE /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:01:55.323525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:55.324312 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:55.330760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.331259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.331709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.332495 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.332967 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.333652 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.541344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:55.549501 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aa460b82-f619-4264-8906-a2f62a84d883 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1689 microversion: 2.1 time: 0.231095 Sep 23 05:01:55.550092 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3802/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:55 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:56.574949 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:56.575830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:56.582948 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:56.583483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:56.583942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:56.584685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:56.585190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:56.585665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:56.762507 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:56.770396 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-690d72e7-2666-4e18-bdce-6a53afba3a48 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 200 len: 1689 microversion: 2.1 time: 0.199755 Sep 23 05:01:56.771072 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3735/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:56 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:57.308705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdaccdd-ce19-434b-9890-3f2d90293296", "name": "network-vif-deleted", "tag": "427412f1-33c4-43d4-82f4-5b0b27c5912a"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:57.321895 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.322305 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.322875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.338750 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] Creating event network-vif-deleted:427412f1-33c4-43d4-82f4-5b0b27c5912a for instance cfdaccdd-ce19-434b-9890-3f2d90293296 on n-h1-858495-2 Sep 23 05:01:57.344520 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-73c3876f-183c-4483-86cc-34db92352478 req-87f3a936-731d-4833-b808-54129599e3bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039772 Sep 23 05:01:57.345559 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3803/7538] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:01:57.793434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:57.794696 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: cfdaccdd-ce19-434b-9890-3f2d90293296] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:57.803184 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.803827 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.804387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.805124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.806135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.806586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.826342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] HTTP exception thrown: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Request method failure captured: Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 HTTP/1.1 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTweO0Cz1aRsHI2y8UM4LvbiSnbxe57foStAkDgsj4z1BSChOe5mf33Y7CVCEn4lR4iI58GcejGnG4YONjJcFba_7Z8aEMcIpCG7FxuUZQHyeAoFfV5VKpmeDo_MU-5DKoGye20v-7T50lDZhks6YimBes-TclRDbO96tqZuzUPqfww Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 733540c92364442c91622c60b9cad842 Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'cfdaccdd-ce19-434b-9890-3f2d90293296'} Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:01:57.828194 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Returning 404 to user: Instance cfdaccdd-ce19-434b-9890-3f2d90293296 could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de3de6fd-0dd5-48be-8371-deb6b588f2c4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296" status: 404 len: 111 microversion: 2.1 time: 0.040343 Sep 23 05:01:57.834440 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3736/7539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:57 2022] GET /compute/v2.1/servers/cfdaccdd-ce19-434b-9890-3f2d90293296 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:02:01.121765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b85a2a52-c3ce-456b-8c36-d8bbffd6c79f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '.version_select at 0x7f0c8b0fcf70>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:01.147957 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b85a2a52-c3ce-456b-8c36-d8bbffd6c79f tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1352659206" status: 202 len: 0 microversion: 2.1 time: 0.031406 Sep 23 05:02:01.148663 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3804/7540] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Sep 23 05:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1352659206 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:02:01.179544 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-726f9cb3-e0dc-437b-b107-d37a2600cacd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: .version_select at 0x7f0c882aa550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-67812243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ8OnYhOObX0M/okdi3sHa5w5Tb2ZxEAy/u7Sr02hMJYKI92hvG6pIPQZjOO30zJO9DiPRacHGye07l+H1Mse9eJb4Qp5LBZRcG3r6u/qIul1H3U6AUkx4hOt7MAHGcHw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:01.199070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-726f9cb3-e0dc-437b-b107-d37a2600cacd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:02:01.206072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-726f9cb3-e0dc-437b-b107-d37a2600cacd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:02:01.230547 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-726f9cb3-e0dc-437b-b107-d37a2600cacd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056247 Sep 23 05:02:01.231147 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3737/7541] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 05:02:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:06.915136 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-81984970", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "networks": [{"uuid": "149e0a0e-9d99-4c6c-9817-73a565b132a8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-67812243", "security_groups": [{"name": "tempest-secgroup-smoke-1461429268"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:07.064278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] validate_networks() for [('149e0a0e-9d99-4c6c-9817-73a565b132a8', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:02:07.328924 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=14 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:07.533683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:02:07.534617 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:02:07.535262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:02:07.536409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:02:07.537173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:02:07.551155 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:07.552278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:07.553127 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:07.553913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:07.554435 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:07.555012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:07.574170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:02:07.579861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Getting quotas for user 733540c92364442c91622c60b9cad842 and project 56d8783d28264bab8e9fb0aea6af6233. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:02:07.593363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:02:07.595913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:02:07.644395 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-81f64b42-3198-466b-b855-9dc074b94c38 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734161 Sep 23 05:02:07.645407 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3805/7542] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:02:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:02:07.657559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0c67ead-a3ed-47c0-a4e0-a33906c1f5e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:07.658206 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0c67ead-a3ed-47c0-a4e0-a33906c1f5e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:07.721447 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c0c67ead-a3ed-47c0-a4e0-a33906c1f5e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:07.733619 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0c67ead-a3ed-47c0-a4e0-a33906c1f5e1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1263 microversion: 2.1 time: 0.081197 Sep 23 05:02:07.734328 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3738/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:07 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:08.760747 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:08.761389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:08.768580 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:08.769324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:08.769802 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:08.771363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:08.772896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:08.772896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:08.861669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:08.871112 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-599f09b7-978b-4edc-b460-57bf7026c770 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1323 microversion: 2.1 time: 0.115296 Sep 23 05:02:08.872141 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3806/7544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:08 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:09.896471 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:09.897102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:09.900170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:09.908817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:09.909365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:09.909831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:09.910563 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:09.911605 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:09.912058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:10.052404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:10.060405 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-41dedb08-25dd-4950-a59c-fc36eb902425 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.167920 Sep 23 05:02:10.060997 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3739/7545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:09 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:10.404431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3b61ad-02d5-4129-8db2-4e51554ac4cf", "tag": "4a8ab196-4c1d-4da5-a110-660e652277f6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:10.414886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:10.415375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:10.415937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:10.431372 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] Creating event network-changed:4a8ab196-4c1d-4da5-a110-660e652277f6 for instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf on n-h2-858495-2 Sep 23 05:02:10.436668 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-47a691cb-2c3d-4be3-b8d9-cc8167f2d26c req-5258c99a-3d1c-42c9-9676-60f4cddbc2d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036068 Sep 23 05:02:10.437288 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3807/7546] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:02:11.083963 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:11.085340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:11.092280 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:11.092785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:11.093248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:11.094005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:11.094489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:11.094969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:11.234112 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:11.242718 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c2ab9b32-e88a-4c09-8dae-e1049bf15eae tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.162833 Sep 23 05:02:11.243312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3740/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:11 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:12.267815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:12.268534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:12.276007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:12.276506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:12.276957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:12.277701 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:12.278170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:12.278614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:12.409476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:12.417243 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-91ebd6f0-0ad4-47f9-8711-83ef63420dfe tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.153764 Sep 23 05:02:12.417854 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3808/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:12 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:13.440359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:13.441795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:13.449474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:13.449988 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:13.450759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:13.451539 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:13.452030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:13.452698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:13.593448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:13.602676 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9554f170-3fd5-41da-a135-8302b4c5ddc7 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.166410 Sep 23 05:02:13.603379 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3741/7549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:13 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:14.625915 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:14.626572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:14.633682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:14.634173 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:14.634619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:14.635322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:14.635785 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:14.636219 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:14.765335 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:14.773654 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a1634576-48e0-4dbf-865f-2763490f5bf4 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.151613 Sep 23 05:02:14.774245 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3809/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:14 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:15.796965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:15.797550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:15.805431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:15.806085 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:15.806542 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:15.807279 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:15.807755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:15.808200 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:15.945873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:15.953754 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4cb274c4-c69f-4465-bfc2-4aee208ee01b tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.160653 Sep 23 05:02:15.969555 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3742/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:15 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:16.977314 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:16.977961 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:16.984790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:16.985284 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:16.985763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:16.986467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:16.986937 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:16.987370 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:17.119959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:17.127873 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-01484cdf-5d1c-4176-b902-d97072bdee98 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.154508 Sep 23 05:02:17.128505 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3810/7552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:16 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:18.017572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3b61ad-02d5-4129-8db2-4e51554ac4cf", "name": "network-vif-plugged", "status": "completed", "tag": "4a8ab196-4c1d-4da5-a110-660e652277f6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:18.024619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:18.030323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.030834 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.031295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.043736 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] Creating event network-vif-plugged:4a8ab196-4c1d-4da5-a110-660e652277f6 for instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf on n-h2-858495-2 Sep 23 05:02:18.050093 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-71aa262e-3098-4452-af28-a28d7ceddba1 req-4aa548a5-79aa-48a7-ae43-cdce215a060c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035561 Sep 23 05:02:18.050770 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3743/7553] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:18.150941 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:18.151676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:18.153688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:18.154362 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:18.156056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:18.163544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.164034 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.164474 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.165215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.165776 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.166205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.302636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:18.310508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7c2dad96-2c2c-400d-b5ea-272047ad29d9 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.163449 Sep 23 05:02:18.311105 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3811/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:18 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:19.334755 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:19.335473 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:19.342803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:19.343310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:19.343785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:19.344506 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:19.344979 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:19.345490 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:19.481194 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:19.489018 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-71c6c026-ed6d-4e68-a7c9-f31051493f51 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1389 microversion: 2.1 time: 0.159071 Sep 23 05:02:19.489648 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3744/7555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:19 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:20.512145 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:20.512760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:20.519696 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:20.520212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:20.520664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:20.521910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:20.522374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:20.522810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:20.650184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:20.657840 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6009fa37-a116-40af-badd-2b5106514e6e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1560 microversion: 2.1 time: 0.149727 Sep 23 05:02:20.658409 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3812/7556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:20 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:20.681001 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:20.681660 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:20.688435 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:20.688940 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:20.689509 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:20.690237 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:20.690714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:20.691162 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:20.823090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:20.831113 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1d82c3da-1344-4c49-aaa5-39ed9906290c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1560 microversion: 2.1 time: 0.153925 Sep 23 05:02:20.831751 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3745/7557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:20 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:22.390255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3b61ad-02d5-4129-8db2-4e51554ac4cf", "tag": "4a8ab196-4c1d-4da5-a110-660e652277f6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:22.396910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:22.397591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:22.406459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:22.406956 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:22.407404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:22.408119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:22.408815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:22.409257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:22.409390 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:22.409903 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:22.410363 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:22.423393 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] Creating event network-changed:4a8ab196-4c1d-4da5-a110-660e652277f6 for instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf on n-h2-858495-2 Sep 23 05:02:22.431753 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-4f8a52e4-4470-4404-8fdc-b3c20883971c req-d88a902e-23cc-4367-b7bf-65083574694a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045405 Sep 23 05:02:22.432558 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3746/7558] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:02:22.556516 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:22.564809 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e31bf2da-a745-4121-af4c-aa8ead447a8c tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1560 microversion: 2.1 time: 0.181782 Sep 23 05:02:22.565424 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3813/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:22 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:55.846168 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:55.846858 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=40 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:55.851357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:55.853710 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:55.861222 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:55.861754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:55.862215 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:55.862932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:55.863409 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:55.863856 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:55.932125 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0a2b5935-a117-4a83-8bc2-add7f4c8aca8 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action" status: 200 len: 24563 microversion: 2.1 time: 0.087852 Sep 23 05:02:55.932997 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3747/7560] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:02:55 2022] POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action => generated 24563 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:03:26.138635 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=5 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:26.139396 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=46 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:26.143605 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:26.144142 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:26.150823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.151313 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.151760 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.152459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.152979 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.153540 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.176851 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lazy-loading 'flavor' on Instance uuid 7a3b61ad-02d5-4129-8db2-4e51554ac4cf {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:03:26.243926 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2f8f2df6-225a-480d-ac85-415266a3fdc5 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.106958 Sep 23 05:03:26.244639 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3814/7561] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:03:26 2022] POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:03:26.253631 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:26.254706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:26.259126 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:03:26.259126 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf (ip 10.222.0.25) !!! Sep 23 05:03:26.260665 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:26.260851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=4 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:26.266536 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.267071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.267581 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.268336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.268872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.269323 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.404248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:26.412720 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a5bb50b7-1c42-417c-8aba-4a22c07a7bbd tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1686 microversion: 2.1 time: 0.163525 Sep 23 05:03:26.413301 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3748/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:26 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:27.440627 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:27.441336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:27.447533 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:27.448030 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:27.448472 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:27.449171 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:27.449707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:27.450146 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:27.583158 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:27.590939 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-33dfabdd-f71f-4510-89e1-fdce53cca2a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1686 microversion: 2.1 time: 0.155761 Sep 23 05:03:27.591510 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3815/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:27 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:28.614806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:28.615444 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:28.623439 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.623947 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.624403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.625121 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.625624 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.626070 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.754411 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:28.763521 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-edf5924c-a3d3-4db4-9390-e016d31c154e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1669 microversion: 2.1 time: 0.152702 Sep 23 05:03:28.764093 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3749/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:28 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:29.859695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:29.861987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:29.869444 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.869869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.870309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.871001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.871539 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.872556 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.939638 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e26a78d9-9b6f-4b50-a36d-1c5efaa9999d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action" status: 200 len: 38332 microversion: 2.1 time: 0.084203 Sep 23 05:03:29.940284 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3816/7565] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:03:29 2022] POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action => generated 38332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:03:29.952289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:29.952849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:29.959779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.960315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.960813 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.961557 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.962039 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.962488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:30.032209 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-40032a0c-596f-4abf-9be3-7710b700fb3e tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.083594 Sep 23 05:03:30.033080 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3750/7566] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:03:29 2022] POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:03:30.042044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:30.042758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:30.051060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:30.051651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:30.052096 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:30.052893 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:30.053424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:30.053984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:30.190761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:30.198853 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-19f5ce6d-cc09-49f0-af97-ca8079e0c3bc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1675 microversion: 2.1 time: 0.161128 Sep 23 05:03:30.199518 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3817/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:30 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:31.222568 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:31.223300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:31.230456 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:31.231683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:31.232314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:31.233055 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:31.234169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:31.234630 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:31.368273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:31.376903 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f82e69e5-fde8-420b-9598-1c4d664062ad tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1675 microversion: 2.1 time: 0.158856 Sep 23 05:03:31.377513 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3751/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:31 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:32.400134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:32.400754 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:32.408077 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:32.408568 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:32.409017 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:32.409744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:32.410214 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:32.410651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:32.544527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:32.552768 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d5976a3a-2436-422f-b4fe-14d03f6d237d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1678 microversion: 2.1 time: 0.156605 Sep 23 05:03:32.553384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3818/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:32 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:32.645465 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:32.647716 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:32.655430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:32.655878 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:32.656362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:32.657101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:32.657600 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:32.658073 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:32.720058 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a18d1e0d-a858-434a-8140-a39b06759849 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action" status: 200 len: 38332 microversion: 2.1 time: 0.078712 Sep 23 05:03:32.720699 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3752/7570] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:03:32 2022] POST /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf/action => generated 38332 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:03:33.685899 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:33.686417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:33.693487 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.693987 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.694439 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.695152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.695614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.696052 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.724437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:03:33.750642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3b61ad-02d5-4129-8db2-4e51554ac4cf", "tag": "4a8ab196-4c1d-4da5-a110-660e652277f6"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:33.761602 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.762107 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.762687 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.774225 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] Creating event network-changed:4a8ab196-4c1d-4da5-a110-660e652277f6 for instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf on n-h2-858495-2 Sep 23 05:03:33.779843 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-ae6fbbc3-a247-43ec-8220-50ac3c08fa04 req-aa33f6cd-293e-4ae2-b241-7cc9f239c040 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087822 Sep 23 05:03:33.780739 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3753/7571] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:33.807802 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-cd0ae4bc-9548-4e6d-a087-cf9204cb97a2 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 204 len: 0 microversion: 2.1 time: 0.125471 Sep 23 05:03:33.808326 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3819/7572] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:03:33 2022] DELETE /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:03:33.819000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:33.820005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:33.826601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.827854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.828666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.829771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.830399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.830986 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.975646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:33.984334 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c6bfc870-c09d-4ef8-bc57-7ababf1ddb89 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1684 microversion: 2.1 time: 0.171380 Sep 23 05:03:33.984921 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3754/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:33 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:35.009944 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:35.010758 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:35.017569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:35.018062 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:35.018514 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:35.019218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:35.019682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:35.020116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:35.152239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:35.161022 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-2e0635e0-ed1c-4660-9fc1-52ab36778e4d tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1684 microversion: 2.1 time: 0.156407 Sep 23 05:03:35.161637 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3820/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:35 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:36.186081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:36.186724 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:36.194000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:36.194437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:36.194969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:36.195738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:36.196214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:36.196671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:36.393733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733540c92364442c91622c60b9cad842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d8783d28264bab8e9fb0aea6af6233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:36.402020 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fb3b9e01-d33d-47fa-9c8b-7bd1510684b1 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 200 len: 1566 microversion: 2.1 time: 0.220475 Sep 23 05:03:36.402611 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3755/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:36 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:36.484418 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3b61ad-02d5-4129-8db2-4e51554ac4cf", "name": "network-vif-deleted", "tag": "4a8ab196-4c1d-4da5-a110-660e652277f6"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:36.495375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:36.495951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:36.496482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:36.508837 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] Creating event network-vif-deleted:4a8ab196-4c1d-4da5-a110-660e652277f6 for instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf on n-h2-858495-2 Sep 23 05:03:36.514134 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5dbc6ced-263e-49c3-9351-4f9cbf4c039c req-34426cc2-53d8-43dc-a17d-a0598fd0ccf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033949 Sep 23 05:03:36.514737 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3821/7576] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:37.425559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:37.426192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] [instance: 7a3b61ad-02d5-4129-8db2-4e51554ac4cf] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:37.433094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:37.433642 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:37.434102 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:37.434805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:37.435777 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:37.436220 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:37.449590 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] HTTP exception thrown: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Request method failure captured: Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf HTTP/1.1 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLTweO0Cz1aRsHI2y8UM4LvbiSnbxe57foStAkDgsj4z1BSChOe5mf33Y7CVCEn4lR4iI58GcejGnG4YONjJcFba_7Z8aEMcIpCG7FxuUZQHyeAoFfV5VKpmeDo_MU-5DKoGye20v-7T50lDZhks6YimBes-TclRDbO96tqZuzUPqfww Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d8783d28264bab8e9fb0aea6af6233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 56d8783d28264bab8e9fb0aea6af6233 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1363696498 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: 733540c92364442c91622c60b9cad842 Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1363696498-project Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': '7a3b61ad-02d5-4129-8db2-4e51554ac4cf'} Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:03:37.451978 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Returning 404 to user: Instance 7a3b61ad-02d5-4129-8db2-4e51554ac4cf could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58d41e3c-9c99-4284-b69e-237d271f03cc tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf" status: 404 len: 111 microversion: 2.1 time: 0.032083 Sep 23 05:03:37.456928 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3756/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:37 2022] GET /compute/v2.1/servers/7a3b61ad-02d5-4129-8db2-4e51554ac4cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:03:40.760049 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7f154fe8-f8f6-405b-b1d1-631e5da31758 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] Calling method '.version_select at 0x7f0c89e17e50>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:40.787123 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7f154fe8-f8f6-405b-b1d1-631e5da31758 tempest-TestNetworkAdvancedServerOps-1363696498 tempest-TestNetworkAdvancedServerOps-1363696498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-67812243" status: 202 len: 0 microversion: 2.1 time: 0.031420 Sep 23 05:03:40.787731 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3822/7578] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Sep 23 05:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-67812243 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:03:51.908905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=18 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:51.909629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:52.116002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-355f7afb-7399-438e-8301-f4965e113d81 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'create', calling method: .version_select at 0x7f0c90a79d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1221520432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPlFED78RSqRW3MV4t+oyaEy6xKRHyi9hFhv8aMdC+z1BcGh7juOEODETyuHkIXCqLM2dZzpCrLRL0TJYg8jeodA6qlWBw2SxmXXKHacfWUpfAQomMT64E4+Ejig0uBTw=="}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:52.139440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-355f7afb-7399-438e-8301-f4965e113d81 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:03:52.146384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-355f7afb-7399-438e-8301-f4965e113d81 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for user 79c1314082e24918a6e7950bab5ed2cb and project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'key_pairs'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:03:52.172738 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-355f7afb-7399-438e-8301-f4965e113d81 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.269388 Sep 23 05:03:52.173369 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3757/7579] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 05:03:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:53.154488 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1356219890", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1221520432", "security_groups": [{"name": "tempest-secgroup-smoke-227173905"}], "networks": [{"uuid": "1f5de08b-94c8-4490-ada1-57c3176e9f94"}]}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:53.165845 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:53.167086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:53.272250 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.network.neutron [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] validate_networks() for [('1f5de08b-94c8-4490-ada1-57c3176e9f94', None, None, None, None, None)] {{(pid=128724) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:03:53.764737 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Flavor limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:03:53.765262 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Image limits 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:03:53.765847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Flavor pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:03:53.766344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Image pref 0:0:0 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:03:53.766862 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.virt.hardware [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:03:53.775921 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:53.776494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:53.777010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:53.777856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:53.778442 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:53.778996 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:53.797476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:03:53.803234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for user 79c1314082e24918a6e7950bab5ed2cb and project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:03:53.816331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Going to run 1 instances... {{(pid=128724) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:03:53.818847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:03:53.866777 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a20adf12-d183-4de1-953d-5b1655a51b84 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718174 Sep 23 05:03:53.867989 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3823/7580] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:03:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:03:53.881629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-07a0c715-ee14-4453-a13f-62922487a8ae tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:53.882317 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-07a0c715-ee14-4453-a13f-62922487a8ae tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:53.941664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-07a0c715-ee14-4453-a13f-62922487a8ae tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:53.949784 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-07a0c715-ee14-4453-a13f-62922487a8ae tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1247 microversion: 2.1 time: 0.074201 Sep 23 05:03:53.950653 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3758/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:53 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:54.973918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:54.975508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:54.991000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:54.991637 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:54.992165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:54.993220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:54.993860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:54.994372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:55.086896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:55.095824 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ca100ae4-9e5a-4d41-873f-4ea8029f5ee0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1317 microversion: 2.1 time: 0.127511 Sep 23 05:03:55.096428 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3824/7582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:54 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1317 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:56.118885 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:56.119517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:56.129756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:56.130261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:56.130711 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:56.131431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:56.131907 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:56.132356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:56.367308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:56.375597 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05cfd67f-463f-4a8f-ad83-83ef1fe6d445 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.260624 Sep 23 05:03:56.376197 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3759/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:56 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:56.571648 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:56.594489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:56.595363 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:56.595884 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:56.608183 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] Creating event network-changed:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h1-858495-2 Sep 23 05:03:56.613202 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-80cef7d9-f624-4dfa-8f90-4d7c25557046 req-94ca7284-bb22-45df-a051-f977317e278b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047020 Sep 23 05:03:56.614049 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3825/7584] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:57.399340 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:57.399898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:57.407663 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:57.408177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:57.408646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:57.409412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:57.409904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:57.410357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:57.545505 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:57.553821 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a807b446-5a7e-440c-8c20-40b9b434a95f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.158465 Sep 23 05:03:57.554401 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3760/7585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:57 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:58.578133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:58.578847 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:58.585006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:58.585531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:58.585976 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:58.586688 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:58.587148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:58.587578 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:58.716409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:58.724591 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-190c7e65-3163-483d-9733-63ddd32ff5a5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.152089 Sep 23 05:03:58.725102 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3826/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:58 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:59.748064 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:59.748840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:59.755818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:59.756332 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:59.756802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:59.757558 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:59.758041 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:59.758494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:59.894005 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:59.901704 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-da82d14d-5671-4880-a096-b48f7a2c99c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.158143 Sep 23 05:03:59.902288 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3761/7587] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:59 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:00.926422 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:00.926984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:00.933423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:00.933906 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:00.934943 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:00.936078 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:00.936741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:00.937390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:01.067351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:01.075410 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7506e5d5-a349-4b15-967a-c09a58ba74bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.153884 Sep 23 05:04:01.075991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3827/7588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:00 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:01.633449 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "name": "network-vif-plugged", "status": "completed", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:01.643351 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:01.643861 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:01.644324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:01.656624 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] Creating event network-vif-plugged:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h1-858495-2 Sep 23 05:04:01.661749 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-1494f037-3fa9-4138-84a0-9a86596b8275 req-49d8457f-2695-45d2-855b-8ffbcea2e66c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088216 Sep 23 05:04:01.662377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3762/7589] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:02.098951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:02.099582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:02.106659 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:02.107152 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:02.107597 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:02.108302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:02.108799 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:02.109235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:02.239294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:02.247664 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-97fcaeaf-94b9-449d-924b-94cd2c03161b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1372 microversion: 2.1 time: 0.151960 Sep 23 05:04:02.248244 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3828/7590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:02 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:03.272770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:03.273489 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:03.280289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:03.280803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:03.281271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:03.282018 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:03.282503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:03.282959 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:03.416188 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:03.424348 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8442924e-9019-4135-98ca-dd99076cc9b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1557 microversion: 2.1 time: 0.156789 Sep 23 05:04:03.424927 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3763/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:03 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:03.449657 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:03.450784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:03.458763 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:03.459281 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:03.459728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:03.460462 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:03.460916 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:03.461614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:03.787453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:03.810355 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:03.912515 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:03.920958 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d1a14931-7492-4b17-b286-f17f3f982538 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1557 microversion: 2.1 time: 0.475358 Sep 23 05:04:03.921567 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3829/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:03 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1557 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:05.527470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:05.532932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:05.539674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:05.540190 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:05.540627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:05.552807 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] Creating event network-changed:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h1-858495-2 Sep 23 05:04:05.557940 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5b1cb337-523a-4fe1-b3b9-eaa7a9543694 req-8902b31f-6788-4bd9-bb28-05eb63442834 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034160 Sep 23 05:04:05.558556 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3764/7593] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:03.185540 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:06:03.186481 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:06:03.187584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:03.188481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=34 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:03.193927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:03.194463 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:03.202662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.203251 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.203698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.204395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.204855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.205395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.228199 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.objects.instance [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lazy-loading 'flavor' on Instance uuid d6c5fada-1025-4943-82e0-13a67d8a9fa0 {{(pid=128724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:06:03.417660 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d052ffb9-58fa-4355-bc3c-a827928a9000 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0/action" status: 202 len: 0 microversion: 2.1 time: 0.233886 Sep 23 05:06:03.418313 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3830/7594] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:06:03 2022] POST /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:06:03.425891 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:06:03.426797 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:06:03.427394 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:03.428356 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=28 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:03.434464 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:03.435201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:03.443735 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.444230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.444698 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.445448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.445935 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.446389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.588888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:03.597270 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e81d2733-e5d9-48d4-8d89-bc8d880c89ed tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.173733 Sep 23 05:06:03.597874 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3765/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:03 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:04.623626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:04.624361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:04.633858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.635336 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.635781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.636485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.636950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.637410 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.641500 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55932. Sep 23 05:06:04.642205 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55934. Sep 23 05:06:04.768461 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:04.776143 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7ac26f28-3002-4388-913f-a178ef53be05 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.158607 Sep 23 05:06:04.776711 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3831/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:04 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:05.800702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:05.801292 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:05.810587 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:05.811091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:05.812244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:05.812977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:05.813478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:05.813929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:05.818730 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55940. Sep 23 05:06:05.821191 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55938. Sep 23 05:06:05.952999 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:05.960972 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3bbdfe1b-7762-4cbf-8c39-bbaeeb6d2990 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.165115 Sep 23 05:06:05.961678 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3766/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:05 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:06.984972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:06.985613 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:06.992420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:06.992901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:06.993337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:06.994055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:06.994508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:06.994934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:07.123761 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:07.131508 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9c171c0b-6c8a-458b-9ce8-58ec851d56cb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.150497 Sep 23 05:06:07.132088 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3832/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:06 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:08.155824 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:08.156457 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:08.163343 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:08.163842 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:08.164296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:08.165007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:08.165511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:08.166185 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:08.297038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:08.305229 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-edc0d872-069a-4ecf-bc2d-0578fa1b8420 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.153899 Sep 23 05:06:08.305834 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3767/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:08 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:09.328424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:09.329012 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:09.335780 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:09.336265 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:09.336702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:09.337423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:09.337881 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:09.338311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:09.474231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:09.482020 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-aaa4aea2-9951-43e6-9ab8-67627799a948 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.157660 Sep 23 05:06:09.482593 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3833/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:09 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:10.505832 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:10.506463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:10.513458 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:10.513906 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:10.514359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:10.515104 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:10.515579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:10.516025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:10.644348 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:10.652249 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d51ab9ce-486f-4ea2-b0cc-dcbd40d60208 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.150330 Sep 23 05:06:10.652829 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3768/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:10 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:11.677382 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:11.678008 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:11.684794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:11.685286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:11.685765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:11.687122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:11.687585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:11.688026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:11.819134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:11.826986 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f99d47bb-2790-4373-9ae1-31a23c0f794e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.153878 Sep 23 05:06:11.827566 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3834/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:11 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:12.850316 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:12.850923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:12.857825 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:12.858353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:12.858807 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:12.859512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:12.859987 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:12.860430 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:12.991570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:13.000126 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-08144c8c-e63a-4cf0-a526-b67c9aa39b47 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.153854 Sep 23 05:06:13.000702 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3769/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:12 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:14.025620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:14.026282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:14.033412 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:14.033912 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:14.034358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:14.035098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:14.035560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:14.035994 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:14.165492 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:14.174194 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6c68b178-1651-49e0-873a-4b48b3937564 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1703 microversion: 2.1 time: 0.153588 Sep 23 05:06:14.174767 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3835/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:14 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:15.198217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:15.198860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:15.206060 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:15.206564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:15.207023 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:15.207746 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:15.208225 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:15.208707 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:15.343095 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:15.351027 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-45152ab5-0397-4079-846a-8cfab1186459 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1703 microversion: 2.1 time: 0.156878 Sep 23 05:06:15.351854 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3770/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:15 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1703 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:16.375389 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:16.376087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:16.383856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:16.384196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:16.384641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:16.385392 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:16.385930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:16.386264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:16.545848 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:16.555559 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f9edbf08-ca90-42fe-9fd7-3809637c3495 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.184513 Sep 23 05:06:16.556374 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3836/7606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:16 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:17.581372 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:17.582646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:17.590287 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:17.591201 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:17.591674 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:17.592413 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:17.592894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:17.593381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:17.748312 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:17.759952 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-97d412f6-fab2-40be-90dd-41b0fbd991b9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.182804 Sep 23 05:06:17.760884 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3771/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:17 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:18.450669 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "name": "network-vif-plugged", "status": "completed", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:18.467124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:18.471872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:18.473190 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:18.495092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] Creating event network-vif-plugged:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h1-858495-2 Sep 23 05:06:18.500757 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-edfa24c8-f88d-4d66-95d1-e6e8d77eaa86 req-9d488e41-5ea6-4e0f-9e9b-aca1db658369 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053861 Sep 23 05:06:18.501619 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3837/7608] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:06:18.784135 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:18.785564 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:18.795069 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:18.795764 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:18.796241 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:18.797204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:18.797767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:18.798227 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:18.965569 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:18.974617 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8779f9de-5502-4b1d-862d-80fbef0d08fa tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.194586 Sep 23 05:06:18.975429 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3772/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:18 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:19.999481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:20.000844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:20.008130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:20.008619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:20.009058 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:20.009878 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:20.010337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:20.010766 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:20.160989 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:20.171311 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d066fd80-f9b1-45db-ae40-7cd971895dff tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.176058 Sep 23 05:06:20.171939 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3838/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:19 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:21.196248 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:21.196883 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:21.205255 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:21.206099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:21.206782 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:21.207765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:21.208353 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:21.208877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:21.359007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:21.368339 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-212762ca-ad86-4265-94ce-0faa0e057f0c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.175997 Sep 23 05:06:21.373393 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3773/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:21 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:22.392306 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:22.392872 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:22.403583 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:22.404443 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:22.404952 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:22.406294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:22.406889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:22.407366 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:22.579639 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:22.587798 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-abd7ac64-8f95-4bae-9a4b-587c61cc7389 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.199494 Sep 23 05:06:22.588572 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3839/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:22 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:23.612058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:23.612681 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:23.620010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:23.620513 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:23.620975 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:23.621763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:23.622345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:23.622840 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:23.788437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:23.799641 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b9bfa295-0841-400c-913d-df0d676a1ffd tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.192054 Sep 23 05:06:23.800865 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3774/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:23 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:24.826004 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:24.826420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:24.833257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:24.833790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:24.834228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:24.835066 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:24.835369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:24.836010 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:24.987424 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:24.997968 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c191bdd8-d84c-4866-b0f6-c48978ebddaf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1698 microversion: 2.1 time: 0.176220 Sep 23 05:06:24.998568 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3840/7614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:24 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:26.025230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:26.026010 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:26.035157 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:26.035662 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:26.036119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:26.036838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:26.037396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:26.037846 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:26.211389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:26.219837 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d2bfcdc5-8453-47ba-a7cb-578d1ad01dfe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1680 microversion: 2.1 time: 0.199599 Sep 23 05:06:26.220538 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3775/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:26 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:27.244084 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:27.244721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:27.252119 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:27.252608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:27.253056 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:27.253786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:27.254248 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:27.254681 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:27.386546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:27.394515 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-23b80bed-755a-4e96-ab27-6e8e2bc89632 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1680 microversion: 2.1 time: 0.154568 Sep 23 05:06:27.395094 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3841/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:27 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:28.421401 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:28.422428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:28.432072 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.432754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.433251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.434036 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.434538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.434977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.575643 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:28.584553 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6d56c856-206f-48ee-ba73-522e4265ab93 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1683 microversion: 2.1 time: 0.167209 Sep 23 05:06:28.585139 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3776/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:28 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:28.607238 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:28.607873 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:28.615405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.615886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.616321 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.617014 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.617505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.617939 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.660779 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128724) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 05:06:28.730648 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-90022921-09bc-4721-a307-69e0b6b9b764 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0/action" status: 202 len: 0 microversion: 2.1 time: 0.127220 Sep 23 05:06:28.731286 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3842/7618] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:06:28 2022] POST /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:06:28.739483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:28.740119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:28.746088 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.746597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.747066 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.747788 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.748268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.748722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.881169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:28.889199 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6cdd3a7c-43aa-496f-9a03-1f771d08676b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1631 microversion: 2.1 time: 0.153630 Sep 23 05:06:28.889831 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3777/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:28 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1631 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:29.914949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:29.915575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:29.922316 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:29.922808 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:29.923256 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:29.924215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:29.924692 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:29.925676 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:30.058390 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:30.066892 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c712b5c2-0f35-4c85-bd72-dde9481e35b5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.156617 Sep 23 05:06:30.067408 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3843/7620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:29 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:30.431183 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "name": "network-vif-unplugged", "status": "completed", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:30.446621 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:30.447120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:30.447570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:30.464118 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] Creating event network-vif-unplugged:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h2-858495-2 Sep 23 05:06:30.469489 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] [1fe0ee23-cfbb-4bf7-b290-0b857fbbaaa0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:06:31.090575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:31.093818 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:31.101710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.102194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.102876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.103795 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.104249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.104859 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.111249 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:31.308502 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:31.316779 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3c6f7d96-cfa2-45f3-bb7f-020c943606f2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.230351 Sep 23 05:06:31.317384 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3844/7621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:31 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:31.388683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:31.400268 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.400750 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.401184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.415642 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] Creating event network-changed:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h2-858495-2 Sep 23 05:06:31.422644 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-8466acd9-8dcf-449b-aafd-4fe99267e3dd req-455fcc30-5939-49b4-86db-d21f68e0e571 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036537 Sep 23 05:06:31.423270 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3845/7622] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:06:31.476744 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] [1fe0ee23-cfbb-4bf7-b290-0b857fbbaaa0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56082. Sep 23 05:06:31.481313 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5e822331-3f2b-48bb-ae9b-950283fb4cc2 req-e516bf45-420c-4319-882c-ecb655000cce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.054477 Sep 23 05:06:31.482344 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3778/7623] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:32.342086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:32.344087 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:32.352953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.354009 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.354800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:32.355789 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.356827 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.357772 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:32.581200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:32.589956 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea5dd324-463d-47d7-96ce-a8899ad97887 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.253573 Sep 23 05:06:32.606075 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3846/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:32 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:33.615475 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:33.616244 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:33.618266 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=29 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:33.625219 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:33.625767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:33.626230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:33.626994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:33.627481 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:33.628117 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:33.632096 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=81 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:33.775110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:33.785326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4517aa4c-6bf9-496e-a9e1-abc4a9dd03c4 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.174881 Sep 23 05:06:33.786137 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3779/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:33 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:34.809003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:34.809641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:34.811871 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:34.817645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:34.818174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:34.818628 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:34.819347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:34.819815 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:34.820257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:34.980076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:34.988094 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e654fde4-4d5a-4ffc-ba2a-add66fa74a83 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.183159 Sep 23 05:06:34.988669 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3847/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:34 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:36.010888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:36.012384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:36.019835 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.020485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.021020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.021857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.022429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.022964 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.172126 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:36.180851 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4ecb2dad-7b3a-4d1f-b712-cb413a6ddb6a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.174202 Sep 23 05:06:36.181770 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3780/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:36 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:37.209887 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:37.210622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:37.218228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:37.218810 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:37.219325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:37.220114 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:37.220662 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:37.221164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:37.361290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:37.369376 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ba215619-d275-4968-b5d3-002272bcbfd3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.163357 Sep 23 05:06:37.370071 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3848/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:37 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:38.392806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:38.394155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:38.412204 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:38.412729 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:38.413418 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:38.414346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:38.414996 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:38.415644 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:38.556335 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:38.564723 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-34671814-0907-4343-8e48-e19b514aef26 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.176225 Sep 23 05:06:38.565332 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3781/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:38 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:39.589074 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:39.589739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:39.597934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:39.598523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:39.599037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:39.599822 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:39.600358 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:39.600861 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:39.761206 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:39.770308 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-7612d151-1676-4f2d-9f94-48a1fcf4d844 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.184969 Sep 23 05:06:39.771949 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3849/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:39 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:40.795058 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:40.795694 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:40.805760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:40.806261 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:40.806714 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:40.807460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:40.807941 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:40.808387 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:40.940378 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:40.948203 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-247af390-8ee5-4344-ad3e-755b97e48acb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.157127 Sep 23 05:06:40.948786 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3782/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:40 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:41.971619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:41.972226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:41.979097 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:41.979582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:41.980015 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:41.980705 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:41.981159 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:41.981619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:42.114354 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:42.124365 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47170777-c693-4259-8266-52716097bd9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.156660 Sep 23 05:06:42.125525 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3850/7632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:41 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:43.148460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:43.149049 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:43.155923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.156429 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.156893 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.157629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.158108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.158559 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.287362 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:43.295273 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-31895084-d0fa-4aee-9b6a-0357a327f758 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.150998 Sep 23 05:06:43.295873 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3783/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:43 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:44.319607 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:44.320297 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:44.327038 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:44.327527 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:44.328626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:44.329334 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:44.329832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:44.330264 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:44.464511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:44.472462 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d3821cbf-b45b-4754-8e14-81de3b20f01b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.156870 Sep 23 05:06:44.473038 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3851/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:44 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:45.496071 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:45.496709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:45.504386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:45.504897 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:45.505381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:45.506120 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:45.506598 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:45.507050 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:45.643606 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:45.651408 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c0fb63de-9eb3-45d1-a6b1-e81029f6c88a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.159308 Sep 23 05:06:45.651987 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3784/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:45 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:46.675174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:46.675788 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:46.682702 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.683188 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.683625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.684318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.684800 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.685234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.823624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:46.831902 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5b0c4960-a239-429b-a894-338085b1e7da tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.160971 Sep 23 05:06:46.832478 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3852/7636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:46 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:47.856099 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:47.856734 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:47.865315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:47.865315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:47.865315 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:47.866115 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:47.866586 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:47.867030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:48.014837 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:48.023052 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b6338875-7dc5-4bc6-b5dd-1217dd5f20a7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.170934 Sep 23 05:06:48.023646 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3785/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:47 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:49.049374 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:49.049932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:49.056762 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:49.057246 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:49.057724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:49.058421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:49.058876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:49.059687 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:49.192417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:49.200318 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-dc6394b5-5698-49e7-b5f5-dbc76303609c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.156096 Sep 23 05:06:49.200897 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3853/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:49 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:49.247589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "name": "network-vif-plugged", "status": "completed", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:49.259254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:49.259763 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:49.260224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:49.271577 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] Creating event network-vif-plugged:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h2-858495-2 Sep 23 05:06:49.276621 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-a379c0d1-f494-41d1-8034-fedfde7362a1 req-52640893-a367-43a8-9f0c-e449643ccf07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Sep 23 05:06:49.277282 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3786/7639] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:50.224665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:50.225220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:50.232205 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:50.232714 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:50.233150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:50.233888 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:50.234962 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:50.235403 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:50.369275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:50.377082 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1ab6ec69-9c8b-47f4-babf-3a54d6e60bde tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.156490 Sep 23 05:06:50.377685 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3854/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:50 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:51.401679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:51.402359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:51.408638 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:51.409142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:51.409627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:51.410342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:51.410821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:51.411271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:51.548733 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:51.557143 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-66aa8046-e0c1-40d1-96f3-c82489984d43 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1689 microversion: 2.1 time: 0.160812 Sep 23 05:06:51.557772 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3787/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:51 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:52.580816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:52.581475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:52.588484 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:52.588984 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:52.589459 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:52.590174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:52.590643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:52.591082 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:52.725860 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:52.733704 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-29098eab-3f79-478b-b693-515077428192 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1676 microversion: 2.1 time: 0.157509 Sep 23 05:06:52.734963 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3855/7642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:52 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:29.502034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=17 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:29.502831 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=49 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:29.506301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=17 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:29.507106 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=66 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:29.508159 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:08:29.508302 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 05:08:29.510873 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:08:29.511024 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 (ip 10.222.0.25) !!! Sep 23 05:08:29.512016 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:08:29.512136 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 (ip 10.222.0.25) !!! Sep 23 05:08:29.516622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:29.517144 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:29.536327 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:29.536845 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:29.537548 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:29.538282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:29.538973 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:29.539428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:29.570838 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:08:29.659453 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-57b13bd7-0e12-4fef-a03a-16feaf0bf74f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 204 len: 0 microversion: 2.1 time: 0.159884 Sep 23 05:08:29.660578 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3788/7643] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:08:29 2022] DELETE /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:08:29.662227 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:29.670532 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:29.671309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:29.673619 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:29.674138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:29.674574 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:29.679081 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:29.679247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:29.679666 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:29.680442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:29.681012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:29.681373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:29.686663 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] Creating event network-changed:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h2-858495-2 Sep 23 05:08:29.692562 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-46d3504e-3e46-4a27-bc17-67d6ea24331b req-fb4d64b4-2bf5-4f47-963a-f7d16cb50191 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187973 Sep 23 05:08:29.693185 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3856/7644] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:29.891163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:29.898960 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-fcaaf31c-0e81-499d-a658-f6811531be78 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.233146 Sep 23 05:08:29.899548 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3789/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:29 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:30.923793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:30.924504 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:30.930934 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:30.931420 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:30.931863 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:30.932559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:30.933022 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:30.933491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:31.192215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:31.203289 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b05daf16-244e-4adb-91dc-e455613eb360 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 200 len: 1682 microversion: 2.1 time: 0.284674 Sep 23 05:08:31.233912 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3857/7646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:30 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 1682 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:31.707412 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c5fada-1025-4943-82e0-13a67d8a9fa0", "name": "network-vif-deleted", "tag": "4dd72610-5591-4659-9904-9ff0a4be5e44"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:31.717929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:31.718437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:31.719422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:31.730438 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] Creating event network-vif-deleted:4dd72610-5591-4659-9904-9ff0a4be5e44 for instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 on n-h2-858495-2 Sep 23 05:08:31.736311 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2093357c-75a4-4b8c-8388-b3728a212dc8 req-59f2f2af-a35a-4797-9029-1ae662bff40a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032682 Sep 23 05:08:31.736914 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3790/7647] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:32.232018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:32.232582 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: d6c5fada-1025-4943-82e0-13a67d8a9fa0] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:32.239500 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:32.240000 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:32.240465 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:32.241156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:32.241654 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:32.242357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:32.255980 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] HTTP exception thrown: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Request method failure captured: Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 HTTP/1.1 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLT4yyWabkuEed3AHTOpHWnzEzfdJvSWa8k6T6Ug5ipxGDmU3xdt_CO82gTTDoQhuFBOfg8fVgP8Nq9CC9ZXHlP3Yccaq15yuxReuEC63TXjOIpGkEkybc_GOtHPtYw9N8R-ktzUG6A94urEwaSJeAO6-Go9tXi7wR--Xgii_FOl-Fjg Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9436dc1ef75246599f88d41f7db05b0c Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestShelveInstance-1318151240 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestShelveInstance-1318151240 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9436dc1ef75246599f88d41f7db05b0c Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestShelveInstance-1318151240 Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestShelveInstance-1318151240-project Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 79c1314082e24918a6e7950bab5ed2cb Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestShelveInstance-1318151240-project Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'd6c5fada-1025-4943-82e0-13a67d8a9fa0'} Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:08:32.257690 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Returning 404 to user: Instance d6c5fada-1025-4943-82e0-13a67d8a9fa0 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c4a2508f-091c-4ee6-ae67-d85440bbdaf7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0" status: 404 len: 111 microversion: 2.1 time: 0.031146 Sep 23 05:08:32.262053 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3858/7648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:32 2022] GET /compute/v2.1/servers/d6c5fada-1025-4943-82e0-13a67d8a9fa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:08:32.426235 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d65630c-23ea-4db2-9a8a-e367e98bc86e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '.version_select at 0x7f0c8ab14f70>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:32.452826 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d65630c-23ea-4db2-9a8a-e367e98bc86e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1221520432" status: 202 len: 0 microversion: 2.1 time: 0.031588 Sep 23 05:08:32.453370 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3791/7649] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Sep 23 05:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1221520432 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:08:32.472536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f7b71d15-812e-4a47-bfd6-7ac5cbe0aeb5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'create', calling method: .version_select at 0x7f0c8b8a1d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-778483917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBieASN2X+ySGDdrM1CI4Ydm+oo122YcDszjYE0Azg4GV+Uj14CWr0JYjWSJLSr23V+PMtef/fdm/Yff8gFVPiqATAZMpL6s5wtjXdpW+nq8MkD8+hmfJdd1Oh2K7T2img=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:32.488126 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f7b71d15-812e-4a47-bfd6-7ac5cbe0aeb5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:08:32.493187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-f7b71d15-812e-4a47-bfd6-7ac5cbe0aeb5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for user 79c1314082e24918a6e7950bab5ed2cb and project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:08:32.520559 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f7b71d15-812e-4a47-bfd6-7ac5cbe0aeb5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052045 Sep 23 05:08:32.521169 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3859/7650] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 05:08:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:48.681786 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:48.682538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:48.686685 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1610072605", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-778483917", "security_groups": [{"name": "tempest-secgroup-smoke-849430275"}], "networks": [{"uuid": "1f5de08b-94c8-4490-ada1-57c3176e9f94"}], "block_device_mapping_v2": [{"uuid": "148ae6f2-3727-442b-84c1-b38b03e63896", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:48.809815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] validate_networks() for [('1f5de08b-94c8-4490-ada1-57c3176e9f94', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:08:49.228722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:08:49.229170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:08:49.229703 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:08:49.230134 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:08:49.230591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:08:49.240051 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.240485 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.240942 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.241754 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.242231 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.242677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.259968 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:08:49.265228 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Getting quotas for user 79c1314082e24918a6e7950bab5ed2cb and project 9436dc1ef75246599f88d41f7db05b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:08:49.322572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:08:49.325079 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='148ae6f2-3727-442b-84c1-b38b03e63896',volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:08:49.453782 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-81c12474-3ce9-452c-9864-6421ed15d4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773731 Sep 23 05:08:49.454449 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3792/7651] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:08:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:08:49.464274 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=10 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:49.465160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=4 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:49.466347 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:49.472690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8c43a497-7d68-4724-a1f6-262d2e397dbe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:49.474535 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8c43a497-7d68-4724-a1f6-262d2e397dbe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:49.535193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8c43a497-7d68-4724-a1f6-262d2e397dbe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:49.542282 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8c43a497-7d68-4724-a1f6-262d2e397dbe tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1088 microversion: 2.1 time: 0.080535 Sep 23 05:08:49.542850 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3860/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:49 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:50.568849 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:50.570013 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:50.580053 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:50.580765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:50.581552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:50.583003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:50.584057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:50.584815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:50.671998 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:50.680197 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7c2f67cc-5c27-45e7-adb1-392f3de53a9d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1204 microversion: 2.1 time: 0.118528 Sep 23 05:08:50.680998 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3793/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:50 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:51.763037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:51.764006 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:51.770876 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:51.771833 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:51.772351 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:51.773324 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:51.774293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:51.774838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.227485 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:52.238948 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4bb94e1b-f2e1-4150-8bf4-e753625c0ec9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1271 microversion: 2.1 time: 0.538811 Sep 23 05:08:52.240778 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3861/7654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:51 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1271 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:52.455291 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:52.466030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.466977 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.468309 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.482309 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] Creating event network-changed:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:08:52.487958 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-10948f9c-041b-412a-8a2d-ae89cd56f3d9 req-ce7485de-a04e-4cf5-9b01-9aedafeabb34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110207 Sep 23 05:08:52.488675 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3794/7655] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:53.263117 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:53.263993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:53.270229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.270718 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.271160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.271864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.272337 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.272756 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.438698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:53.446851 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-f695a9c3-51fc-431c-89af-efe4ff89ae38 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1271 microversion: 2.1 time: 0.188622 Sep 23 05:08:53.447435 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3862/7656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:53 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:54.470276 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:54.471020 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:54.478155 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.478679 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.479154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:54.479905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.480395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.480855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:54.628181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:54.636613 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d2cc935-da6b-475c-8b47-450dbc245539 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1271 microversion: 2.1 time: 0.171688 Sep 23 05:08:54.637241 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3795/7657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:54 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:55.659672 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:55.660226 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.666970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.667453 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.667892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.668584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.669037 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.669585 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.803918 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:55.811818 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e591bc73-da66-479f-91bc-5ace64d8bee8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.156135 Sep 23 05:08:55.813054 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3863/7658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:55 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:56.835436 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:56.836046 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:56.842915 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.843983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.844443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.845147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.845654 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.846101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.975857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:56.983579 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3fd77787-1980-4905-a370-f7684ea812e1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.152192 Sep 23 05:08:56.984157 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3796/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:56 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:58.005910 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:58.006567 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:58.013372 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.013870 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.014309 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.015005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.015464 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.015897 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.145073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:58.152847 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4a6a1531-976a-4bfc-ae81-4c3423a97218 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.150856 Sep 23 05:08:58.153443 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3864/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:58 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:59.176256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:59.176892 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:59.184043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.184577 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.185211 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.185965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.186443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.186894 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.250310 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:59.273437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:59.321422 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:59.330729 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e73f2b1f-ef8e-467d-ba99-71786347694c tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.158446 Sep 23 05:08:59.331585 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3797/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:59 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:00.353771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:00.354391 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:00.357160 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:00.363107 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.363599 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.364045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.364749 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.365207 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.365683 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.495883 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:00.503785 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e70d643b-c804-46a5-bfb4-245a54ae0019 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.153983 Sep 23 05:09:00.504359 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3865/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:00 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:01.527057 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:01.527688 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:01.534628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:01.535124 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:01.535571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.536277 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:01.536751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:01.537193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.680133 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:01.688063 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-6b08892b-ce7b-4494-b20b-7bcc705a48b7 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.164971 Sep 23 05:09:01.688657 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3798/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:01 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:02.710220 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.710768 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.717771 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.718914 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.719369 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.720076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.720542 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.720978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.849823 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:02.857682 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-df9f146b-2779-497f-9197-57a9befe1ae8 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.151438 Sep 23 05:09:02.858260 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3866/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:03.880285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:03.880950 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:03.887863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.888415 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.888876 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.889616 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.890093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.890546 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.023882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:04.034036 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-89188a39-cacd-40bb-926c-f5bd8028e3bf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.157459 Sep 23 05:09:04.034809 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3799/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:03 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:05.058325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:05.058975 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:05.064991 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.065522 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.065970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.066679 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.067141 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.067576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.178762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "name": "network-vif-plugged", "status": "completed", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:05.189677 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.190179 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.190622 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.201684 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] Creating event network-vif-plugged:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:09:05.207645 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-dce0cca0-d5db-4491-8717-a2a9fa0bc509 req-a3efe346-791f-48b1-b4fb-e35eb18d73d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094821 Sep 23 05:09:05.208456 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3800/7666] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:09:05.211178 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:05.219731 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3cf5a993-3c0f-4973-b0c8-21c17de12a8e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.165689 Sep 23 05:09:05.220317 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3867/7667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:05 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:06.243286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:06.244014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:06.250450 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.250946 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.251396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.252098 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.252567 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.253108 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.391025 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:06.400409 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-7d8a736c-c0d4-4eaf-b7d7-308401d89ae6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1259 microversion: 2.1 time: 0.161632 Sep 23 05:09:06.401012 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3801/7668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:06 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:07.424253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:07.424778 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:07.432018 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.432503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.432980 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.433707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.434170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.434603 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.566634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:07.574474 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5909a75-9697-4762-b00c-fbe926bc6b73 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1444 microversion: 2.1 time: 0.154782 Sep 23 05:09:07.575055 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3868/7669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:07 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:07.597110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:07.597780 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:07.604798 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.605308 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.605808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.606531 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.607043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.607497 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.741932 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:07.749917 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a3ac71c4-bb54-42b2-96b1-cc73fd308f3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1444 microversion: 2.1 time: 0.157467 Sep 23 05:09:07.750496 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3802/7670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:07 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:09.331483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:09.342147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.342631 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.343566 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.354550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] Creating event network-changed:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:09:09.360317 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-865b9bfe-570a-4ce0-9c48-ef571fe9d879 req-ef0ffeb8-31e0-4325-a9d1-253d1b8c1fd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 Sep 23 05:09:09.360973 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3869/7671] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:11:05.498725 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:05.499495 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=54 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:05.505009 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:05.505584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:05.513012 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.513636 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.514093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.514802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.515270 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.515712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.540516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lazy-loading 'flavor' on Instance uuid 75a127a2-b883-452a-b754-be18e315c380 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:11:05.612752 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-50f21008-a797-466e-8d03-6d89b575b625 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380/action" status: 202 len: 0 microversion: 2.1 time: 0.115852 Sep 23 05:11:05.613312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3803/7672] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:11:05 2022] POST /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:11:05.619686 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:11:05.620511 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:11:05.621165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=22 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:05.622055 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=50 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:05.623176 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:11:05.623176 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 (ip 10.222.0.25) !!! Sep 23 05:11:05.629730 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:05.630531 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:05.638476 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.638970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.639417 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.640122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.640590 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.641027 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.777546 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:05.785315 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e165a042-0869-4f39-8368-759e7146ab09 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.167577 Sep 23 05:11:05.785983 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3870/7673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:05 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:06.807560 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:11:06.808401 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:11:06.812299 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:06.813035 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:06.821158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:06.821699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:06.822167 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:06.822882 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:06.823499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:06.823927 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:07.036177 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:07.044221 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d0b6451f-1ff7-4313-9581-141fa879f1e5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.238163 Sep 23 05:11:07.044851 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3804/7674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:06 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:08.068235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:08.068820 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:08.080046 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:08.080558 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:08.081003 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:08.081735 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:08.082194 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:08.082624 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:08.089174 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56504. Sep 23 05:11:08.101125 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56506. Sep 23 05:11:08.216700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:08.225180 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-66964449-d194-48d5-9f92-024f191a2daf tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.160909 Sep 23 05:11:08.225801 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3871/7675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:08 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:09.248334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:09.248980 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:09.259523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.260037 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.260501 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.261226 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.261742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.262191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.268541 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56510. Sep 23 05:11:09.281785 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56512. Sep 23 05:11:09.399772 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:09.407708 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2e6fd00c-1a4f-4e89-aacb-2aec81eedf62 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.163341 Sep 23 05:11:09.408299 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3805/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:09 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:10.431608 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:10.432258 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:10.439042 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:10.439529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:10.439969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:10.440665 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:10.441128 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:10.441660 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:10.569892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:10.577721 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1403c344-cafd-4caa-82f3-ce477d57f499 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.150031 Sep 23 05:11:10.578301 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3872/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:10 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:11.602147 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:11.602795 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:11.609821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:11.610333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:11.610797 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:11.611516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:11.612006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:11.612451 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:11.745043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:11.752994 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b2f0ea34-ac49-42b1-8041-784e10f25ee6 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.154890 Sep 23 05:11:11.753696 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3806/7678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:11 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:12.776757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:12.777302 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:12.784179 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:12.784673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:12.785121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:12.786475 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:12.786953 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:12.787393 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:12.916047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:12.923922 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-a5951d3a-7f91-4b4e-9d91-b1e8505f6bf0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.151217 Sep 23 05:11:12.924506 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3873/7679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:12 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:13.948437 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:13.949075 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:13.956030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:13.956533 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:13.956990 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:13.958370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:13.958852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:13.959304 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:14.088771 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:14.096769 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-908b1708-3f17-479e-b4c1-ef5179bca078 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.152280 Sep 23 05:11:14.097377 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3807/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:13 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:15.119927 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:15.120611 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:15.127375 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:15.127864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:15.128326 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:15.129007 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:15.129552 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:15.130634 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:15.264296 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:15.272267 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fe5b9db4-99e9-49af-a794-b7f68fe85713 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.156343 Sep 23 05:11:15.273404 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3874/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:15 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:16.301570 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:16.302214 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:16.309265 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:16.309818 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:16.310282 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:16.311006 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:16.311488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:16.311945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:16.443130 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:16.450992 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f13e447d-87d0-4861-9302-88a2aea4d585 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.154531 Sep 23 05:11:16.451574 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3808/7682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:16 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:17.474612 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:17.475257 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:17.482193 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:17.482682 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:17.483124 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:17.483828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:17.484301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:17.484736 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:17.619837 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:17.627716 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6def0596-553d-43fc-b94e-879d7693dbbb tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.157676 Sep 23 05:11:17.628290 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3875/7683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:17 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:18.650550 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:18.651189 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:18.658470 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:18.658982 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:18.659446 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:18.660170 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:18.660683 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:18.663094 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:18.799443 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:18.808485 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-87c66aee-3b54-4438-b4ad-172c0fe87696 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.161943 Sep 23 05:11:18.809073 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3809/7684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:18 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:19.832211 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:19.832886 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:19.840204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:19.840703 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:19.841150 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:19.842076 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:19.842547 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:19.842993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:19.988481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:19.997179 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c8b49d63-f49e-421c-a7cf-fdac849e75c0 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1569 microversion: 2.1 time: 0.168858 Sep 23 05:11:19.997845 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3876/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:19 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:20.019516 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:20.020256 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:20.027158 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:20.027673 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:20.028217 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:20.028965 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:20.029469 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:20.029922 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:20.075488 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 05:11:20.148075 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-ac97d089-7fe3-4577-89bf-172b1a1fbf6e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "POST /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380/action" status: 202 len: 0 microversion: 2.1 time: 0.132531 Sep 23 05:11:20.148720 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3810/7686] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:11:20 2022] POST /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:11:20.156889 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:20.157543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:20.164080 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:20.164572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:20.165215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:20.165959 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:20.166431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:20.166869 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:20.336667 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:20.346717 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-21e8a240-dd98-4b73-ad1c-36d7c167df44 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1517 microversion: 2.1 time: 0.193590 Sep 23 05:11:20.348014 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3877/7687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:20 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:21.372510 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:21.373294 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:21.380129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:21.380704 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:21.381163 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:21.381900 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:21.382376 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:21.382822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:21.522460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:21.531300 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-9d4de74b-4dfc-4f57-81c7-48e3c44998b2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1519 microversion: 2.1 time: 0.163563 Sep 23 05:11:21.532086 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3811/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:21 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:21.773620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "name": "network-vif-unplugged", "status": "completed", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:21.785467 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:21.787491 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:21.788024 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:21.801858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.compute.server_external_events [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] Unable to find a host for instance 75a127a2-b883-452a-b754-be18e315c380. Dropping event network-vif-unplugged {{(pid=128724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 05:11:21.802765 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-61af01e6-bd3b-475f-a190-5f0a8457a37a req-76fc28d8-0990-4e34-9741-fe4af6f8c3db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033983 Sep 23 05:11:21.803524 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3878/7689] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 05:11:22.556910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:22.557575 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:22.564494 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:22.564997 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:22.565477 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:22.566198 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:22.566672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:22.567718 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:22.705765 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:22.714179 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-94a91c66-1386-4ac2-a892-557065ebd7c2 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1519 microversion: 2.1 time: 0.161314 Sep 23 05:11:22.714905 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3812/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:22 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:23.737569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:23.738122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:23.746278 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:23.746993 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:23.747630 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:23.748638 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:23.749261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:23.749726 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:23.889079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:23.898095 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1c1b7743-9400-44c2-bb24-6edd8d310a64 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1519 microversion: 2.1 time: 0.164481 Sep 23 05:11:23.898710 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3879/7691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:23 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:24.922150 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:24.922796 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:24.930593 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:24.931093 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:24.931571 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:24.932333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:24.932803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:24.933247 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:25.070268 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:25.078208 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-a1c3255a-054e-44e5-80f6-eea679041a69 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1519 microversion: 2.1 time: 0.159993 Sep 23 05:11:25.078797 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3813/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:24 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:26.101710 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:26.102275 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:26.109180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:26.109707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:26.110153 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:26.110858 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:26.111318 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:26.111748 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:26.325285 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:26.333617 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-10d4fda8-dde6-4f58-86b3-6f748a4ef195 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.235843 Sep 23 05:11:26.334197 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3880/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:26 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:27.357989 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:27.358617 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:27.365670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:27.366171 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:27.366625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:27.367334 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:27.367806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:27.368251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:27.497896 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:27.506342 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-58f36fbd-73a7-4de3-966b-6c8fdecf958f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.152334 Sep 23 05:11:27.506932 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3814/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:27 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:28.529721 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:28.530341 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:28.537253 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:28.537769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:28.538212 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:28.538902 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:28.539357 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:28.539784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:28.667344 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:28.675121 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-4b96d549-dbe4-4997-8254-477c43608097 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.149404 Sep 23 05:11:28.675702 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3881/7695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:28 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:29.699229 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:29.699864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:29.706969 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:29.707472 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:29.707934 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:29.708649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:29.709129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:29.709609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:29.843699 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:29.852728 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-95fdc26a-2067-4776-ad79-281db3ceb4b1 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.157426 Sep 23 05:11:29.853331 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3815/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:29 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:30.876217 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:30.876740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:30.883593 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:30.884079 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:30.884526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:30.885208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:30.885691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:30.886121 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:31.015506 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:31.023976 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8eeabd81-6132-42ff-8c44-b4b66473e86b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.151702 Sep 23 05:11:31.024558 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3882/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:30 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:32.047246 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:32.047886 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:32.055828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:32.056333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:32.056794 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:32.057552 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:32.058034 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:32.058486 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:32.079933 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:32.195629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:32.203659 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-2fec15bc-8a24-42a0-a73c-9417121763f3 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.160322 Sep 23 05:11:32.204272 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3816/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:32 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:33.227343 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:33.227965 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:33.234757 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:33.235245 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:33.235691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:33.236386 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:33.236850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:33.237315 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:33.368045 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:33.375812 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1a2d4e6f-beab-4db2-9087-b21aa0839c9f tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.152482 Sep 23 05:11:33.376403 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3883/7699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:33 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:34.400263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:34.400910 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:34.407815 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:34.408324 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:34.408781 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:34.409538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:34.410014 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:34.410466 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:34.545627 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:34.553884 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-f6a1b350-377a-4d9d-9d9b-db08b5bb41db tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.158131 Sep 23 05:11:34.554485 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3817/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:34 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:35.576930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:35.577579 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:35.584303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:35.584784 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:35.585223 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:35.585942 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:35.586401 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:35.586828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:35.716972 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:35.719263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=85 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:35.727353 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-59c75da0-b240-483a-91ad-1430cc1db810 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.154392 Sep 23 05:11:35.727978 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3884/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:35 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:35.947738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "name": "network-vif-plugged", "status": "completed", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:35.954346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:35.962007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:35.962517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:35.962981 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:35.975358 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] Creating event network-vif-plugged:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:11:35.981012 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-46dab6ff-f5d9-40d2-a073-c58bd3056186 req-8cc0acae-cad7-4313-8b41-d81ecd903e89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Sep 23 05:11:35.981819 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3818/7702] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:11:36.752700 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:36.753230 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:36.756494 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=31 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:36.762167 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:36.762656 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:36.763099 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:36.763796 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:36.764282 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:36.764719 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:36.895868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:36.903671 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-47c5d3e2-0f5f-4585-8510-4514485a440d tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1575 microversion: 2.1 time: 0.155571 Sep 23 05:11:36.904245 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3885/7703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:36 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:37.927713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:37.928434 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:37.935747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:37.936242 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:37.936697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:37.937428 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:37.937901 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:37.938346 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:38.068474 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:38.076319 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-be1ba239-2135-491b-a22f-4e84419280d9 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1562 microversion: 2.1 time: 0.153133 Sep 23 05:11:38.076895 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3819/7704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:37 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:54.382130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:54.383367 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:54.384013 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=7 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:54.384357 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=16 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:54.384893 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:12:54.385150 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 (ip 10.222.0.25) !!! Sep 23 05:12:54.385305 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:12:54.385462 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 05:12:54.386417 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:12:54.386537 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 (ip 10.222.0.25) !!! Sep 23 05:12:54.393658 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:54.394168 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:54.397579 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:54.402632 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:54.403133 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:54.403793 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:54.404511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:54.404970 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:54.405622 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:54.420737 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:54.421584 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:54.422042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:54.435706 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] Creating event network-changed:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:12:54.441142 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-89dd168f-cd64-4453-b2fd-158cd5a1e450 req-9ad0b3ca-f6de-44bc-9829-a4047459faa2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059827 Sep 23 05:12:54.441838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:12:54.442167 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3820/7705] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:12:54.538653 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e4ad83d6-aceb-4581-8fba-1b8de5c2271a tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 204 len: 0 microversion: 2.1 time: 0.158612 Sep 23 05:12:54.543612 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3886/7706] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:12:54 2022] DELETE /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:12:54.550285 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:54.551110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:54.559038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:54.559670 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:54.560205 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:54.561043 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:54.561628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:54.562139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:54.722759 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:54.730430 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-5bca7a63-cafe-4742-aa76-55808334facc tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.185408 Sep 23 05:12:54.731227 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3821/7707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:54 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:12:55.753543 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:55.754260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:55.761727 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:55.762218 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:55.762663 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:55.763666 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:55.764135 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:55.764569 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:56.343512 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:56.359697 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-36cf11fe-aef8-4e4d-9266-918364505dca tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1568 microversion: 2.1 time: 0.610348 Sep 23 05:12:56.379142 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3887/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:55 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1568 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:56.628139 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a127a2-b883-452a-b754-be18e315c380", "name": "network-vif-deleted", "tag": "dfce9e34-40a3-48eb-95b4-84e47d889910"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:56.640756 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:56.641440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:56.641872 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:56.654308 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] Creating event network-vif-deleted:dfce9e34-40a3-48eb-95b4-84e47d889910 for instance 75a127a2-b883-452a-b754-be18e315c380 on n-h1-858495-2 Sep 23 05:12:56.659486 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-965fc3bc-9017-44aa-8bc5-a36311856446 req-0265177d-ec7c-4f80-a05a-1fd31c7acf0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Sep 23 05:12:56.660145 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3822/7709] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:57.386957 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:57.387584 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:57.394520 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:57.395047 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:57.395493 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:57.396208 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:57.396724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:57.397164 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:57.467232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:57.478410 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ff0576f8-95f6-4941-b493-701d6f1cb3ee tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1219 microversion: 2.1 time: 0.094981 Sep 23 05:12:57.479517 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3888/7710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:57 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:58.504684 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:58.505431 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:58.512502 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:58.513000 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:58.513483 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:58.514191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:58.514664 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:58.515109 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:58.577669 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:58.586219 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d21c4c48-e9e2-417a-bc1f-f81f386a8b3e tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1219 microversion: 2.1 time: 0.085770 Sep 23 05:12:58.586839 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3823/7711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:58 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:59.609901 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:59.610526 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:59.618103 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:59.618591 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:59.619032 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:59.619734 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:59.620198 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:59.620644 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:59.686868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:59.694953 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3b967651-bc80-4d08-bacb-1fc6df92514b tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1219 microversion: 2.1 time: 0.088911 Sep 23 05:12:59.695557 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3889/7712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:59 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:00.718373 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:00.718993 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:00.726769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:00.727364 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:00.727713 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:00.728432 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:00.728904 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:00.729384 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:00.799448 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c1314082e24918a6e7950bab5ed2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9436dc1ef75246599f88d41f7db05b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:00.809513 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-0b3eaf74-12a3-4e80-a678-e1ee5d3cf0c5 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 200 len: 1219 microversion: 2.1 time: 0.094970 Sep 23 05:13:00.810146 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3824/7713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:00 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:01.832405 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:01.832947 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] [instance: 75a127a2-b883-452a-b754-be18e315c380] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:01.839969 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:01.840451 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:01.840890 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:01.841609 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:01.842068 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:01.842496 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:01.856490 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] HTTP exception thrown: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Request method failure captured: Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 HTTP/1.1 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLT4yyWabkuEed3AHTOpHWnzEzfdJvSWa8k6T6Ug5ipxGDmU3xdt_CO82gTTDoQhuFBOfg8fVgP8Nq9CC9ZXHlP3Yccaq15yuxReuEC63TXjOIpGkEkybc_GOtHPtYw9N8R-ktzUG6A94urEwaSJeAO6-Go9tXi7wR--Xgii_FOl-Fjg Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 9436dc1ef75246599f88d41f7db05b0c Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestShelveInstance-1318151240 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9436dc1ef75246599f88d41f7db05b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestShelveInstance-1318151240 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 9436dc1ef75246599f88d41f7db05b0c Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestShelveInstance-1318151240 Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestShelveInstance-1318151240-project Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: 79c1314082e24918a6e7950bab5ed2cb Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestShelveInstance-1318151240-project Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': '75a127a2-b883-452a-b754-be18e315c380'} Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:13:01.858234 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Returning 404 to user: Instance 75a127a2-b883-452a-b754-be18e315c380 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-6e2ae4e9-724d-4fc9-9bde-68ecefe12c87 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380" status: 404 len: 111 microversion: 2.1 time: 0.031265 Sep 23 05:13:01.863560 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3890/7714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:01 2022] GET /compute/v2.1/servers/75a127a2-b883-452a-b754-be18e315c380 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:13:02.021994 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8ce790c4-4ae0-4374-b96b-41909e143f13 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] Calling method '.version_select at 0x7f0c89c76280>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:02.048323 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8ce790c4-4ae0-4374-b96b-41909e143f13 tempest-TestShelveInstance-1318151240 tempest-TestShelveInstance-1318151240-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-778483917" status: 202 len: 0 microversion: 2.1 time: 0.030726 Sep 23 05:13:02.049064 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3825/7715] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 23 05:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-778483917 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:13:19.386122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:13:19.387503 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:13:19.601423 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-86cac69b-18f2-4ba8-8263-b1191c56e235 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Action: 'create', calling method: .version_select at 0x7f0c8b0a58b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-965971728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHM9sqfq5rugWOP70sNcckiUjwKPLEwpYobvp6/LH7WLrLVKhNjPDoqRaK9sh/UNjbJTehxWWzKrvPi5w3JfGND7xpf1gRxfAJWJSzTIMuPnzH7BsfqwywwsjZTL4idpA=="}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:13:19.616896 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-86cac69b-18f2-4ba8-8263-b1191c56e235 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:13:19.622001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.quota [None req-86cac69b-18f2-4ba8-8263-b1191c56e235 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for user dcc7add552784370b4da8a63e7b041b2 and project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'key_pairs'} {{(pid=128724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:13:19.659891 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-86cac69b-18f2-4ba8-8263-b1191c56e235 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.280114 Sep 23 05:13:19.660824 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3891/7716] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 23 05:13:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:13:20.635954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-484853284", "imageRef": "e4f75334-b417-4681-8bb0-50f45fb07fda", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-965971728", "security_groups": [{"name": "tempest-secgroup-smoke-812933178"}], "networks": [{"uuid": "e3a20476-5c4c-438f-99ce-4774e1a4d100"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:13:20.645671 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=22 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:13:20.646329 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:13:20.743514 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] validate_networks() for [('e3a20476-5c4c-438f-99ce-4774e1a4d100', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:13:21.122322 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:13:21.122769 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:13:21.123269 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:13:21.123700 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:13:21.124132 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:13:21.133333 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:21.133864 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:21.134328 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:21.135077 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:21.135553 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:21.136003 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:21.152619 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:13:21.157983 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for user dcc7add552784370b4da8a63e7b041b2 and project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:13:21.171592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:13:21.174002 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e4f75334-b417-4681-8bb0-50f45fb07fda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:13:21.226784 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-3877ad89-3470-403c-b13c-ebf292128051 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.594914 Sep 23 05:13:21.227843 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3826/7717] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:13:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:13:21.239415 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b3fbbfeb-b1c7-4167-abfc-e0a463c89b36 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:21.240130 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b3fbbfeb-b1c7-4167-abfc-e0a463c89b36 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:21.309673 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b3fbbfeb-b1c7-4167-abfc-e0a463c89b36 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:21.318007 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b3fbbfeb-b1c7-4167-abfc-e0a463c89b36 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1247 microversion: 2.1 time: 0.083197 Sep 23 05:13:21.318870 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3892/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:21 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:13:22.344381 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:22.346224 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:22.353722 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:22.354561 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:22.355271 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:22.356243 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:22.356939 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:22.357629 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:22.430192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:22.439440 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c37d3973-66e6-4599-9ea8-0b7eaf581f27 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1307 microversion: 2.1 time: 0.100645 Sep 23 05:13:22.440129 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3827/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:22 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:23.463242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:23.463938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:23.475525 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:23.476116 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:23.476643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:23.477481 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:23.478339 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:23.478857 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:23.641057 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:23.650093 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-de56aaac-d5fa-42cb-b34c-f98a0a521dda tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.191401 Sep 23 05:13:23.651000 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3893/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:23 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:23.978712 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:13:23.995258 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:23.996342 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:23.996599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:24.012259 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] Creating event network-changed:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:13:24.018832 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-aefdb808-70d0-497d-9598-7b6f76bd6c1c req-3a053348-c7f0-4cec-9408-08fed18c02c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043773 Sep 23 05:13:24.019954 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3828/7721] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:13:24.675473 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:24.676089 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:24.684005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:24.684505 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:24.684949 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:24.685698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:24.686165 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:24.686641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:24.821293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:24.830619 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3ca1ac9d-19f7-4edd-adac-b445574e140d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.159161 Sep 23 05:13:24.831868 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3894/7722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:24 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:25.854007 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:25.854821 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:25.862826 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:25.863402 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:25.863863 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:25.864572 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:25.865590 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:25.866038 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:25.996785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:26.004487 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-de264d4f-f2c1-47b8-a695-c91513019633 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.154916 Sep 23 05:13:26.005066 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3829/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:25 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:27.028260 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:27.028892 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:27.035773 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:27.036263 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:27.036838 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:27.037576 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:27.038041 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:27.038534 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:27.173664 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:27.181778 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-07ce39d1-69af-439a-88a5-b50ba99b48c2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.157428 Sep 23 05:13:27.182389 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3895/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:27 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:28.205192 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:28.205830 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:28.213779 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:28.214296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:28.214751 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:28.215482 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:28.215954 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:28.216396 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:28.363650 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:28.372791 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-4326d1e4-23ee-479b-b8fa-0206d57a65f3 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.171669 Sep 23 05:13:28.373441 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3830/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:28 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:28.414290 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "name": "network-vif-plugged", "status": "completed", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:13:28.424626 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:28.425174 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:28.425769 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:28.437208 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] Creating event network-vif-plugged:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:13:28.442406 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-fcbf73a2-83a4-4213-9ad8-20a751a04f42 req-3469bd34-e130-44c1-a270-d2828e2008dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Sep 23 05:13:28.443640 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3896/7726] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:13:29.396101 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:29.396731 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:29.403641 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:29.404142 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:29.404596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:29.405305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:29.405805 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:29.406251 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:29.535873 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:29.544317 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-e27819a4-7cde-43f7-ac80-78f79a206b2f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1372 microversion: 2.1 time: 0.152155 Sep 23 05:13:29.544941 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3831/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:29 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:30.569602 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:30.570625 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:30.576835 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:30.577322 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:30.577790 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:30.578489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:30.578951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:30.579404 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:30.719844 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:30.728284 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-fdfd1e3d-54df-4990-8887-0534bd7e7957 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1553 microversion: 2.1 time: 0.164676 Sep 23 05:13:30.729224 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3897/7728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:30 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:30.750639 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:13:30.751281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:13:30.758359 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:30.758862 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:30.759319 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:30.760030 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:30.760523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:30.760961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:30.988389 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:13:30.996876 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-01b2cde6-53ff-459c-974d-8fefbbd85d2b tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1553 microversion: 2.1 time: 0.250085 Sep 23 05:13:30.997508 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3832/7729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:13:30 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:13:32.610856 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:13:32.616587 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=6 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:13:32.623483 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:13:32.623978 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:13:32.624431 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:13:32.637023 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] Creating event network-changed:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:13:32.642225 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-337e78ba-1b1a-425b-877c-ba4898ba1ce1 req-38fadee0-7401-4221-9a3b-8a4ef28d5d88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034920 Sep 23 05:13:32.642849 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3898/7730] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:29.903281 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:15:29.904384 n-d-858495-2 devstack@n-api.service[128723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:15:29.904760 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:29.905555 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:29.906817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:29.907478 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=34 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:29.908740 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 05:15:29.908890 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:15:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d/action (ip 10.222.0.25) !!! Sep 23 05:15:29.914455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1134171238"}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:29.916852 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:29.926440 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:29.926923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:29.927406 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:29.928118 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:29.928589 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:29.929289 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:30.129393 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c071814a-1d50-4240-bcbb-bd87e2736088 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "POST /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d/action" status: 202 len: 0 microversion: 2.1 time: 0.227901 Sep 23 05:15:30.130127 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3833/7731] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:15:29 2022] POST /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 05:15:36.897415 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:15:36.898575 n-d-858495-2 devstack@n-api.service[128724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:15:36.900005 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:36.901385 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=28 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:36.902295 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:15:36.902489 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 05:15:37.008536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "name": "network-vif-plugged", "status": "completed", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:37.020380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:37.020864 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:37.021292 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:37.034231 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] Creating event network-vif-plugged:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:15:37.039550 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-5aa47e65-3819-4a12-9d40-0f6c9369c888 req-40e0669d-d51f-4f44-ab79-a5415d06e6d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143961 Sep 23 05:15:37.040250 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3899/7732] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:43.712467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:43.713260 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:43.718086 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1259888102", "imageRef": "9033a63d-d813-4ad5-b6c4-f1d51143d621", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-965971728", "security_groups": [{"name": "tempest-secgroup-smoke-812933178"}], "networks": [{"uuid": "e3a20476-5c4c-438f-99ce-4774e1a4d100"}]}} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:43.744955 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d40b75e6-df19-4308-ba2c-add483221685] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57000. Sep 23 05:15:43.745830 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] [d42ecf37-7b09-4064-a446-f3479a3e651e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57002. Sep 23 05:15:43.831803 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.network.neutron [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] validate_networks() for [('e3a20476-5c4c-438f-99ce-4774e1a4d100', None, None, None, None, None)] {{(pid=128723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:15:44.251110 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Flavor limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:15:44.251576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Image limits 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:15:44.252076 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Flavor pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:15:44.252499 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Image pref 0:0:0 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:15:44.252926 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.virt.hardware [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:15:44.261877 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:44.262370 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:44.262822 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:44.263560 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:44.264029 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:44.264467 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:44.281592 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:15:44.287442 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.quota [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Getting quotas for user dcc7add552784370b4da8a63e7b041b2 and project 5df3ac6bffbe49a78cfdae2cd387f649. Resources: {'cores', 'instances', 'ram'} {{(pid=128723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:15:44.299753 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Going to run 1 instances... {{(pid=128723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:15:44.302286 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9033a63d-d813-4ad5-b6c4-f1d51143d621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:15:44.351905 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d767ddd3-7fac-47cc-baf8-fbf7a4da6bb0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.641495 Sep 23 05:15:44.352602 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3834/7733] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 23 05:15:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:15:44.364437 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9d5a648b-da2e-4f69-91d1-d7e57e06ca9a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:44.365200 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9d5a648b-da2e-4f69-91d1-d7e57e06ca9a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:44.385064 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [2910b42d-748b-4ccb-aa9d-5f9f17d1d48a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57020. Sep 23 05:15:44.390367 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ef45d4f-6d5c-4363-bd48-00c84fd916a4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57018. Sep 23 05:15:44.490511 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-9d5a648b-da2e-4f69-91d1-d7e57e06ca9a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:44.498008 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9d5a648b-da2e-4f69-91d1-d7e57e06ca9a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1248 microversion: 2.1 time: 0.137964 Sep 23 05:15:44.498634 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3900/7734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:44 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:15:45.522193 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:45.522762 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:45.529145 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:45.529680 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:45.530141 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:45.530854 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:45.531336 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:45.531820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:45.596116 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:45.604083 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d4e9eb7a-a301-4d15-941c-829c38b7d3e8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1252 microversion: 2.1 time: 0.086748 Sep 23 05:15:45.605032 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3835/7735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:45 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:46.627294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:46.628044 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:46.635919 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.636408 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.636850 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.637594 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.638086 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.638521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.704098 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:46.712075 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-1231977f-144a-44fe-90ee-ff0073a823d1 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1306 microversion: 2.1 time: 0.088673 Sep 23 05:15:46.725454 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3901/7736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:46 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:46.913296 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "name": "network-vif-unplugged", "status": "completed", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:46.930742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.931585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.932295 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.947502 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] Creating event network-vif-unplugged:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:15:46.954607 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6f737c2a-3bac-40ec-9a18-775010d64a30 req-5dc0f167-8827-4b5b-8999-3bd77c65cfb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046291 Sep 23 05:15:46.956233 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3836/7737] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:47.738529 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:47.739303 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:47.746724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:47.747232 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:47.747655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:47.749026 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:47.749523 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:47.749951 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:47.897595 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:47.907691 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5da68f11-87e2-4d0a-8d34-1c636b19e866 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.172739 Sep 23 05:15:47.909079 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3902/7738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:47 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:48.934784 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:48.935625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:48.942961 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.943625 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.944082 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:48.944828 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.945301 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.945770 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:49.089140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:49.101285 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-38eb6f18-4a2f-4d42-b702-76f886ac39ab tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.172983 Sep 23 05:15:49.109176 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3837/7739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:48 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:50.125231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:50.126311 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:50.133946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.134932 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.135601 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.136563 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.137237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.137946 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.278794 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:50.289099 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-5303a134-3b3b-45f4-b3df-d81c146c22ee tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.168219 Sep 23 05:15:50.289742 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3903/7740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:50 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:51.312399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:51.313596 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:51.322196 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:51.322702 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:51.323160 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:51.323888 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:51.324365 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:51.324808 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:51.482742 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:51.494514 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-56563251-c3a8-4e19-82e4-debc0123d09c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.185864 Sep 23 05:15:51.495312 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3838/7741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:51 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:52.518715 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:52.519383 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:52.526633 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:52.527122 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:52.527559 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:52.528267 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:52.528724 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:52.529156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:52.691651 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:52.700499 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8cda03fa-3ed0-4f73-9592-d60e75fb68cf tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.186231 Sep 23 05:15:52.701296 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3904/7742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:52 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:53.724161 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:53.724817 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:53.731879 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:53.732399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:53.732866 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:53.733628 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:53.734119 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:53.734576 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:53.880891 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:53.888951 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c7ec0ccc-170c-4a99-b529-e27c7d677952 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.169031 Sep 23 05:15:53.889592 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3839/7743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:53 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:54.913935 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:54.914620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:54.917286 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell0:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:54.923019 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:54.923508 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:54.923950 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:54.924655 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:54.925111 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:54.925572 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:55.068073 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:55.076092 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b2f911c6-c6a7-48bb-9ae0-58f1da4c98d0 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.166108 Sep 23 05:15:55.076677 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3905/7744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:54 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:56.098503 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:56.099138 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:56.101169 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:56.101874 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell0:SELECT=6 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:56.108857 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:56.109379 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:56.109929 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:56.110646 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:56.111129 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:56.111580 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:56.241476 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:56.249444 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-8d9f9347-ac0b-4172-94eb-8dba88d4ef7f tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.154913 Sep 23 05:15:56.250039 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3840/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:56 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:57.275489 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:57.276138 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:57.283575 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:57.284075 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:57.284521 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:57.285239 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:57.285739 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:57.286184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:57.423400 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:57.431328 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-c96eeea9-49df-4c4a-b032-8f1c02574338 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.159928 Sep 23 05:15:57.431915 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3906/7746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:57 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:57.623517 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:57.634400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:57.634898 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:57.635350 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:57.647063 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] Creating event network-changed:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:15:57.652628 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-c0642fd8-769d-46cd-8f28-c2855c6006f5 req-ba55efa3-67ea-45a5-a23d-74a8761259d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097910 Sep 23 05:15:57.653244 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3841/7747] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:58.454532 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:58.455144 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:58.463689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:58.464180 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:58.464620 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:58.465544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:58.466228 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:58.466781 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:58.596650 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:58.604589 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-ea3e4803-5a41-49af-b368-804690b175f2 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.154220 Sep 23 05:15:58.605160 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3907/7748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:58 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:15:59.627799 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:59.628551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:59.635747 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:59.636249 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:59.636709 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:59.637463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:59.637945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:59.638395 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:59.777738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:59.786694 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-05b9cff5-9c05-474d-b0b8-e637abb745a8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.163177 Sep 23 05:15:59.787565 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3842/7749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:59 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:00.815090 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:00.815704 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:00.822755 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:00.823235 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:00.823671 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:00.824361 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:00.824816 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:00.825242 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:00.960743 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:00.968414 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-17a58473-78ce-4825-8058-348f92eec67a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.157930 Sep 23 05:16:00.968991 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3908/7750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:00 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:01.991802 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:01.992591 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:01.999583 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:02.000091 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:02.000551 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:02.001281 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:02.001785 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:02.002232 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:02.133653 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:02.142053 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b67bb25c-3681-4ae2-a279-a1a671f20432 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.154285 Sep 23 05:16:02.142644 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3843/7751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:01 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:03.165686 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:03.166333 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:03.173259 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:03.173782 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:03.174229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:03.174930 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:03.175395 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:03.175830 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:03.307421 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:03.315554 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-e6a59745-342a-4d6b-bac8-386d76aae284 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.153863 Sep 23 05:16:03.316137 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3909/7752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:03 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:03.933633 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "name": "network-vif-plugged", "status": "completed", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:03.946697 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:03.947463 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:03.948424 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:03.960060 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] Creating event network-vif-plugged:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:16:03.965779 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-2b95e5ba-9068-4134-91eb-c43d136bf520 req-563446ea-09c3-414a-9a51-c26341e63f01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Sep 23 05:16:03.966726 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3844/7753] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:04.338108 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:04.338765 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:04.346201 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:04.346697 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:04.347148 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:04.347855 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:04.348325 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:04.348764 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:04.481184 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:04.489292 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-8881b6df-a637-4fc5-aebc-e8e6abc4284d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1373 microversion: 2.1 time: 0.155103 Sep 23 05:16:04.489892 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3910/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:04 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:05.515197 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:05.515992 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:05.523213 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:05.523723 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:05.524181 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:05.524905 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:05.525399 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:05.525851 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:05.660297 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:05.668428 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-32d9c0a3-3ebc-42e8-92fe-eb912d48f8b8 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1555 microversion: 2.1 time: 0.157532 Sep 23 05:16:05.669028 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3845/7755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:05 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:05.691698 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:05.692317 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:16:05.699204 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:05.699690 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:05.700134 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:05.700828 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:05.701288 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:05.701744 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:05.836913 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:16:05.845103 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b8294592-284a-4f49-bf8c-8908e7947ace tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1555 microversion: 2.1 time: 0.157303 Sep 23 05:16:05.845719 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3911/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:16:05 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:16:07.783492 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:07.793620 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:07.794208 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:07.794767 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:07.806360 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] Creating event network-changed:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:16:07.811625 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-5c6a0fba-0be2-4009-99fb-f447a60a073d req-c853867e-f179-4db9-9094-cc76e14ac8c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090018 Sep 23 05:16:07.813237 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3846/7757] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:06.705689 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=28 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:06.706447 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=68 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:06.707459 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 05:18:06.707632 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535/action (ip 10.222.0.25) !!! Sep 23 05:18:06.708638 n-d-858495-2 devstack@n-api.service[128724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:18:06.708827 n-d-858495-2 devstack@n-api.service[128724]: Fri Sep 23 05:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535/action (ip 10.222.0.25) !!! Sep 23 05:18:06.715156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1789028165"}} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:06.717636 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:06.727060 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:06.727550 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:06.728001 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:06.728707 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:06.729172 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:06.729643 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:06.932834 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-153b61d0-fa35-4371-9d7c-8566f7acde4d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "POST /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535/action" status: 202 len: 0 microversion: 2.1 time: 0.228999 Sep 23 05:18:06.933530 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3912/7758] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 23 05:18:06 2022] POST /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 05:18:12.657074 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:12.657956 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=58 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:12.659308 n-d-858495-2 devstack@n-api.service[128723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:18:12.659749 n-d-858495-2 devstack@n-api.service[128723]: Fri Sep 23 05:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 23 05:18:12.667314 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "name": "network-vif-plugged", "status": "completed", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:12.688738 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:12.689230 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:12.689706 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:12.701885 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] Creating event network-vif-plugged:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:18:12.707351 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-dd04b347-36ed-4c8f-80c9-0a73bdc48c9a req-b5529ed7-4cb2-451c-b62a-46c6e16f4294 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052304 Sep 23 05:18:12.707942 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3847/7759] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:18:24.817695 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_api:SELECT=2 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:24.818482 n-d-858495-2 devstack@n-api.service[128724]: DEBUG dbcounter [-] [128724] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:24.819806 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_api:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:24.821403 n-d-858495-2 devstack@n-api.service[128723]: DEBUG dbcounter [-] [128723] Writing DB stats nova_cell1:SELECT=2 {{(pid=128723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:24.823854 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:24.824564 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:24.827512 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:24.833641 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:24.834170 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:24.834832 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:24.836359 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:24.836836 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:24.837270 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:24.840234 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:24.840745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:24.841210 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:24.853282 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] Creating event network-changed:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:18:24.858717 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-cad73a07-d789-4db4-b86e-d9a64ef4799c req-8139b25a-4259-43e9-b806-8d1554eae130 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041160 Sep 23 05:18:24.859342 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3848/7760] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:24.868741 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Going to try to terminate instance {{(pid=128724) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:18:24.956592 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-b63f7534-45f3-40b5-bc02-64f282043c84 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 204 len: 0 microversion: 2.1 time: 0.141109 Sep 23 05:18:24.965450 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3913/7761] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:18:24 2022] DELETE /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:18:24.968601 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:24.969597 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:24.977672 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:24.978191 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:24.978686 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:24.979460 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:24.979945 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:24.980400 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:25.116388 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:25.124885 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-d7d7020f-8cf5-4636-beee-c1a9925db653 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1680 microversion: 2.1 time: 0.162433 Sep 23 05:18:25.125515 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3849/7762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:24 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:26.149328 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:26.149988 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:26.156740 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:26.157231 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:26.157709 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:26.158409 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:26.158868 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:26.159301 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:26.297728 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:26.305908 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-191be71a-2e98-496e-a6e3-c465c69c51aa tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1680 microversion: 2.1 time: 0.160960 Sep 23 05:18:26.306765 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3914/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:26 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:26.721923 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "name": "network-vif-unplugged", "status": "completed", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:26.743015 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:26.743520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:26.743976 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:26.764626 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.compute.server_external_events [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] Creating event network-vif-unplugged:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:18:26.775326 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [req-6867da85-8c4b-4cbc-942c-6a6438ed9ae1 req-b2ac48ef-14a4-48e3-b262-e3390423ab5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057089 Sep 23 05:18:26.776984 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3850/7764] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:27.217875 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3917aeb-6462-4576-9928-d027c7559535", "name": "network-vif-deleted", "tag": "1a726a92-516a-4318-b2dd-e2c5b8dc0a10"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:27.228629 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:27.229110 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:27.229598 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:27.240679 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] Creating event network-vif-deleted:1a726a92-516a-4318-b2dd-e2c5b8dc0a10 for instance b3917aeb-6462-4576-9928-d027c7559535 on n-h2-858495-2 Sep 23 05:18:27.245646 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-107d9923-a164-4c8f-b302-bd3829a0257f req-18ea050a-370f-45e9-83f8-7ffd4845858d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032207 Sep 23 05:18:27.246232 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3915/7765] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:27.332880 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:27.333649 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:27.340585 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:27.341097 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:27.341599 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:27.342326 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:27.342809 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:27.343263 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:27.375408 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:27.375917 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:27.376382 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:27.376859 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.objects.instance [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lazy-loading 'fault' on Instance uuid b3917aeb-6462-4576-9928-d027c7559535 {{(pid=128723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:18:27.424853 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:27.434570 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-086256d0-1eae-4ce1-9db6-6b55530f2fe9 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 200 len: 1338 microversion: 2.1 time: 0.107152 Sep 23 05:18:27.435195 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3851/7766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:27 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:28.459544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:28.460261 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: b3917aeb-6462-4576-9928-d027c7559535] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:28.467051 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:28.467544 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:28.468229 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:28.468729 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:28.469187 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:28.469647 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:28.483920 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.wsgi [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] HTTP exception thrown: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Request method failure captured: Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: request: GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 HTTP/1.1 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Accept: application/json Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Accept-Encoding: identity Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Connection: close Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Content-Length: 0 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Content-Type: application/json Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Host: 10.222.0.25 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: Openstack-System-Scope: None Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: User-Agent: python-urllib3/1.26.12 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Auth-Token: gAAAAABjLUBpMCMNpFF7vHVDZ3hQxwZjxaQs4pCNMYmOZdsAu2PrgznLtFnPPSmkpsPUL-8Mbn2CplUtlPeIQIbadZRMOnPTaJJte3UiFnHwzYXW193vZOXQGwk9uaZ8OojYl2ytDpTKADV5KcEph9yn7QG_o7rSBPwQlDzTNxTeKyAKXb_2VTo Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Id: None Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Domain-Name: None Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Identity-Status: Confirmed Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Is-Admin-Project: True Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Id: default Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Domain-Name: Default Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Id: 5df3ac6bffbe49a78cfdae2cd387f649 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Project-Name: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Role: reader,member Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Roles: reader,member Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Id: 5df3ac6bffbe49a78cfdae2cd387f649 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-Tenant-Name: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-User: tempest-TestSnapshotPattern-1289073968-project Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Id: default Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-User-Domain-Name: Default Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-User-Id: dcc7add552784370b4da8a63e7b041b2 Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: X-User-Name: tempest-TestSnapshotPattern-1289073968-project Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: method: > Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: exception: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: action_args: {'id': 'b3917aeb-6462-4576-9928-d027c7559535'} Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:18:28.485519 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: ERROR nova.api.openstack.wsgi Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Returning 404 to user: Instance b3917aeb-6462-4576-9928-d027c7559535 could not be found. {{(pid=128724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-9a23f96d-8da1-4118-a751-3a97316bc689 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535" status: 404 len: 111 microversion: 2.1 time: 0.032672 Sep 23 05:18:28.491293 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3916/7767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:28 2022] GET /compute/v2.1/servers/b3917aeb-6462-4576-9928-d027c7559535 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:18:29.812913 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:29.813523 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:29.815380 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:29.820538 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:29.821264 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:29.821744 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:29.822462 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:29.822937 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:29.823386 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:29.832196 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:29.832938 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:29.833571 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:29.846411 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] Creating event network-changed:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:18:29.850345 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Going to try to terminate instance {{(pid=128723) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:18:29.852291 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-56bdde59-5a65-4fe6-8d45-38b2efb02da0 req-fd5c41ac-a399-4f99-97eb-413482879c61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 Sep 23 05:18:29.853409 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3917/7768] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:18:29.947413 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-1b39cd35-5db1-4ba5-bec8-d968e2b5312d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 204 len: 0 microversion: 2.1 time: 0.138436 Sep 23 05:18:29.948466 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3852/7769] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 23 05:18:29 2022] DELETE /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:18:29.957156 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:29.958002 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.compute.api [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128724) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:29.965536 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:29.966147 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:29.966786 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:29.967691 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:29.968215 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:29.968840 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:30.107645 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.policy [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128724) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:30.115844 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-d2d97f09-cb8c-46c0-84fe-8fb145600f1a tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1677 microversion: 2.1 time: 0.162885 Sep 23 05:18:30.116522 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3918/7770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:29 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:31.141305 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:31.142105 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:31.149520 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:31.150042 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:31.150511 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:31.151254 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:31.152404 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:31.152860 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:31.523855 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.policy [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc7add552784370b4da8a63e7b041b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df3ac6bffbe49a78cfdae2cd387f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128723) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:31.532947 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-c1164047-00a9-4dce-ad82-2cf35365e66d tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 200 len: 1492 microversion: 2.1 time: 0.396320 Sep 23 05:18:31.533881 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3853/7771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:31 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 1492 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:31.872614 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1648710-bc26-4f8c-b621-03e1442f223d", "name": "network-vif-deleted", "tag": "0b232d45-993a-45e8-9dcc-eef70983763c"}]} {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:31.883331 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:31.883806 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:31.884237 n-d-858495-2 devstack@n-api.service[128724]: DEBUG oslo_concurrency.lockutils [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:31.896426 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.compute.server_external_events [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] Creating event network-vif-deleted:0b232d45-993a-45e8-9dcc-eef70983763c for instance d1648710-bc26-4f8c-b621-03e1442f223d on n-h1-858495-2 Sep 23 05:18:31.901667 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [req-4b5082fd-0771-4090-b905-6d78d076be02 req-b8e82f27-e243-4818-a6aa-619f570d6905 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 Sep 23 05:18:31.902266 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3919/7772] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:32.556273 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '>' {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:32.557154 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.compute.api [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] [instance: d1648710-bc26-4f8c-b621-03e1442f223d] Fetching instance by UUID {{(pid=128723) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:32.564140 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:32.564637 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:32.565090 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:32.565820 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Acquiring lock "7f22f53f-b9cc-4e97-a884-e2597a729053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:32.566300 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:32.566745 n-d-858495-2 devstack@n-api.service[128723]: DEBUG oslo_concurrency.lockutils [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Lock "7f22f53f-b9cc-4e97-a884-e2597a729053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:32.580778 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.wsgi [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] HTTP exception thrown: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Request method failure captured: Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: request: GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d HTTP/1.1 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Accept: application/json Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Accept-Encoding: identity Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Connection: close Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Content-Length: 0 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Content-Type: application/json Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Host: 10.222.0.25 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: Openstack-System-Scope: None Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: User-Agent: python-urllib3/1.26.12 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Auth-Token: gAAAAABjLUBpMCMNpFF7vHVDZ3hQxwZjxaQs4pCNMYmOZdsAu2PrgznLtFnPPSmkpsPUL-8Mbn2CplUtlPeIQIbadZRMOnPTaJJte3UiFnHwzYXW193vZOXQGwk9uaZ8OojYl2ytDpTKADV5KcEph9yn7QG_o7rSBPwQlDzTNxTeKyAKXb_2VTo Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Id: None Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Domain-Name: None Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Identity-Status: Confirmed Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Is-Admin-Project: True Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Id: default Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Domain-Name: Default Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Id: 5df3ac6bffbe49a78cfdae2cd387f649 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Project-Name: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Role: reader,member Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Roles: reader,member Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5df3ac6bffbe49a78cfdae2cd387f649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Id: 5df3ac6bffbe49a78cfdae2cd387f649 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-Tenant-Name: tempest-TestSnapshotPattern-1289073968 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-User: tempest-TestSnapshotPattern-1289073968-project Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Id: default Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-User-Domain-Name: Default Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-User-Id: dcc7add552784370b4da8a63e7b041b2 Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: X-User-Name: tempest-TestSnapshotPattern-1289073968-project Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: method: > Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: exception: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: action_args: {'id': 'd1648710-bc26-4f8c-b621-03e1442f223d'} Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: {{(pid=128723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:18:32.582455 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: ERROR nova.api.openstack.wsgi Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: DEBUG nova.api.openstack.wsgi [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Returning 404 to user: Instance d1648710-bc26-4f8c-b621-03e1442f223d could not be found. {{(pid=128723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: INFO nova.api.openstack.requestlog [None req-b220e783-a543-4c30-9d03-63f7de8dc613 tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d" status: 404 len: 111 microversion: 2.1 time: 0.031658 Sep 23 05:18:32.587609 n-d-858495-2 devstack@n-api.service[128723]: [pid: 128723|app: 0|req: 3854/7773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:32 2022] GET /compute/v2.1/servers/d1648710-bc26-4f8c-b621-03e1442f223d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:18:32.742294 n-d-858495-2 devstack@n-api.service[128724]: DEBUG nova.api.openstack.wsgi [None req-3d86c115-93a7-4d8e-a7c9-821cb39d601c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] Calling method '.version_select at 0x7f0c8b1b8c10>' {{(pid=128724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:32.768951 n-d-858495-2 devstack@n-api.service[128724]: INFO nova.api.openstack.requestlog [None req-3d86c115-93a7-4d8e-a7c9-821cb39d601c tempest-TestSnapshotPattern-1289073968 tempest-TestSnapshotPattern-1289073968-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-965971728" status: 202 len: 0 microversion: 2.1 time: 0.031008 Sep 23 05:18:32.769758 n-d-858495-2 devstack@n-api.service[128724]: [pid: 128724|app: 0|req: 3920/7774] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Sep 23 05:18:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-965971728 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)